Skip to content
PickZeal

    Topic: Local LLMs

    How to Run an LLM Locally: Models, Tools and Hardware

    A local LLM is a language model that runs on your own computer instead of on a company server. Your prompts never leave the machine, it works offline and there is no subscription.

    Getting one running comes down to three choices: a model small enough for your RAM or VRAM, a quantized file format such as GGUF Q4_K_M that shrinks it to fit, and an app that runs it, such as Ollama, LM Studio or llama.cpp. The guides below start from the hardware you already have.

    4 guides

    Guides

    Browse all topics