Why run AI on your computer?
If you want AI to work directly on your computer instead of relying entirely on an online AI service, we’ll help you find out what your computer can handle and whether it makes sense for you.
Run AI directly on your computer — even without internet. Keep more of your data private, reduce ongoing usage costs, and find a model that fits your machine.
If you want AI to work directly on your computer instead of relying entirely on an online AI service, we’ll help you find out what your computer can handle and whether it makes sense for you.
estimated memory = model weights + quantization overhead + KV cache + workspace + runtime reserve + safety margin
We’ll use what your browser can see, then ask you to confirm anything it cannot know reliably.
lspci and free -h.
Think of it as having a smaller version of an AI assistant such as ChatGPT running directly on your own computer. Instead of sending every question to a company’s servers, the model can process it locally on your machine.
Installing a local AI model does not automatically give it control of your computer. By default, it responds to what you type into it. As with any software, only install trusted tools and models from reputable sources.
Maybe not. If you’re happy using online AI services and don’t need offline use or extra privacy, you may not need to install anything. LocalAI is here to help you understand the choice — not to convince you that everyone needs local AI.
Nothing is installed automatically. These are simply step-by-step instructions based on your selected computer and recommended model.
Open Terminal or PowerShell and run:
ollama run MODELOnce the model downloads, you can chat with it directly on your computer.