What is a local LLM, in plain words

A “local” AI is one that runs on your own computer, not on someone else’s servers far away.

That one change carries most of the weight of this whole site. When the model lives on your machine, your words stay in the room, it costs nothing to run, and it works with no internet at all: on a train, on a plane, in a blackout.

The big cloud AIs are wonderful, and this is not against them. It is simply another option, one where the model runs on your own machine, and you get to see the quiet wonder of it working right there in front of you.

What “LLM” means

LLM is short for large language model. It is the kind of AI behind a chatbot: you give it words, it gives you words back. “Local” just says where it runs. So a local LLM is that same kind of chatbot, living on your device instead of in a data centre.

You do not need special hardware to try it

A recent laptop can run a small model today. A modern phone can too. It will be slower than the big cloud ones, and the small models are less clever - but it is real, and it is yours. Start small, get a feel for it, and grow from there.

Why anyone bothers

Three quiet reasons, and they are enough:

• Private. What you type stays on your machine. Nothing is sent away.
• Free to run. No subscription, no per-message cost. You already own the computer.
• Always there. No internet needed once the model is downloaded. It stays exactly as it is, for as long as you keep it.

That is the whole idea: a capable model running quietly on your own machine. The rest of this site is just how to get there, one calm step at a time.