● Start
Architecture.
Three parts, one of them optional.
Everything the user does happens on the phone. The only network traffic is the model download and, if you use one, the settings from your console.
01The picture
02The parts
- The app (
app/lib): screens and logic in Dart; state withprovider; history in SQLite. - The engine (
app/packages/pocket_llm): a small C API over llama.cpp, mtmd and whisper.cpp, called throughdart:ffiin a background isolate so the screen never freezes. - The console (
admin/, optional): serves one JSON document,/v1/config(docs/CONTRACT.md).