What is Quartermaster

Quartermaster is an all-in-one local inference engine - a front-end over llama.cpp (text/vision models) and stable-diffusion.cpp (images) that runs entirely on your own machine. Nothing is sent to a cloud service; weights, prompts, and conversations stay local.

It discovers the model files you have on disk, works out sensible runtime settings for each one automatically (context length, GPU offload, KV cache), and hot-swaps models in and out of VRAM on demand - a request for a model that isn't loaded triggers a load (evicting others if needed).

Two web UIs: the operator dashboard (main port - catalog, loading, config, metrics) and the playground (its own port - chat, images, speech, transcription, rerank).

This page is generated from the help wiki that ships inside the app: the same text you get from the Help button, and the same text the playground assistant searches. Corrections go to wiki_articles.json.