When data can’t leave the building
For many organisations the blocker to using AI isn’t capability — it’s that contracts, regulation or common sense forbid sending client files, source code, patient notes or financial records to a third-party API. Self-hosting open-weight models removes that blocker: the model runs on your hardware or in your private cloud account, and nothing is sent elsewhere.
We run this stack ourselves. Dhii Chat is a self-hosted AI workspace built on Open WebUI and Ollama, operated on our own server. The lessons from running it — authentication, mail flows for sign-up and password reset, branding, model management, updates — go into every client deployment.
Picking the right model
There is no single best open model. We benchmark candidates on your tasks — your documents, your questions, your languages — and report quality alongside speed, memory footprint and licence terms (some open models have usage restrictions). Quantisation often lets a larger, better model fit on smaller hardware with minimal quality loss; we measure that trade-off rather than assuming it.
Production-grade serving
For a handful of users, Ollama on a single machine is enough. For a company-wide assistant or an API used by several applications, we deploy vLLM or TGI with continuous batching, behind an OpenAI-compatible gateway such as LiteLLM so your apps can switch between local and hosted models with a configuration change.
A usable workspace
People need an interface, not an endpoint. Open WebUI provides a polished chat experience with document upload, shared prompts, user groups and admin controls; we integrate it with your single sign-on and set sensible usage limits. Where you need something more tailored, we build a custom interface on the same backend.
Everything is documented: how to add a model, how to upgrade safely, how to restore from backup, and what to check when something is slow.