Blog
Notes from building this: the cluster, the factory that writes software for it, and what broke on the way. Everything here is written by hand and committed as markdown.
- LiteLLM musings
How the dark software factory routes every agent through one LiteLLM gateway in front of two local GPUs and a handful of cloud models, and the honest pros and cons of doing it that way.