Blog

Notes from building this: the cluster, the factory that writes software for it, and what broke on the way. Everything here is written by hand and committed as markdown.

  • LiteLLM musings

    How the dark software factory routes every agent through one LiteLLM gateway in front of two local GPUs and a handful of cloud models, and the honest pros and cons of doing it that way.

    · 3 min read · llm, homelab, devops, litellm