Beiträge
Serving and routing local LLMs with LLMhop
4. Juni 2026
#nix #llm
A tiny OpenAI-compatible router paired with a NixOS module that runs the inference servers for you.
Weiterlesen
Packaging llmster with Nix
4. Februar 2026
#nix #llm
Insights into packaging the headless LM Studio server using Nix for reliable deployment.
Weiterlesen