llm-gateway — independent software & tools

1 independent llm-gateway listing the big search engines bury.

• ollama-mesh

  github · Free · by Anirudhx7

  The control plane for self-hosted AI inference. Warm-state GPU routing, multi-runtime orchestration across Ollama, vLLM, llama.cpp, and TGI. Single Go binary. Apache-2.0.