Devadex

ollama-mesh

github   Free   by Anirudhx7
51d old1★Go

The control plane for self-hosted AI inference. Warm-state GPU routing, multi-runtime orchestration across Ollama, vLLM, llama.cpp, and TGI. Single Go binary. Apache-2.0.

Get it → anirudh.social
Related:
ai-infrastructureanthropiccontrol-planegolanggpugpu-schedulinghomelablitellm-alternativellmllm-gateway

Found on Devadex — the discovery index for independent software the big search engines bury. More from github.

Report this listing