gpu-scheduling — independent software & tools
-
ollama-mesh
The control plane for self-hosted AI inference. Warm-state GPU routing, multi-runtime orchestration across Ollama, vLLM, llama.cpp, and TGI. Single Go binary. Apache-2.0.
The control plane for self-hosted AI inference. Warm-state GPU routing, multi-runtime orchestration across Ollama, vLLM, llama.cpp, and TGI. Single Go binary. Apache-2.0.