Devadex

Quartermaster

github   Free   by Quartermaster-Labs
89d old18★Go
Capabilities: AIMachine LearningAPI   Platforms: Go

Run any model without tuning a single flag. Text, image and audio on one machine: Quartermaster works out what fits in your VRAM, launches each model with computed flags, and hot-swaps them on demand behind one OpenAI- and Anthropic-compatible API.

Get it → quartermaster-labs.github.io
Related:
aianthropic-apiggufgolangimage-generationinference-serverllama-cppllamacppllmllm-serving

Found on Devadex — the discovery index for independent software the big search engines bury. More from github.

Report this listing