Devadex

squish

github   Free   by konjoai
10★Python

⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-response time. OpenAI/Ollama-compatible. No cloud, no API keys.

Get it → squish.run
Related:
apple-siliconinference-engineint4kv-cachellama-cpp-alternativellmllm-infernecelocal-ailocal-llmmacos

Found on Devadex — the discovery index for independent software the big search engines bury. More from github.

Report this listing