inference-engine — independent software & tools

1 independent inference-engine listing the big search engines bury.

• squish

  github · Free · by konjoai

  ⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-response time. OpenAI/Ollama-compatible. No cloud, no API keys.