inference — independent software & tools

13 independent inference listings the big search engines bury.

• fak

  github · Free · by anthony-chaudhary

  fak — the Fused Agent Kernel: one Go binary for AI agent loops. Wrap Claude Code/Codex/Cursor, keep long sessions cache-efficient, route work per call, run local GGUF models, and adjudicate tool calls.

• eco-mesh-sdk

  github · Free · by benlmadan9-star

  Mica Plugin 2026: Route AI Inference Through Green Energy MVM Nodes to Cut Token Costs by 60%

• clickllm

  github · Free · by dshakes

  Prove which open model can replace your closed one — on your traffic, your hardware, your budget. Then move you there without a risky cutover.

• agent-nuvira

  npm · Free · by imdheerajsharma

  Agent-Nuvira: Multi-agent AI coding CLI — plan, write, review, test, and publish code with local models (Ollama) or cloud APIs (Groq, NVIDIA NIM, Google Gemini, OpenRouter)

• @huggingface/inference

  npm · Free · by GitHub Actions

  Typescript client for the Hugging Face Inference Providers and Inference Endpoints

• amazon-sorftime-research-MCP-skill

  github · Free · by asl4

  Analyze Amazon listings and categories using Sorftime MCP to deliver detailed competitor insights and automated product selection.

• OpenProcessor

  github · Free · by davidamacey

  Self-hosted visual AI processing engine for object detection, face recognition, CLIP embeddings, OCR, and vector search. Built on FastAPI, NVIDIA Triton Inference Server, and TensorRT.

• nano-banana-cli

  github · Free · by erikceballos

  🖼️ Generate and edit images with ease using the Nanobanana CLI, powered by AI and Google's Gemini models for advanced image manipulation.

• atlas.llm

  github · Free · by fezcode

  Local AI coding companion in a single Go binary. Bubbletea chat TUI with on-device inference via llamafile, plus one-shot --summarize and --dump modes for turning a repo into LLM-ready Markdown.

• NanoBanana-PPT-Skills

  github · Free · by girish6055

  🎨 Generate high-quality PPTs with AI, featuring smart transitions and interactive playback for seamless presentations and engaging visuals.

• gglib

  github · Free · by mmogr

  Download, manage, and chat with LLMs, completely private and local.

• nano-banana-pro-prompts-recommend-skill

  github · Free · by PedroCouto839

  🖼️ Generate stunning images easily with intelligent prompts from a database of 6000+ curated options, tailored to your specific needs.

• captainslog-whisper

  github · Free · by ZeiraxGaming

  Convert your voice to text locally using Whisper without sending data to the cloud or requiring accounts.