Devadex

1Cat-vLLM

github   Free   by donitb934
5★Python

Optimize Tesla V100 GPUs for AWQ 4-bit inference with improved speed, stability, and support for modern large models like Qwen3.5 and MoE.

Get it → github.com
Related:
4xapicatscivclicompilerdistributedgitjavalanguage

Found on Devadex — the discovery index for independent software the big search engines bury. More from github.

Report this listing