internlm2 — independent software & tools
-
llm-compress
Compress context data to optimize memory and performance in C++ large language model applications within the llm-cpp toolkit.
Compress context data to optimize memory and performance in C++ large language model applications within the llm-cpp toolkit.