RKLLama: LLM Server and Client for Rockchip 3588/3576 Chips
Address:https://github.com/NotPunchnox/rkllama RKLLama is an open-source server and client solution designed to run large language models (LLMs) optimized for the Rockchip RK3588 (S) and RK3576 platforms, and to interact with them. Unlike solutions such as Ollama or Llama.cpp, RKLLama fully utilizes the Neural Processing Units (NPU) on these devices, providing an efficient and high-performance solution for … Read more