OpenAI API

Usage: git clone https://github.com/huonwe/rkllm_openai_like_api.gitcd rkllm_openai_like_api Add the required dynamic libraries: sudo cp lib/*.so /usr/lib Installuv: curl -LsSf https://astral.sh/uv/install.sh | sh Installpythondependencies: uv sync Run: uv run server.py By default, the platform is set to rk3588, the model path is models/deepseek-r1-1.5b-w8a8.rkllm, and the listening port is 8080. You can manually specify parameters, such as uv run … Read more