Deploying Qwen 3.0 Based on RK3588
Requires the following versionRKLLM https://github.com/airockchip/rknn-llm/tree/release-v1.2.1b1 Install theRKLLM-Toolkit for this version, otherwise the model conversion may fail. Download the model file, taking Qwen3-0.6B as an example https://www.modelscope.cn/models/Qwen/Qwen3-0.6B Modify rknn-llm/examples/DeepSeek-R1-Distill-Qwen-1.5B_Demo/export/export_rkllm.py Changemodelpath to the downloadedQwen3 directory modelpath = ‘/home/andy/rkllm/Qwen3-0.6B’ Executepython export_rkllm.py to convert to therkllm supported model format. INFO: rkllm-toolkit version: 1.2.1b1WARNING: Cuda device not available! switch to … Read more
