Local Deployment of DeepSeek-R1 Large Model on RK3588 Platform: NPU Edition
Using the NPU to run inference on large models can more effectively plan resource allocation, achieving more efficient applications. 1 Preparation Before Deployment To deploy large language models using the NPU on RK3588, the following files need to be prepared in advance, which include the corresponding files for Rockchip’s NPU and the DeepSeek inference model … Read more