MindIE

New Ascend NPU and MindIE Support Capabilities in SmartX AI Infrastructure: Solutions and Evaluations

by
New Ascend NPU and MindIE Support Capabilities in SmartX AI Infrastructure: Solutions and Evaluations

Recently, SmartX launched the DeepSeek solution based on AI infrastructure, providing a unified infrastructure resource stack for both AI large models and other enterprise business systems, helping enterprises quickly advance the implementation and validation processes of large models. At the same time, considering the needs of users in industries such as finance and healthcare for … Read more

Deploying DeepSeek-32Bw8a8+Dify Knowledge Base Application on Ascend Servers/Development Boards

by
Deploying DeepSeek-32Bw8a8+Dify Knowledge Base Application on Ascend Servers/Development Boards

Step 1: First, apply for the device from Ascend, and obtain the Atlas 800 9000 server. Use the official account and password provided by Ascend to ensure you can log into the server. (1) Update the drivers, as the image provided by Ascend requires a specific version of the driver firmware. Download and install the … Read more

Deploying DeepSeek Large Model on Kunpeng Server with openEuler and Ascend NPU

by
Deploying DeepSeek Large Model on Kunpeng Server with openEuler and Ascend NPU

1. Deployment MethodUtilizingopenEuler 22.03 LTS SP4 + twoAscend NPUs, using Docker to launch themindIEimage, the model used is deepseek-32bDeployment process is as follows:1. Install the server operating system2. Install NPU drivers3. Install Docker and download the MindIE image4. Download the large model files5. Launch the MindIE image and load the large model6. Test the output … Read more