Introduction MindIE (Mind Inference Engine) is Huawei’s Ascend inference acceleration suite designed for AI applications across various scenarios. By providing layered open AI capabilities, it supports diverse AI business needs, enabling a multitude of models and releasing the computational power of Ascend hardware devices. It supports multiple mainstream AI frameworks and interfaces with various types … Read more
Efficiently and conveniently performing large model inference on the Ascend NPU has long been a core challenge faced by domestic developers. Although Huawei officially provides the high-performance MindIE inference engine, its high usage threshold and complex environment configuration have somewhat limited its rapid application and iteration within the broader developer community. This is not only … Read more
Recently, SmartX launched the DeepSeek solution based on AI infrastructure, providing a unified infrastructure resource stack for both AI large models and other enterprise business systems, helping enterprises quickly advance the implementation and validation processes of large models. At the same time, considering the needs of users in industries such as finance and healthcare for … Read more
Step 1: First, apply for the device from Ascend, and obtain the Atlas 800 9000 server. Use the official account and password provided by Ascend to ensure you can log into the server. (1) Update the drivers, as the image provided by Ascend requires a specific version of the driver firmware. Download and install the … Read more
1. Deployment MethodUtilizingopenEuler 22.03 LTS SP4 + twoAscend NPUs, using Docker to launch themindIEimage, the model used is deepseek-32bDeployment process is as follows:1. Install the server operating system2. Install NPU drivers3. Install Docker and download the MindIE image4. Download the large model files5. Launch the MindIE image and load the large model6. Test the output … Read more