“Training a large model costs tens of millions of dollars in computing power,” “GPU server prices have doubled and are still hard to obtain,” “Half of the GPUs in the cluster are idle and cannot be scheduled”—this is the most genuine computing power anxiety in the current AI industry. As the industry struggles with computing … Read more
“Training a large model costs tens of millions of dollars in computing power,” “GPU server prices have doubled and are still hard to obtain,” “Half of the GPUs in the cluster are idle but cannot be scheduled”—this reflects the most genuine computing power anxiety in the current AI industry. As the industry struggles with computing … Read more
Translator’s Note In today’s world, where the demand for AI computing power is growing exponentially, the bottleneck of computing power has gradually shifted from the pure computing capability of chips to the communication efficiency between chips. NVIDIA has built a strong moat with its NVLink and InfiniBand technologies. Huawei’s UB-Mesh, showcased at Hot Chips, is … Read more