DeepSeek, a rising star in the AI landscape, has made headlines by utilizing Huawei’s Ascend 910C AI chips for inference in its latest model, DeepSeek R1. This strategic move highlights China’s growing capabilities in artificial intelligence, especially in the face of US export restrictions on advanced technology.
Key Takeaways
- DeepSeek R1 is trained on NVIDIA H800 GPUs but uses Huawei’s Ascend 910C for inference.
- The Ascend 910C chip is designed to be a cost-effective alternative to NVIDIA’s offerings.
- DeepSeek’s chatbot has become the top app in 51 countries, showcasing its competitive edge.
- Huawei plans to release the Ascend 920C chip to further enhance its AI capabilities.
DeepSeek’s Rise in the AI Market
DeepSeek, established in 2023, has quickly positioned itself as a formidable competitor in the AI sector. Its large-language model (LLM), DeepSeek R1, has gained significant traction, particularly due to its cost efficiency compared to US counterparts. The model’s success is attributed to its open-source nature and the affordability of its services, which are significantly lower than those of established players like OpenAI.
The Role of Huawei’s Ascend 910C Chip
The Ascend 910C chip is pivotal for DeepSeek’s inference processes. While the training of the model is handled by NVIDIA’s powerful H800 GPUs, the inference—where the model generates responses—is executed on the Huawei chip. This dual approach allows DeepSeek to leverage the strengths of both technologies, optimizing performance while minimizing costs.
- Inference vs. Training: In AI, training involves teaching a model using vast datasets, requiring substantial computational power. In contrast, inference is the application of the trained model to new data, which demands less processing power. This makes the Ascend 910C a suitable choice for DeepSeek’s needs.
I feel this should be a much bigger story: DeepSeek has trained on Nvidia H800 but is running inference on the new home Chinese chips made by Huawei, the 910C. pic.twitter.com/6IAgQlQ3ou
— Alexander Doria (@Dorialexander) January 28, 2025
Competitive Landscape
DeepSeek’s emergence is particularly noteworthy given the current geopolitical climate, where US export restrictions have limited access to advanced AI chips for Chinese companies. By utilizing Huawei’s domestically produced chips, DeepSeek not only circumvents these restrictions but also showcases the potential of Chinese technology in the global AI arena.
Future Developments
Looking ahead, Huawei is set to release the Ascend 920C chip, which aims to compete directly with NVIDIA’s leading products. This development could further bolster DeepSeek’s capabilities and solidify its position in the market. As the AI race intensifies, the competition between Chinese and US tech firms is expected to drive innovation and reshape the industry landscape.
Conclusion
DeepSeek’s innovative use of Huawei’s Ascend 910C AI chips for inference marks a significant milestone in the AI sector. As the company continues to grow and evolve, it stands as a testament to the advancements in Chinese technology and the shifting dynamics of the global AI market.
