Global data center GPU shipments to reach 3.85 million in 2023

2024-07-09 12:18
 121
According to TechInsights data, the total global data center GPU shipments will reach 3.85 million in 2023, of which NVIDIA will ship 3.76 million. NVIDIA H100 accelerator card costs more than $25,000, and the new generation AI GPU B200 costs about $30,000 to $40,000. If the large model capabilities increase 10 times each year, the hardware infrastructure performance must also be enhanced 10 times. Although the number of AI chips required will not increase 10 times, the cost may increase 10 times.