According to current experiences from LatePost, main Chinese web corporations which have a cloud computing enterprise have positioned substantial orders with NVIDIA following this 12 months’s Spring Festival. ByteDance, for instance, has ordered over $1 billion in GPUs from NVIDIA this 12 months.
One supply near NVIDIA acknowledged that ByteDance has to this point acquired a complete of 100,000 A100 and H800 accelerator playing cards, together with each delivered and pending orders. Notably, the H800 solely started manufacturing in March of this 12 months. It was revealed that the orders from ByteDance alone this 12 months may strategy the complete variety of business GPUs NVIDIA offered in China final 12 months.
A ByteDance insider shared that in June 2020, after the launch of GPT-3, the firm had skilled a generative language mannequin with a number of billion parameters utilizing the V100 computing card. However, because of the restricted parameter scale, the mannequin’s era capabilities have been common, and ByteDance didn’t see its business potential at the moment.
Another supply from Alibaba Cloud revealed that Alibaba had additionally been actively buying GPUs in 2018-2019. At that point, Alibaba‘s buy quantity reached no less than tens of 1000’s of models, together with V100 and T4 computing playing cards. Approximately one-tenth of those have been despatched to the Damo Academy for AI know-how analysis and have been utilized in the trillion-parameter massive mannequin M6 launched in 2021.
SEE ALSO: ByteDance’s Douyin Releases Rules that Prohibit Public Welfare Accounts from Participating in Live Streaming Tipping
The similar supply talked about that main corporations like ByteDance and Alibaba primarily negotiate purchases immediately with NVIDIA. The calls for of those corporations are so massive that distributors and the secondary market wrestle to satisfy them. NVIDIA, nonetheless, provides sure reductions based mostly on the scale of the buy.
The present value of an A100 on NVIDIA’s official web site is $10,000, whereas an H100 prices $36,000. The A800 and H800 fashions, which have been launched in the Chinese market final 12 months, are barely cheaper. However, because of provide and demand points, the transaction value is sure to be larger.
Sign up as we speak for five free articles month-to-month!
…. to be continued
Read the Original Article
Copyright for syndicated content material belongs to the linked Source : Pandaily – https://pandaily.com/bytedance-and-alibaba-place-massive-gpu-orders-with-nvidia-fueling-the-ai-race/