China’s AI firms are cleverly innovating around chip bans
Tweaks to software blunt the shortage of powerful hardware
TODAY’S TOP artificial-intelligence (AI) models rely on large numbers of cutting-edge processors known as graphics processing units (GPUs). Most Western companies have no trouble acquiring them. Llama 3, the newest model from Meta, a social-media giant, was trained on 16,000 H100 GPUs from Nvidia, an American chipmaker. Meta plans to stockpile 600,000 more before year’s end. XAI, a startup backed by Elon Musk, has built a data centre in Memphis powered by 100,000 H100s. And though OpenAI, the other big model-maker, is tight-lipped about its GPU stash, it had its latest processors hand-delivered by Jensen Huang, Nvidia’s boss, in April.
Explore more
This article appeared in the Science & technology section of the print edition under the headline “Miniature model-building”
Science & technology September 21st 2024
From the September 21st 2024 edition
Discover stories from this section and more in the list of contents
Explore the editionDiscover more
Deforestation is costing Brazilian farmers millions
Without trees to circulate moisture, the land is getting hotter and drier
Robots can learn new actions faster thanks to AI techniques
They could soon show their moves in settings from car factories to care homes
Scientists are learning why ultra-processed foods are bad for you
A mystery is finally being solved
Scientific publishers are producing more papers than ever
Concerns about some of their business models are building
The two types of human laugh
One is caused by tickling; the other by everything else
Scientists are building a catalogue of every type of cell in our bodies
It has thus far shed light on everything from organ formation to the causes of inflammation
