OpenAI began rolling out GPT-6 Astra access to a limited number of organisations earlier this week, with wider subscriber access planned to soon follow. According to Jensen Huang via X, the model was trained on "~100K+ Nvidia Grace Blackwell NVLink72" server racks, and there are already plans to get 400,000 GPUs online in anticipation of whatever comes next.
Greg Brockman, the co-founder and president of OpenAI, told Stratechery that this was "the first run that we’ve trained on more than 100,000 GPUs." That's a staggering amount of hardware (and perhaps leaves little doubt as to how we ended up in a memory supply crisis). But the thing that gives me more pause about Astra's announcement is the Nvidia CEO's assertion that "AGI has arrived."
To reca...
English (US)