The Mighty GB200 AI Superchip

Nvidia’s impressive GB200 AI superchip, introduced back in March 2024, was unveiled at the GTC conference, showcasing a remarkable level of technology and design.

Nvidia GB200 AI Superchip

Dr. Moritz Lehmann shared detailed images on the Nvidia subreddit that give a genuine feel for the size of this technology, with an amusing hand gesture included for scale—having a striking resemblance to a Vulcan salute. For an extensive review of the features, see the original subreddit post.

The GB200 consists of a 72-core Nvidia Grace CPU and two Blackwell AI GPUs, capable of holding up to 372 GB of HBM3e memory, with an impressive bandwidth of 16 TB/s. This performance puts the conventional gaming rigs to shame, although not every consumer could exactly afford this powerhouse.

In an interactive response regarding its pricing, Lehmann mentioned, “one entire NVL72 rack with 18 nodes of these will set you back $3 million.”

Technical Specs

In keeping with its mammoth size, the superchip features a cabling framework with five thousand cables extending over two miles, boasting an outrageous total bandwidth measurement of 130 TB/s—quite a remarkable figure indeed. As stated by Jensen Huang, “the peak traffic of the entire internet is 900 terabits per second. Divide that by eight. This moves more traffic than the entire internet.”

Exploration into the GB200 shows a significant experience in AI computing technology, hinting at what the future holds in the realm of hardware and processing power.