Nvidia strikes Hopper GPUs for AI into full manufacturing

Nvidia introduced at present that the Nvidia H100 Tensor Core graphics processing unit (GPU) is in full manufacturing, with world tech companions planning in October to roll out the primary wave of services based mostly on the Nvidia Hopper structure.

Nvidia CEO Jensen Huang made the announcement at Nvidia’s on-line GTC fall occasion.

Unveiled in April, H100 is constructed with 80 billion transistors and has a spread of expertise breakthroughs. Amongst them are the highly effective new Transformer Engine and an Nvidia NVLink interconnect to speed up the most important synthetic intelligence (AI) fashions, like superior recommender methods and giant language fashions, and to drive improvements in such fields as conversational AI and drug discovery.

“Hopper is the brand new engine of AI factories, processing and refining mountains of knowledge to coach fashions with trillions of parameters which can be used to drive advances in language-based AI, robotics, healthcare and life sciences,” mentioned Jensen Huang, founder and CEO of Nvidia, in an announcement. “Hopper’s Transformer Engine boosts efficiency as much as an order of magnitude, placing large-scale AI and HPC inside attain of firms and researchers.”

[Follow along with VB’s ongoing Nvidia GTC 2022 coverage »]

Along with Hopper’s structure and Transformer Engine, a number of different key improvements energy the H100 GPU to ship the subsequent huge leap in Nvidia’s accelerated compute knowledge middle platform, together with second-generation Multi-Occasion GPU, confidential computing, fourth-generation Nvidia NVLink and DPX Directions.

“We’re tremendous excited to announce that the Nvidia H100 is now in full manufacturing,” mentioned Ian Buck, normal supervisor of accelerated computing at Nvidia, in a press briefing. “We’re able to take orders for cargo in Q1 (beginning in Nvidia’s fiscal 12 months in October). And beginning subsequent month, our methods companions from Asus to Supermicro might be beginning to ship their H100 methods, beginning with the PCIe merchandise and increasing afterward this 12 months to the NVLink HDX platforms.”

A five-year license for the Nvidia AI Enterprise software program suite is now included with H100 for mainstream servers. This optimizes the event and deployment of AI workflows and ensures organizations have entry to the AI frameworks and instruments wanted to construct AI chatbots, advice engines, imaginative and prescient AI and extra.

World rollout of Hopper

H100 allows firms to slash prices for deploying AI, delivering the identical AI efficiency with 3.5 occasions extra vitality effectivity and thrice decrease complete price of possession, whereas utilizing 5 occasions fewer server nodes over the earlier technology.

For patrons who wish to strive the brand new expertise instantly, Nvidia introduced that H100 on Dell PowerEdge servers is now out there on Nvidia LaunchPad, which gives free hands-on labs, giving firms entry to the most recent {hardware} and Nvidia AI software program.

Clients also can start ordering Nvidia DGX H100 methods, which embrace eight H100 GPUs and ship 32 petaflops of efficiency at FP8 precision. Nvidia Base Command and Nvidia AI Enterprise software program energy each DGX system, enabling deployments from a single node to an Nvidia DGX SuperPOD, supporting superior AI growth of huge language fashions and different huge workloads.

H100-powered methods from the world’s main pc makers are anticipated to ship within the coming weeks, with over 50 server fashions available in the market by the top of the 12 months and dozens extra within the first half of 2023. Companions constructing methods embrace Atos, Cisco, Dell Applied sciences, Fujitsu, GIGABYTE, Hewlett Packard Enterprise, Lenovo and Supermicro.

Moreover, a few of the world’s main increased training and analysis establishments might be utilizing H100 to energy their next-generation supercomputers. Amongst them are the Barcelona Supercomputing Middle, Los Alamos Nationwide Lab, Swiss Nationwide Supercomputing Centre (CSCS), Texas Superior Computing Middle and the College of Tsukuba.

In comparison with the prior A100 technology, Buck mentioned the prior system had 320 A100 methods in a datacenter, however with Hopper an information middle would solely want 64 H100 methods to match that throughput of the older knowledge middle. That’s a 20% discount in nodes and an enormous enchancment in vitality effectivity.