Nvidia
At immediately’s GTC convention keynote, Nvidia introduced that its H100 Tensor Core GPU is in full manufacturing and that tech companions resembling Dell, Lenovo, Cisco, Atos, Fujitsu, GIGABYTE, Hewlett-Packard Enterprise, and Supermicro will start transport merchandise constructed across the H100 subsequent month.
The H100, a part of the “Hopper” structure, is probably the most highly effective AI-focused GPU Nvidia has ever made, surpassing its earlier high-end chip, the A100. The H100 contains 80 billion transistors and a particular “Transformer Engine” to speed up machine studying duties. It additionally helps Nvidia NVLink, which hyperlinks GPUs collectively to multiply efficiency.
In accordance with the Nvidia press launch, the H100 additionally reportedly delivers effectivity advantages, providing the identical efficiency because the A100 with 3.5 instances higher power effectivity, 3 instances decrease price of possession, utilizing 5 instances fewer server nodes.
Nvidia expects the H100 chip for use in quite a lot of industrial, well being care, supercomputer, and cloud functions starting from giant language fashions, drug discovery, recommender programs, conversational AI, and extra. Going by the monitor file of the sooner A100 “Ampere” structure GPU, analysts imagine the H100 chip will doubtless have a big effect within the AI area. It can additionally very doubtless play a task within the subsequent era of picture synthesis fashions.
Nvidia introduced that over 50 H100-based server fashions from totally different corporations might be in the marketplace by the tip of the yr. And Nvidia itself will start integrating the H100 into its Nvidia DGX H100 enterprise programs, which pack eight H100 chips and ship 32 petaflops of efficiency.
Information that H100 is in full manufacturing and transport quickly could also be seen as a reduction to Nvidia buyers. The agency’s inventory had dropped in early September after it introduced that the US authorities was putting restrictions on exports of the H100 to China, which was additionally the place the chip was being partially developed and is being manufactured. The US allowed H100 improvement to renew, however the export restrictions to China and Russia are nonetheless in place.
