Nvidia announces its top-end AI chip H200. A look at what's changed | Mint
Active Stocks
Fri Feb 23 2024 15:58:13
  1. Tata Steel share price
  2. 145.50 -0.24%
  1. State Bank Of India share price
  2. 759.40 -0.86%
  1. HDFC Bank share price
  2. 1,420.90 0.08%
  1. NTPC share price
  2. 337.70 -0.54%
  1. ITC share price
  2. 411.60 -0.65%
Business News/ Ai / Artificial Intelligence/  Nvidia announces its top-end AI chip H200. A look at what's changed
BackBack

Nvidia announces its top-end AI chip H200. A look at what's changed

Nvidia's H200 chipset, set to ship in Q2 2024, will bring performance boost, including almost doubling the interference speed on Meta's Llama 2 language model compared to the H100 chipset.

FILE PHOTO: A smartphone with a displayed NVIDIA logo is placed on a computer motherboard in this illustration taken March 6, 2023. REUTERS/Dado Ruvic/Illustration/File Photo (REUTERS)Premium
FILE PHOTO: A smartphone with a displayed NVIDIA logo is placed on a computer motherboard in this illustration taken March 6, 2023. REUTERS/Dado Ruvic/Illustration/File Photo (REUTERS)

Chip giant Nvidia has unveiled its top-of-the-range chipset - the H200 - aimed at artificial intelligence work. The upgrade to the already popular H100 chipset will start shipping in the second quarter of 2024, with many major companies such as Amazon Web Services, Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure already committing to using the chipset next year.

Dion Harris, head of data centre product marketing at NVIDIA, was quoted by Bloomberg as saying: “When you look at what’s happening in the market, model sizes are rapidly expanding…It’s another example of us continuing to swiftly introduce the latest and greatest technology." 

Nvidia said that the introduction of the H200 will lead to a performance boost that will include almost doubling the interference speed on Meta's Llama 2 language model when compared to the H100 chipset.

Following the launch of the H200 chipset, Nvidia shares rose as much as 1.5% in New York, one of only two semiconductor stocks to rise, Bloomberg reported. Nvidia shares are up around 200% this year, the best performer on the Philadelphia Stock Exchange's semiconductor index.

Performance upgrade in H200:

The major upgrade for the H200 chipset comes in the form of memory, becoming the first GPU to come with HBM3e technology. The H200 comes with 141GB of memory at 4.8 terabytes per second compared to 141 GB memory capacity on the H100.

Competition rises for Nvidia: 

Nvidia is currently the undisputed market leader in the AI chips segment and controls around 80% of the global market for the chips in this segment. 

However, competition is slowing rising for Nvidia with Advanced Micro Devices looking to announce its AI chip M1300 to the market in the fourth quarter while Intel claiming that its Gaudi 2 chipset is faster than the incumbent H100 chipset by Nvidia, reported Bloomberg. Moreover, a Reuters report earlier had noted that even Nvidia's regular customers like ChatGPT maker OpenAI is considering manufacturing its own chipset and are even evaluating a potential acquisition target.

Unlock a world of Benefits! From insightful newsletters to real-time stock tracking, breaking news and a personalized newsfeed – it's all here, just a click away! Login Now!

Catch all the Business News, Market News, Breaking News Events and Latest News Updates on Live Mint. Check all the latest action on Budget 2024 here. Download The Mint News App to get Daily Market Updates.
More Less
Published: 14 Nov 2023, 07:20 AM IST
Next Story footLogo
Recommended For You
Switch to the Mint app for fast and personalized news - Get App