Nvidia Hopper Leaps Ahead

<div class="container pt-4"> <div class="row">
	<div class="col-sm-12 col-lg-8" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;">
	<h2 class="top-h2 pt-4" style="">Nvidia Hopper Leaps Ahead</h2>

	<h5 class="top-h3 pt-4" style="">New 700W AI Chip Triples Performance, Adds FP8 Support</h5>

	<h5 class="top-h5 pb-3" style="">The next-generation AI architecture powers the H100 card and DGX-H100 system. The 700W flagship card triples peak performance over Ampere while adding FP8 support for more-efficient training.</h5>

	<div class="row pl-3 pb-4">
	<div class="col-xs-6"><img alt="Linley Gwennap" src="https://www.techinsights.com/sites/default/files/2022-04/lg.jpg" style="border-radius: 50%;" width="50" /></div>

	<div class="col-xs-6 pl-2 pt-3">
	<h5 style="font-weight: 600;font-size: 1.0rem;letter-spacing: -.1px;line-height: 1.4;">Linley Gwennap</h5>
	</div>
	</div>

	<p>For two years, other AI-accelerator vendors have tried and failed to surpass Nvidia’s Ampere A100. Now, the bar is suddenly much higher, as the market leader introduced its newest AI processor, the Hopper H100. In its maximum configuration, the chip triples raw performance over the A100 while pushing power consumption to a scorching 700W. New features such as 8-bit floating-point (FP8) support and improved scalability promise even greater gains for training large networks.</p>

	<p>The Hopper architecture doubles the number of MAC units per core, boosting performance at modest power gain. Using 4nm technology, the GPU packs more cores than the A100 while raising the clock speed as well. The new FP8 format doubles throughput compared with standard FP16 training.</p>

	<p>The company offers the H100 in a custom SXM5 module or a standard PCIe card; the latter delivers about one-third less performance at 350W. Nvidia has also developed a new DGX-H100 system that combines eight Hopper chips. It employs next-generation NVLink technology to create high-bandwidth connections between systems, greatly increasing performance in clusters of up to 32 DGX systems. The company expects production shipments of H100-based modules, cards, and systems by September.</p>

	<p>At the recent GTC, Nvidia also gave a brief update on its Grace processor, which is due to ship in 1H23. Grace will contain 72 Arm Neoverse CPUs and 198MB of on-chip cache while connecting to eight LPDDR5X channels. The processor will typically sit side by side with a Hopper GPU, forming what Nvidia calls the “Grace Hopper superchip” (after the celebrated admiral and computer scientist). In this configuration, the processor can feed data from 512GB of DRAM directly to the GPU through its coherent NVLink connections, accelerating performance on enormous models such as GPT.</p>
	</div>

	<div class="col-sm-12 col-lg-4 pt-4" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;">
	<div class="row pb-4 pt-4" style="margin-left:2px; margin-right:3px;">
	<div class="col-sm-12 col-lg-8 pt-2" style="background-image: url(https://www.techinsights.com/sites/default/files/2022-03/blog-signup.jpg);background-repeat: no-repeat;background-position: top center; border-radius: 10px; -webkit-background-size: cover; background-size: cover; box-shadow:inset 0 0 0 2000px rgba(0, 0, 0, 0.7);font-size: 1.2rem;line-height:1.4rem;color:#fff;text-align: left;font-weight: 500;">
	<p class="pt-4 pl-2" style="font-size: 2.2rem;line-height:2.6rem;color:#fff;text-align: left;font-weight: 600;">Free Logic Newsletter</p>

	<p class="pl-2 pr-2" style="font-size: 1.0rem;line-height:1.4rem;">Get the latest analysis of new developments in microprocessors and other semiconductor products.</p>
	<iframe border="no" class="pl-2" scrolling="no" src="https://w2.techinsights.com/l/4202/2022-04-06/2mss5p" style="height: 280px; width:100%;overflow:hidden;border:0px;" title="Snapdragon X70 Modem Trims Power"></iframe></div>
	</div>
	</div>
	</div>
	</div>

	<div class="container">
	<div class="row">
	<div class="col-sm-12 col-lg-8" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;">
	<hr /></div>
	</div>
	</div>

	<div class="container">
	<div class="row pt-2">
	<div class="col-sm-12 col-lg-8" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;text-align: center;">
	<h5 class="top-h5" style="">Subscribers can view the full article in the TechInsights Platform.</h5>
	</div>
	</div>

	<div class="row pb-2">
	<div class="col-sm-12 col-lg-8 pl-2" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;">
	<center><a class="btn btn-tags-platform" href="https://www.techinsights.com/tiapp" tabindex="-1">Subscriber Login</a></center>
	</div>
	</div>
	</div>

	<div class="container">
	<div class="row">
	<div class="col-sm-12 col-lg-8" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;">
	<hr /></div>
	</div>
	</div>

	<div class="container">
	<div class="row pb-4 pt-4" style="margin-left:2px; margin-right:3px;">
	<div class="col-sm-12 col-lg-8 pt-2" style="background-image: url(https://www.techinsights.com/sites/default/files/2022-04/Hopper.jpg);background-repeat: no-repeat;background-position: top center; border-radius: 10px; -webkit-background-size: cover; background-size: cover; box-shadow:inset 0 0 0 2000px rgba(0, 0, 0, 0.7);font-size: 1.2rem;line-height:1.6rem;color:#fff;text-align: left;font-weight: 500;">
	<p> </p>

	<p class="pt-2 pl-2" style="font-size: 2.4rem;line-height:2.8rem;color:#fff;text-align: left;font-weight: 600;">You must be a subscriber to access the Microprocessor Report</p>

	<p class="pl-2 pr-2">If you are not a subscriber, you can <strong>purchase a subscription</strong> or you can <strong>purchase an article</strong>. Enter your email below to contact us about access.</p>
	<iframe border="no" class="pl-2" scrolling="no" src="https://w2.techinsights.com/l/4202/2022-04-06/2mssfl" style="height: 250px; width:100%;overflow:hidden;border:0px;" title="Snapdragon X70 Modem Trims Power"></iframe></div>
	</div>
	</div>

	<div class="container py-4">
	<div class="row pb-4">
	<div class="col-xs-3 pl-2" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;"><a class="btn btn-tags" href="/market-analysis/processor-market-research-analysis/microprocessor-report" tabindex="-1">Microprocessor Report</a></div>

	<div class="col-xs-3 pl-2" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;"><a class="btn btn-tags" href="https://www.techinsights.com/tiapp" tabindex="-1">Subscriber Login</a></div>

	<div class="col-xs-3 pl-2" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;"><a class="btn btn-tags" href="/analysis-insights" tabindex="-1">Analysis Insights</a></div>

	<div class="col-xs-3 pl-2" style="color:#000;font-size: 1.0rem;line-height:1.6rem;font-weight: 500;"><a class="btn btn-tags" href="/e-subscribe" tabindex="-1">Subscribe</a></div>
	</div>
	</div>
	<script type="text/javascript" src="https://platform-api.sharethis.com/js/sharethis.js#property=5a903b55e3b02a00133b2fdb&product=inline-share-buttons" async="async"></script>
	<style type="text/css">
	<!--/--><![CDATA[/ ><!--*/
	/* Small devices (landscape phones, 544px and up) */
	@media (max-width: 543px) {
	.top-h2 {font-size: 2.0rem;letter-spacing: -.6px;line-height: 1.14;font-weight: 600;}
	.top-h3 {font-weight: 600;font-size: 1.4rem;letter-spacing: -.1px;line-height: 2.0rem;}
	.top-h5 {font-weight: 600;font-size: 1.2rem;letter-spacing: -.1px;line-height: 1.5;}
	}

	/* Small devices (landscape phones, 544px and up) */
	@media (min-width: 544px) {
	.top-h2 {font-size: 2.2rem;letter-spacing: -.6px;line-height: 1.14;font-weight: 600;}
	.top-h3 {font-weight: 600;font-size: 2.0rem;letter-spacing: -.1px;line-height: 2.6rem;}
	.top-h5 {font-weight: 600;font-size: 1.2rem;letter-spacing: -.1px;line-height: 1.5;}
	}

	/* Medium devices (tablets, 768px and up) The navbar toggle appears at this breakpoint */
	@media (min-width: 768px) {
	.top-h2 {font-size: 2.5rem;letter-spacing: -.6px;line-height: 1.14;font-weight: 600;}
	.top-h3 {font-weight: 600;font-size: 2.0rem;letter-spacing: -.1px;line-height: 2.6rem;}
	.top-h5 {font-weight: 600;font-size: 1.4rem;letter-spacing: -.1px;line-height: 1.5;}
	}

	/* Large devices (desktops, 992px and up) */
	@media (min-width: 992px) {
	.top-h2 {font-size: 3.5rem;letter-spacing: -.6px;line-height: 1.14;font-weight: 600;}
	.top-h3 {font-weight: 600;font-size: 2.0rem;letter-spacing: -.1px;line-height: 2.6rem;}
	.top-h5 {font-weight: 600;font-size: 1.4rem;letter-spacing: -.1px;line-height: 1.5;}
	}

	/* Extra large devices (large desktops, 1200px and up) */
	@media (min-width: 1200px) {
	.top-h2 {font-size: 3.5rem;letter-spacing: -.6px;line-height: 1.14rem;font-weight: 600;}
	.top-h3 {font-weight: 600;font-size: 2.0rem;letter-spacing: -.1px;line-height: 2.6rem;}
	.top-h5 {font-weight: 600;font-size: 1.4rem;letter-spacing: -.1px;line-height: 2.0rem;}
	}

	.btn-tags{border-radius: 4px;background-color:#efefef;border:2px solid #efefef;font-size: 0.9rem;font-weight: 500;text-transform: none;color:#000;min-height: 40px;margin-top: 7px;margin-bottom: 7px;}
	.btn-tags:hover{border-radius: 4px;color:#fff;background-color:#0d6efd;border:2px solid #ffffff;font-size: 0.9rem;font-weight: 500;}

	.btn-tags-platform{border-radius: 4px;background-color:#2676bb;border:2px solid #2676bb;font-size: 1.2rem;font-weight: 600;text-transform: none;color:#fff;min-height: 40px;margin-top: 7px;margin-bottom: 7px;}
	.btn-tags-platform:hover{border-radius: 4px;background-color:#2676bb;border:2px solid #ffea00;font-size: 1.2rem;font-weight: 600;text-transform: none;color:#fff;min-height: 40px;margin-top: 7px;margin-bottom: 7px;}

	/--><!]]>/
	</style> </div>