techspot Microsoft upgrading to H100 Nvidia GPUs for AI

[UltraMega]

Quote

Since the initial success of ChatGPT, Microsoft and some of its rivals have started work on parallel AI models for search engines and other applications. To speed up its generative AI, the company has introduced the ND H100 v5 VM, a virtual machine that can use between eight and thousands of Nvidia H100 GPUs.

 

The H100s connect through NVSwitch and NVLink 4.0 with 3.6TB/s of bisectional bandwidth between each of the 8 local GPUs within each virtual machine. Each GPU boasts 400 Gb/s of bandwidth through Nvidia Quantum-2 CX7 InfiniBand and 64GB/s PCIe5 connections. Each virtual machine manages 3.2Tb/s through a non-blocking fat-tree network. Microsoft's new system also features 4th-generation Intel Xeon processors and 16-channel 4800 MHz DDR5 RAM.

 

Microsoft plans to use the ND H100 v5 VM for its new AI-powered Bing search engine, Edge web browser, and Microsoft Dynamics 365. The virtual machine is now available for preview and will come standard with the Azure portfolio. Prospective users can request access.

ChatGPT was made possible thanks to tens of thousands of Nvidia GPUs, which Microsoft is now upgrading

WWW.TECHSPOT.COM

---

According to Bloomberg, OpenAI trained ChatGPT on a supercomputer Microsoft built from tens of thousands of Nvidia A100 GPUs. Microsoft announced a new array utilizing Nvidia's newer...

 

Now large companies have a whole new reason to need more and more computer power; for AI. 

[schuck6566]

18 hours ago, UltraMega said:

ChatGPT was made possible thanks to tens of thousands of Nvidia GPUs, which Microsoft is now upgrading

WWW.TECHSPOT.COM

---

According to Bloomberg, OpenAI trained ChatGPT on a supercomputer Microsoft built from tens of thousands of Nvidia A100 GPUs. Microsoft announced a new array utilizing Nvidia's newer...

 

Now large companies have a whole new reason to need more and more computer power; for AI. 

And Nvidia was worried about profits dropping?

[Avacado]

27 minutes ago, schuck6566 said:

And Nvidia was worried about profits dropping?

Wait till all those GPUs flood ebay.