On Wednesday, Nvidia introduced a collaboration with Microsoft to construct a “huge” cloud pc centered on AI. It would reportedly use tens of hundreds of high-end Nvidia GPUs for functions like deep studying and giant language fashions. The businesses goal to make it probably the most highly effective AI supercomputers on the earth.
In flip, the brand new supercomputer will function hundreds of items of what’s arguably the strongest GPU on the earth, the Hopper H100, which Nvidia launched in October. Nvidia may even present its second strongest GPU, the A100, and make the most of its Quantum-2 InfiniBand networking platform, which might switch information at 400 gigabits per second between servers, linking them collectively into a robust cluster.
In the meantime, Microsoft will contribute its Azure cloud infrastructure and ND- and NC-series digital machines. Nvidia’s AI Enterprise platform will tie the entire thing collectively. The businesses may even collaborate on DeepSpeed, Microsoft’s deep studying optimization software program.
In an announcement, Nvidia talked about the functions the joint supercomputer may serve:
“As a part of the collaboration, Nvidia will make the most of Azure’s scalable digital machine situations to analysis and additional speed up advances in generative AI, a quickly rising space of AI wherein foundational fashions like Megatron Turing NLG 530B are the idea for unsupervised, self-learning algorithms to create new textual content, code, digital photos, video or audio.”
This previous yr has seen a fast rise in generative AI fashions equivalent to Secure Diffusion and DALL-E that may synthesize novel photos on demand. Related fashions have appeared that may create video, synthesize voices, and carry out transcription, amongst different makes use of. As computational demand will increase for generative AI, Nvidia and Microsoft intend to be there to fulfill it.
As soon as Nvidia and Microsoft’s cloud pc comes on-line, clients can deploy hundreds of GPUs in a single cluster to “practice even essentially the most huge giant language fashions, construct essentially the most complicated recommender methods at scale, and allow generative AI at scale,” in keeping with Nvidia.
The businesses didn’t present particulars on when the brand new supercomputer will probably be prepared however talked about that the announcement marks the start of a “multi-year collaboration.” It is probably the cloud pc will scale up in capability over time.