- Updated: September 17, 2024
- 3 min read
Oracle and NVIDIA Unveil Groundbreaking Innovations at Oracle CloudWorld 2024
At the highly anticipated Oracle CloudWorld 2024 event, Oracle Cloud Infrastructure (OCI) and NVIDIA unveiled groundbreaking advancements in AI supercomputing. This strategic collaboration aims to empower enterprises worldwide to unlock the full potential of next-generation AI models and accelerate data processing capabilities.
Highlights of Oracle and NVIDIA Collaboration
The centerpiece of this collaboration is the introduction of the first zettascale OCI Supercluster, accelerated by the NVIDIA Blackwell platform. This unprecedented computing powerhouse will harness more than 100,000 of NVIDIA’s latest-generation GPUs, enabling enterprises to train and deploy cutting-edge AI models with unparalleled efficiency.
Slated for availability in the first half of 2024, the Blackwell-based systems can scale up to an astonishing 131,072 Blackwell GPUs with NVIDIA ConnectX-7 NICs for RoCEv2 or NVIDIA Quantum-2 InfiniBand networking. This translates to a staggering 2.4 zettaflops of peak AI compute power, unleashing a new era of AI innovation in the cloud.
Key Announcements and Advancements
In addition to the zettascale OCI Supercluster, Oracle and NVIDIA unveiled several other groundbreaking advancements at CloudWorld 2024:
- Oracle previewed NVIDIA GB200 NVL72 liquid-cooled bare-metal instances, capable of large-scale training with Quantum-2 InfiniBand and real-time inference of trillion-parameter models within the expanded 72-GPU NVIDIA NVLink domain.
- This year, OCI will offer NVIDIA HGX H200 — connecting eight NVIDIA H200 Tensor Core GPUs in a single bare-metal instance via NVLink and NVLink Switch, and scaling to 65,536 H200 GPUs with NVIDIA ConnectX-7 NICs over RoCEv2 cluster networking.
- OCI announced the general availability of NVIDIA L40S GPU-accelerated instances for midrange AI workloads, NVIDIA Omniverse, and visualization.
- For edge deployments, Oracle’s Roving Edge Device v2 will now support up to three NVIDIA L4 Tensor Core GPUs, enabling scalable AI at the edge, even in disconnected and remote locations.
Use Cases and Success Stories
Companies worldwide are already leveraging NVIDIA-powered OCI Superclusters to drive AI innovation and transform their businesses. Foundation model startup Reka, for instance, is using the clusters to develop advanced multimodal AI models for enterprise agents.
“Reka’s multimodal AI models, built with OCI and NVIDIA technology, empower next-generation enterprise agents that can read, see, hear and speak to make sense of our complex world,” said Dani Yogatama, cofounder and CEO of Reka. “With NVIDIA GPU-accelerated infrastructure, we can handle very large models and extensive contexts with ease, all while enabling dense and sparse training to scale efficiently at cluster levels.”
NVIDIA received the 2024 Oracle Technology Solution Partner Award in Innovation for its full-stack approach to innovation.
Conclusion and Call to Action
The collaboration between Oracle and NVIDIA represents a significant leap forward in the realm of AI computing, empowering enterprises to unlock unprecedented levels of performance and efficiency. With the zettascale OCI Supercluster and a suite of cutting-edge GPU-accelerated solutions, businesses can now harness the full potential of next-generation AI models and accelerate data processing capabilities like never before.
To learn more about this groundbreaking partnership and how it can transform your business, visit the UBOS homepage or explore the Enterprise AI platform by UBOS. Unlock the power of AI supercomputing and stay ahead of the curve in the rapidly evolving world of artificial intelligence.