NVIDIA CEO Emphasizes AI and Accelerated Computing at COMPUTEX 2024

In a keynote speech ahead of the COMPUTEX technology conference in Taipei, NVIDIA founder and CEO Jensen Huang highlighted the transformative potential of generative AI and accelerated computing. According to the NVIDIA blog, Huang emphasized that the convergence of AI and accelerated computing is poised to redefine the future.

Huang addressed an audience of more than 6,500 industry leaders, media, entrepreneurs, gamers, creators and AI enthusiasts at the National Taiwan University Sports Center. “The intersection of AI and accelerated computing will redefine the future,” said Huang, wearing his signature black leather jacket.

‘Rhythm of a year’

In his presentation, Huang revealed a roadmap for new semiconductors that will be released each year. The upcoming Rubin platform includes new GPUs, an Arm-based CPU called Vera, and advanced networking components including NVLink 6 and CX9 SuperNIC.

“Our company operates on a yearly basis. Our basic philosophy is very simple. Building a full data center scale, separating and selling parts on a yearly cycle, and pushing everything to the limits of technology,” Huang explained.

‘Accelerated computing is sustainable computing’

Huang also discussed the sustainability of accelerated computing, highlighting that combining GPUs and CPUs can provide up to 100x speedups while reducing power consumption by only 3x. “The more you buy, the more you save,” he said, emphasizing the significant cost and energy savings.

Industry joins NVIDIA to build AI factories

In particular, major computer manufacturers in Taiwan are adopting NVIDIA GPUs and networking solutions to build AI systems. Companies such as ASRock Rack, ASUS, GIGABYTE, Pegatron, Supermicro, and others are using NVIDIA technologies to create cloud, on-premises, and edge AI systems.

The NVIDIA MGX modular reference design platform now supports the Blackwell architecture, optimized for large-scale language model inference and data processing. AMD and Intel also support the MGX architecture through their CPU host processor designs.

Next-generation networking with Spectrum-X

On the networking front, Huang announced the annual launch of the Spectrum-X product, designed to meet the growing demand for high-performance Ethernet networking for AI. NVIDIA Spectrum-X improves network performance by 1.6x compared to traditional Ethernet fabrics.

CoreWeave, GMO Internet Group, and other AI cloud service providers were among the first to adopt Spectrum-X for their AI infrastructure.

NVIDIA NIM Transforms Millions into AI Generation Developers

With NVIDIA NIM, developers can now easily create generative AI applications. NIM delivers models as optimized containers that can be deployed in the cloud, data center, or workstation. Nearly 200 technology partners are integrating NIM into their platforms to accelerate the deployment of generative AI.

“Today we published the fully optimized Hugging Face of Llama 3,” Huang said. “You can run it in the cloud, download these containers, deploy them in your own data center, and make them available to your customers.”

NVIDIA Brings AI Assistants to Life with GeForce RTX AI PCs

NVIDIA’s RTX AI PCs, powered by RTX technology, are set to revolutionize consumer experiences with over 200 RTX AI laptops and over 500 AI-powered apps and games. The RTX AI Toolkit and NIM Inference Microservices for the NVIDIA ACE Digital Human Platform highlight NVIDIA’s commitment to AI accessibility.

NVIDIA is also working with: microsoft Helps developers introduce new generative AI features to Windows native apps and web apps.

NVIDIA Robotics Adopted by Industry Leaders

NVIDIA is leading the shift toward industrial digitalization through autonomous operations and digital twins. Taiwanese manufacturers are using technology from NVIDIA to transform their factories and utilize tools such as Omniverse, Isaac, and Metropolis to leverage enhanced robotics facilities.

Global electronics giants are integrating autonomous robots from NVIDIA into their factories and leveraging simulations from Omniverse to test and validate AI against the real world. This includes over 5 million pre-programmed robots worldwide.

NVIDIA AI Enterprise on the IGX platform partners with companies like ADLINK and Advantech to deliver edge AI solutions that meet the rigorous regulatory standards essential to industries such as medical technology.

Tribute to Taiwan

Huang concluded his keynote by paying tribute to Taiwan and its NVIDIA partners. “Thank you,” said Hwang. “i love you.”

Image source: Shutterstock

. . .

tag