Ayar Labs is developing artificial intelligence (AI) infrastructures based on its optical I/O technology for next-generation high performance computing (HPC) applications.
Collaborating with Nvidia, the companies will focus on integrating Ayar’s technology to scale out architectures enabled by high-bandwidth, low-latency and ultra-low power optical-based interconnects for future Nvidia products.
Optical I/O changes the performance and power trajectories of system designs by enabling compute, memory and networking ASICs to communicate with increased bandwidth at lower latency, over longer distances and at lower power of existing electrical I/O solutions.
“Today’s state-of-the-art AI/ML training architectures are limited by current copper-based compute-to-compute interconnects to build scale-out systems for tomorrow’s requirements,” said Charles Wuischpard, CEO of Ayar Labs. “Our work with Nvidia to develop next-generation solutions based on optical I/O provides the foundation for the next leap in AI capabilities to address the world’s most sophisticated problems.”
Nvidia said that by 2023 AI model sizes will have 100 trillion or more connections, a 600x increase from 2021.
As electrical-based interconnects reach bandwidth limits, new interconnect solutions and architectures will be needed to meet scale, performance and power demands for next generation AI. The partnership with Nvidia will address these challenges with next generation architectures.
