Nvidia, Intel and Arm call for processing standard for AI hardware

16 September 2022

Some of the largest semiconductor processor vendors have jointly authored a new research paper detailing a specification for an 8-bit floating point (FP8) interchangeable format for artificial intelligence (AI) training and inference.

Intel Corp., Nvidia Corp. and Arm Inc. authored the cross-industry specification alignment that will allow AI models to operate and perform consistently across various hardware platforms.

The goal is to accelerate the development of AI software by making it easier to meet computational requirements from hardware used to run the AI. The companies said that new innovation is required across both hardware and software to be able to meet computational throughput needed to advance AI in all industries.

Intel said it will support this new format specification across its AI product roadmap for CPUs, GPUs and other AI accelerators such as the Habana Gaudi deep learning accelerator.

Why it is needed

The companies said reducing the numeric precision requirements for deep learning helps to improve memory and computational efficiencies. Reduced precision methods exploit the inherent noise resilient properties of deep neural networks to improve this efficiency.

The FP8 specification is different from the existing IEEE 754 floating point format as it balances hardware and software for existing implementations to accelerate adoption and improve productivity, the companies said.

The specification will leverage the concepts and algorithms built on the IEEE standard to enable greater latitude of future AI innovation while adhering to current industry conventions.

The full research can be found on Arxiv.

To contact the author of this article, email

Powered by CR4, the Engineering Community

Discussion – 0 comments

By posting a comment you confirm that you have read and accept our Posting Rules and Terms of Use.
Engineering Newsletter Signup
Get the Engineering360
Stay up to date on:
Features the top stories, latest news, charts, insights and more on the end-to-end electronics value chain.
Weekly Newsletter
Get news, research, and analysis
on the Electronics industry in your
inbox every week - for FREE
Sign up for our FREE eNewsletter
Find Free Electronics Datasheets