Syntiant Corp. has unveiled what it claims is its most powerful neural decision processor (NDP), a device that has five times the tensor throughput of its previous deep learning hardware generation.
Called the NDP250, the processor includes Syntiant’s Core 3 programmable deep learning architecture and is targeted at imaging, speech and sensor applications in power-constrained devices like person detection, object classification, automatic speech recognition (ASR), text to speed (TTS) and motion tracking.
The NDP250 integrates ASR and TTS directly into devices to be used as next generation large language models (LLM) for voice interfaces. The processing capabilities can understand and produce human language more accurately and fluently, improving user interactions and experiences, Syntiant said.
“Syntiant’s third generation of at-memory compute processors for multi-modal artificial intelligence from a variety of sensor types extends their lead into system designs, where LLMs will interface with humans and the environment at minimal latency and energy cost,” said Michael Stewart, managing partner at M12, Microsoft’s Venture Fund.
Some of the features of the processor include always-on image recognition at under 30 mW, meaning at a low power it can be used for automotive security, battery-powered cameras and video doorbells.
Additionally, the device extends battery life in these devices by processing data locally. The low latency doesn’t travel back and forth to a remote server for faster response times. Privacy is also done remotely to minimize transmitting information over networks. Finally, the device can reduce cloud costs with all these data points being run locally, Syntiant said.
Key features of the NDP250 include:
- Arm Cortex M0 processor
- HiFi 3 DSP
- Integrated phase-locked loop
- Supports more than 6M neural parameters (in 8-bit mode)
- Hardware acceleration over 30 GOPS
- Dual 11-wire direct image interface
- Dual PDM digital microphone interface
- I2S serial interface with PCM
- Quad-SPI and dual-I2C controller and target for multi-modal sensor fusion
- Up to 120 MHz internal operating frequency
- Low power PLL for flexible clock input
- Software development kit
- Training development kit
