Industrial Electronics

How to build a custom embedded stereo system for depth perception

12 August 2022

Depth perception can be achieved by a variety of 3D sensors ranging from stereo vision with cameras to lidar and time-of-flight sensors, each with its own strengths and weaknesses. While several off-the-shelf options exist, a custom embedded solution can cater to specific application requirements better. The Teledyne FLIR embedded depth perception solution provides a high-resolution color point cloud using custom stereo setup with cameras. Depending on factors such as accuracy, baseline, field-of-view and resolution, such a solution can be built using relatively inexpensive components and open-source software.

Source: Teledyne FLIRSource: Teledyne FLIR

Machine vision engineers at Teledyne FLIR share an overview of stereo vision while taking the reader through all the necessary steps to design a depth perception solution. The article also covers pros and cons of two design options depending on space and computational requirements: with detailed steps for building, calibration and real-time depth mapping using one of the options. The setup does this without a host computer and uses off-the-shelf hardware and open-source software options. Read along to learn more — the article covers:

• A simplified overview of a stereo vision system
• How machine vision cameras can be used to build a depth perception solution
• Two design options depending on user space and computational requirements
• Step-by-step guide with sample code for building one of the options
• Off-the-shelf hardware and open-source software required to build the system
• Steps for calibration and real time depth mapping
• Unique features, ease of use and integration enabled by Spinnaker SDK

To contact the author of this article, email

Powered by CR4, the Engineering Community

Discussion – 0 comments

By posting a comment you confirm that you have read and accept our Posting Rules and Terms of Use.
Engineering Newsletter Signup
Get the Engineering360
Stay up to date on:
Features the top stories, latest news, charts, insights and more on the end-to-end electronics value chain.
Weekly Newsletter
Get news, research, and analysis
on the Electronics industry in your
inbox every week - for FREE
Sign up for our FREE eNewsletter
Find Free Electronics Datasheets