Multispectral camera detects defects both on and under the surface

Technology

Three key technologies enable the camera’s unique imaging features: line scan imaging, complementary metal–oxide semiconductor (CMOS) sensor and multispectral capability. Line scan imaging, exemplified by the fax machine, involves the construction of a two-dimensional image using a single line of sensor pixels. The pixel line produces what is effectively a one-dimensional image; the movement of the target object leads to the second dimension as the camera acquires multiple single-line scans one after the other to build the full two-dimensional picture.

Compared to area scan cameras, which capture a full two-dimensional image in a single exposure, line scan cameras provide higher resolution at a more economical price. The price per pixel of line scan cameras exceeds that of alternatives. In addition, line scan cameras offer high dynamic range, better color fidelity and high pixel fill-factor to maximize sensitivity. They can capture smear-free images of target objects that are moving quickly without costly and unwieldy setups involving strobing and shuttering. Another advantage of line scan cameras is their efficient processing, which results from the elimination of frame overlaps. Overlapping frames produced in alternative imaging technology constitute excessive data that consumes additional processing bandwidth especially in applications with fast-moving objects imaged at high resolution.

The Linea ML 8k multispectral camera harnesses state-of-the-art complementary metal oxide semiconductor (CMOS) technology to deliver performance and value, enabling advanced inspection techniques like multispectral analysis. CMOS image sensors produce electronic signals by converting light into electric charge via the photoelectric effect. Each pixel in a CMOS sensor has dedicated charge-to-voltage conversion. The sensors also usually contain additional circuitry like pre-amplifiers, noise-correction and digitization to ultimately create digital bits. Compared to charge coupled device sensors — which send voltages as analog signals for conversion off-chip — the additional components result in less area available for light capture, increase design complexity and lower uniformity of the output. The benefit for CMOS sensors, however, is high speed due to the high total bandwidth enabled by massive parallelization.

Multispectral imaging enables detection of defects both on and beneath the surface. Human vision only perceives light in the visible spectrum, allowing humans to see only features that are in view on an object’s surface. Multispectral imaging technology like that featured on the Linea ML 8k multispectral line scan camera uses different wavelengths to reveal subsurface features at various depths. Cameras detect optical reflections from a surface, and depending on the wavelength of the light source, the optical properties can vary significantly. Since the penetration depth of light in materials depends on the wavelength, a range of NIR wavelengths enables image capture beneath a substrate. Spectral independence of the RGB and NIR output channels allows for surface and sub-surface defect detection in a single scan, simplifying vision system design.

Figure 1. The Linea ML 8k multispectral camera's independent RGB and NIR outputs enable accurate detection of defects without spectral interference. Source: Teledyne

Features

The Linea ML 8k multispectral camera is equipped with a range of features to meet the demands of today’s inspection applications.

One feature of the camera is subpixel spatial correction. This algorithm allows the camera to fix image artifacts that arise from a mismatch between the camera and the speed of the observed web as well as installations that involve a non-perpendicular angle between the camera and the web. In these cases, the imaging produces a non-square pixel that the correction algorithm can fix by compensation and reconstruction. With the mismatch corrected, color fringing effects are minimized.

Parallax correction also allows for the correction of an optical artifact caused by camera installations that are non-perpendicular to the surface of the web. For a multi-row sensor, the amount of magnification for rows that are not at the center will vary slightly from the central row. This results in the same space within the field of view being mapped to different pixels for each line.

With the look up table (LUT), the Linea ML 8k multispectral camera allows the user to customize the linearity of the camera’s response. This can be accomplished in two ways: by uploading an LUT to the camera via the file transfer features or by using the gamma correction feature. The gamma correction value can be modified at any time. The LUT can be utilized with any of the camera’s modes. When enabled, the LUT does not alter the maximum line rate or the quantity of the camera’s data output. It is recommended that the fixed offset available in the camera control be set to zero when the LUT is enabled.

The camera’s flat-field correction (FFC) corrects each individual pixel by means of digital subtractive offset correction and multiplicative gain correction. If the camera lacked this feature, recording of a homogeneous object could result in the display of slightly different pixel values. The FFC process is performed to correct lens shading in real-time, either in the camera or on the acquisition board.

Figure 2. The Linear ML 8k multispectral camera delivers accurate flaw detection for quality control. Source: TeledyneThe Linea ML 8k multispectral camera is equipped with a fiber optic data interface that enables data transmission reliability over cable lengths up to 300 meters. The camera’s built-in SFP+ transceivers convert electrical signals to optical signals and the camera interfaces directly with fiber optic cables via LC connectors. The CameraLink HS interface provides reliable data transfer with immunity to electrical interference over long cable lengths.

Paired with Teledyne’s Xtium2 family of frame grabbers, the Linea ML 8k multispectral camera can transfer images via the CameraLink HS interface at high bandwidth directly to host memory without CPU overhead. Each fiber carries 1.2GB/s data throughput.

The Linea ML 8k multispectral camera is similar to a multifield application system with the only difference being the illumination method. In general, other than three-field illumination, multispectral imaging requires a white light plus an NIR light shining on the object at the same time. Using wafer-level coated filters, the camera captures an RGB color image and an NIR image. Each of the camera’s channels has independent exposure control, producing improved white balancing. In addition, the camera functions seamlessly from maximum speed to stop conditions.

The Linea 8k multispectral camera delivers a resolution of 8,192 x 4 pixels at a line rate of 70 x 4 kHz with a pixel size of 5 x 5 µm in a compact form factor measuring 76 mm (W) x 76 mm (H) x 85 mm (D) and weighing 500 g. The camera has an 8 bit data format, dynamic range of 53 dB and an operating temperature of 0° C to 65° C. The camera features an M58 x 0.75 lens mount, CLHS LC data interface, and 12 V DC to 24 V DC, Hirose 12 pin power and GPIO interface.

Applications

The versatile features of the Linea ML 8k multispectral camera enable it to excel in a number of machine vision inspection applications. From print and web imaging to PCB and electronics inspection, the camera is designed to handle challenging inspection jobs.

Print and web inspection involves imaging continuous webs or sheets of everything from paper, textiles, film and foil to plastics, metals, glass and coatings. Commercial security printing applies markings comprised of special inks that cannot be seen with human vision as a measure to combat counterfeiting of items like banknotes, passports and other high security print. For this application, 100% of the security ink must be inspected for quality as part of the printing process. Previous machine vision inspection system designs were complicated by the need for multiple cameras to image different aspects of a banknote’s features. A single-color camera would inspect the banknote’s color, while a separate NIR camera would detect the security inks. With a multispectral camera like the Linea ML 8k, the design can be simplified and costs reduced by using a single camera to inspect both aspects of banknotes. The multispectral camera captures both RGB and NIR images in a single scan using combined white and NIR LED light sources.

Inspecting webs may involve multiple inspection events during production. With a large field of view and the ability to detect small defects at high speeds, the Linea ML 8k can perform seamless roll-to-roll inspection with higher dynamic range, multiple wavelengths and improved processing efficiency at a reduced price per pixel.

Figure 3. Multispectral imaging enables defect detection both on and under the surface of PCBs. Source: TeledyneImaging at various depths is critical to ensure quality in electronic circuit manufacturing. The Linea ML 8k camera’s multispectral capability enables sensing defects at different distances from the surface of PCBs or substrates. The uppermost layer of a PCB often has a top coating of colored paint. Beneath the surface, features like copper wires are buried deeper within the board. Since all of these elements need to be inspected to ensure a quality product, inspection system designers using cameras with limited wavelength capabilities would need to create a system using multiple cameras. Each camera would be tuned for specific wavelengths corresponding to the depth of interest for each of the PCB’s features. A visible-light camera can detect the colored paint on the surface of the product, while an NIR camera has better penetration depth to see deeper into the object to detect buried copper wires. The reflectivity of copper is also higher at NIR wavelengths, enabling an NIR camera to obtain better image contrast of the wires. Instead of a multi-camera setup, a single multispectral camera can simplify the machine vision system design by offering imaging capability at multiple depths to detect both defects on the surface of a PCB and beneath it. The Linea ML 8k can capture yield-limiting defects with high inspection system throughput. For wafer inspection, the camera’s spectrally independent RGB and NIR outputs allow detection of defects like micro-cracks at various depths throughout the target in a single scan. Multispectral imaging’s unique advantages continue to propel growth in other automatic optical inspection applications including food and materials sorting and medicine. With crucial requirements like low cost, high speed and reduced footprint, industrial applications present demanding circumstances that can be met by multispectral imaging solutions. Applications like fruit and vegetable inspection, material recycling and pharmaceutical products need more than color inspection, and benefit from Linea ML 8k’s spectrally independent output of RGB-NIR to detect defects.

Conclusion

The Linea ML 8k multispectral camera’s spectrally independent RGB and NIR outputs allow accurate detection of defects across a range of applications. The camera excels in applications that require defect detection both on and under the surface, from examining print and web to inspecting PCB and electronics to general machine vision tasks. Quality control is ensured via accurate flaw detection at various depths in a single device, eliminating complex and costly multi-camera setups. Expand vision capabilities today with the Linea ML 8k multispectral camera from Teledyne.