Researchers at Pointcloud GmbH in Zürich, Switzerland, have packed advanced 4D sensing technology — once too bulky for everyday use — onto a single silicon chip.
It’s a 4D imaging sensor that maps the physical world while simultaneously clocking the speed of every object it sees. It offers a low-cost, high-speed vision solution for everything from autonomous drones to future smartphones.
“This result demonstrates the capabilities of FMCW LiDAR FPA sensors as enablers of ubiquitous, low-cost, compact coherent 4D imaging cameras,” the researchers wrote in the study paper.
Laser-based tech
Most drones today use pulsed LiDAR, which fires bursts of light and waits for them to bounce back. It works, but it’s bulky.
It’s also velocity-blind — to know how fast a car is moving, the computer has to compare two frames and do the math.
This new chip, developed using a Focal Plane Array (FPA) with 61,952 stationary pixels, ditches the pulse-based approach in favor of a continuous laser beam.
The study describes a compact device that uses a grid of these thousands of pixels to simultaneously map an environment in 3D and track the instantaneous speed of moving objects.
Using Frequency-Modulated Continuous-Wave (FMCW) LiDAR and a continuous laser beam, the chip can detect subtle frequency shifts to measure velocity in real time.
Unlike standard LiDAR systems that require separate transmitters and receivers, each pixel in this array serves a dual purpose: both emitting and detecting laser light routed through a network of on-chip optical switches.
“At the core is a 352 × 176-pixel 2D FMCW LiDAR FPA comprising more than 0.6 million photonic components, all integrated on-chip together with their associated electronics. This represents a five times increase in pixel count with respect to previous demonstrations,” the study described.
Shows promise in testing
Using a continuous laser beam rather than standard pulses, this sensor can detect subtle shifts in light frequency to simultaneously calculate an object’s distance and speed.
This approach was validated through various environmental tests, during which the chip successfully reconstructed high-density 3D digital maps of indoor spaces at distances of 6 to 11 meters.
With combined depth mapping and real-time velocity tracking, the system demonstrates an ability to handle movement that other sensors often miss.
Reportedly, the chip demonstrated impressive versatility, capturing fine architectural details of a building 65 meters away and providing instantaneous velocity readings of a spinning disk.
By integrating all necessary electronics directly onto the silicon, lead author Remus Nicolaescu suggests the system is finally poised for affordable, large-scale production.
While the team plans to further refine its range and resolution, the technology’s potential extends far beyond robotics. It could lead to high-performance 4D imaging in standard consumer smartphone cameras.
The researchers are now focused on boosting resolution and stretching the sensor’s range even further. The era of blind robots is ending; the era of instant 4D sight has begun.
The findings were published in the journal Nature.