Oct 2026· PHOTOMET EDUMET· Vol 14495, pp. 1449509 - 1449509-9· 0 citations· 12 references
Engineering
TL;DR
It is shown that the event-based approach coupled with motion compensation can scan slower than a frame-based approach to recover the same moving object, reducing redundancy in measurements.
Abstract
We report an event-camera-based optical 4D (3D+time) sensor and compare it with a classical frame-based counterpart while measuring dynamic scenes. Frame-based active stereo 4D sensors project a series of patterns per single 3D scan into a scene for parallel temporal coding of object surface points. This is comparable to the parallel measurement of a global shutter camera in 3D. At the same time, each of the cameras measures the scene's responses. Phase retrieval, temporal correlation, or other methods identify pixels in both cameras which have likely seen the same object point. This approach forbids significant object motion during a single scan for spatio-temporal consistency. Consequently, high projection rates, high frame rates, and high illumination power are necessary for measuring fast motion. We developed an event-based stereo 4D sensor to break this limitation. Event cameras don’t measure complete frames, but instead, each pixel monitors its incoming brightness independently. When a positive or negative change crosses a threshold, an event is reported, i.e. a small data package with the pixel’s coordinates, a high-resolution timestamp, and photometric information, most commonly the polarity of the change. Coupled with a specialized projector, our event cameras sequentially measure sparse slices of the scene, which can be thought of as a rolling shutter. Temporally corresponding events are used to triangulate and reconstruct 3D points with timestamps from these events. We show that our event-based approach coupled with motion compensation can scan slower than a frame-based approach to recover the same moving object, reducing redundancy in measurements.
Synthetic-aperture imaging (SAI) removes occluders such as foliage by integrating many views of a scene along a camera path. It has so far been used mainly with frame cameras. We ask whether an event camera has advantages for SAI, and answer the question in simulation, where both sensors see exactly the same scene and...
Jakob Hinterholzer, Mohamed Youssef, Oliver Bimber· 0 citations
We address geometric video alignment for the same scene captured by multiple freely moving cameras. Existing methods, which are based on image stitching or video stabilization, are typically limited to two cameras or must assume the restrictive setting of a fixed linear ordering of the cameras. We propose MViS, a light...
Shira Ifergane, Roy Amoyal, Shahar Ben Ishay et al.· 0 citations
It is suggested that even a lightweight, non-invasive fusion of event data can meaningfully improve 4D reconstruction robustness, motivating a more thorough architectural investigation in future work.
Dulanga Weerakoon, Darshana Rathnayake, Van Minh Do et al.· 0 citations
Dynamic scenes may be captured by a moving camera, multiple video streams, or images taken at different times. These observations reveal complementary aspects of scene geometry and motion, yet bringing them together requires establishing correspondence across viewpoints, capture times, and visibility changes. We introd...
Ilya Fradlin, Christian Schmidt, Jens Piekenbrinck et al.· 1 citation
Pixels in event-based cameras (EBCs) report log-intensity changes asynchronously and operate in high dynamic range with microsecond temporal resolution. However, event streams do not correspond to radiometric values, precluding the direct application of standard electro-optical metrics such as slanted-edge modulation t...
Event cameras have microsecond-level temporal resolution and high dynamic range which make them more resilient to motion blur and poor illumination than standard frame-based cameras. Event-camera visual odometry (VO) pipelines maximize these benefits when they process the asynchronous event stream at the native tempora...
Nikan Nobari, J. Gammell· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.