Skip to content

Unrolling the shutter in 4D: exploiting sub-scan dynamics with event cameras for efficient dynamic measurements

Oct 2026 · PHOTOMET EDUMET · Vol 14495, pp. 1449509 - 1449509-9 · 0 citations · 12 references
Engineering

TL;DR

It is shown that the event-based approach coupled with motion compensation can scan slower than a frame-based approach to recover the same moving object, reducing redundancy in measurements.

Abstract

We report an event-camera-based optical 4D (3D+time) sensor and compare it with a classical frame-based counterpart while measuring dynamic scenes. Frame-based active stereo 4D sensors project a series of patterns per single 3D scan into a scene for parallel temporal coding of object surface points. This is comparable to the parallel measurement of a global shutter camera in 3D. At the same time, each of the cameras measures the scene's responses. Phase retrieval, temporal correlation, or other methods identify pixels in both cameras which have likely seen the same object point. This approach forbids significant object motion during a single scan for spatio-temporal consistency. Consequently, high projection rates, high frame rates, and high illumination power are necessary for measuring fast motion. We developed an event-based stereo 4D sensor to break this limitation. Event cameras don’t measure complete frames, but instead, each pixel monitors its incoming brightness independently. When a positive or negative change crosses a threshold, an event is reported, i.e. a small data package with the pixel’s coordinates, a high-resolution timestamp, and photometric information, most commonly the polarity of the change. Coupled with a specialized projector, our event cameras sequentially measure sparse slices of the scene, which can be thought of as a rolling shutter. Temporally corresponding events are used to triangulate and reconstruct 3D points with timestamps from these events. We show that our event-based approach coupled with motion compensation can scan slower than a frame-based approach to recover the same moving object, reducing redundancy in measurements.

View source

Similar papers

Preprint Oct 2026

Event Cameras versus Frame Cameras for Synthetic-Aperture Imaging: A Simulation Study

Synthetic-aperture imaging (SAI) removes occluders such as foliage by integrating many views of a scene along a camera path. It has so far been used mainly with frame cameras. We ask whether an event camera has advantages for SAI, and answer the question in simulation, where both sensors see exactly the same scene and...

Jakob Hinterholzer, Mohamed Youssef, Oliver Bimber · 0 citations
Preprint Nov 2026

Video Stitching from Multiple Moving Cameras

We address geometric video alignment for the same scene captured by multiple freely moving cameras. Existing methods, which are based on image stitching or video stabilization, are typically limited to two cameras or must assume the restrictive setting of a fixed linear ordering of the cameras. We propose MViS, a light...

Shira Ifergane, Roy Amoyal, Shahar Ben Ishay et al. · 0 citations
Preprint Oct 2026

4D Reconstruction with Events&RGB

It is suggested that even a lightweight, non-invasive fusion of event data can meaningfully improve 4D reconstruction robustness, motivating a more thorough architectural investigation in future work.

Dulanga Weerakoon, Darshana Rathnayake, Van Minh Do et al. · 0 citations
Preprint Oct 2026

ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild

Dynamic scenes may be captured by a moving camera, multiple video streams, or images taken at different times. These observations reveal complementary aspects of scene geometry and motion, yet bringing them together requires establishing correspondence across viewpoints, capture times, and visibility changes. We introd...

Ilya Fradlin, Christian Schmidt, Jens Piekenbrinck et al. · 1 citation
Open access Oct 2026

Calibration-driven modulation transfer function estimation for event-based cameras.

Pixels in event-based cameras (EBCs) report log-intensity changes asynchronously and operate in high dynamic range with microsecond temporal resolution. However, event streams do not correspond to radiometric values, precluding the direct application of standard electro-optical metrics such as slanted-edge modulation t...

Achour Idoughi, Keigo Hirakawa · 0 citations
Preprint Oct 2026

Real-time Event-camera Stereo Visual Odometry via Keytime Gaussian Process Regression

Event cameras have microsecond-level temporal resolution and high dynamic range which make them more resilient to motion blur and poor illumination than standard frame-based cameras. Event-camera visual odometry (VO) pipelines maximize these benefits when they process the asynchronous event stream at the native tempora...

Nikan Nobari, J. Gammell · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.