Optical flow characterizes motion in the visual field and is fundamental to motion perception and tracking in biological and artificial vision systems. Biological retinas extract motion efficiently through local ON/OFF pathways and parallel processing, while conventional frame-based optical flow relies on dense sampling and global computation, resulting in high latency and power consumption. To overcome these limitations, we present a pixel-level Optical Flow Sensor (OFS) integrated circuit. The design combines Dynamic Vision Sensor (DVS) ON/OFF event comparison with time-difference measurement to enable fully parallel optical flow computation on-chip. An optical-flow-specific Address-Event Representation (OF-AER) interface supports low-power, high-throughput readout. \rev{Based on the CMOS-based OFS, we further propose optical memristor-based OFS to reduce sensor power consumption and area overhead.} Experimental results show that the proposed OFS achieves a 303$\times$ reduction in power consumption compared with FPGA-accelerated DVS systems while maintaining microsecond-level latency. Moreover, by directly outputting optical flow vectors, the OFS reduces output data size by approximately 3.3$\times$, demonstrating strong potential for ultra-high-speed, low-power vision sensing applications.
This work presents a 1600-channel subretinal prosthesis system-on-a-chip (SoC) that employs edge-based stimulation with adaptive ambient light compensation to improve spatial resolution and ensure stable operation under varying illumination conditions. High-density retinal prostheses often suffer from current dispersio...
Conventional artificial vision systems process dynamic scenes inefficiently by reconstructing motion from discrete frames, which requires post-processing. In contrast, real-world environments containing multiple moving objects demand sensor-level discrimination. This work presents a memristive motion-streak neuron that...
Hyungjun Park, Jin Hong Kim, Hyun Wook Kim et al.· Advances in Materials· 0 citations
With the development of Artificial Intelligence (AI), deep neural networks have shown promising capabilities for image signal processing tasks. However, in practical applications of image processing and visual perception, the object of interest may deviate from the image center, therefore, more complex networks are req...
Conghe Wang, Cai-Hua Zhang, Zheng Huang et al.· IEEE Signal Processing Lette...· 0 citations
Luminescence-based chemical sensors are almost universally read as point detectors with the signal inverted through a single calibration model. Here we reframe optical oxygen sensing as a computer vision problem, in which the sensing film acts as a spatially heterogeneous encoder and a pretrained Temporal Vision Transf...
Nikolaos Salaris, Evangelos Mazomenos, Adrien E. Desjardins et al.· 0 citations
Optical neural networks (ONNs) offer high-throughput and energy-efficient computation, providing a promising alternative to conventional electronic systems. However, their application in bright-field microscopy is limited by random spatial displacements of dynamic targets and a strong unmodulated transmitted-light co...