Retinal Fiction: Real-Time Intra-Shot Montage through Gaze-Triggered Generative AI
We present Retinal Fiction, an interactive installation that turns a display into a “magic window” where looking becomes rewriting. When a viewer’s gaze lingers on an object, the system segments it (SAM 2), identifies it (CLIP/Florence-2), and re-renders its appearance through FLUX.1 Fill diffusion inpainting. A glitch...