Integrating Segment Anything Model 2 and Multimodal Generative Models for a Lightweight Projection Mapping Framework
A lightweight framework integrating Segment Anything Model 2 and multimodal generative AI is developed in this study to automate projection mapping. By leveraging Google Vertex AI cloud application programming interfaces (APIs) and a Python-TouchDesigner bridge, the developed framework bypasses local hardware constrain...