Concept-based vision models represent images through an intermediate layer of human-inspectable concepts, so what a model relies on can be traced to those concepts. However, those models are often limited to fixed categories or depend on language to define their concepts. We introduce DisParQ (Discrete Parts with Quant...
Adam Pardyl, Siddhartha Gairola, Sukrut Rao et al.· 0 citations
Concept bottleneck models (CBMs) make predictions inspectable and intervenable by routing them through human-interpretable concepts, but originally required concept annotations. Annotation-free variants remove this requirement, but typically use large concept vocabularies, static at both training and inference, produci...
Wolfgang Stammer, Sukrut Rao, Hevra Petekkaya et al.· 0 citations
This work proposes TEVI, a framework that uses captions as a signal for what to retain from image embeddings and uses sparse autoencoders to disentangle image embeddings and train a masking module to selectively reconstruct the embedding based on a given caption.
S. Mahajan, Sukrut Rao, Jiahao Xie et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.