This work evaluates several pretrained vision models on a temporally controlled Wikidata corpus of artworks and shows that these models contain usable temporal information, however, a qualitative analysis indicates that this temporal knowledge is shaped by various biases.
Abstract
Museum and archival datasets do not mirror historical artistic production, but materialize the contingent histories of collecting, preservation, cataloging, and digitization. This has direct consequences for interpreting pretrained image representations: they may appear to encode historical time while actually encoding the institutional conditions under which objects become visible as data. We describe this phenomenon as temporal entanglement and investigate it by formulating artwork dating as an uncertainty-aware regression task over frozen image embeddings. We evaluate several pretrained vision models on a temporally controlled Wikidata corpus of artworks. Our results show that these models contain usable temporal information, with Vision-Language Models (VLMs) outperforming purely visual self-supervised baselines. However, a qualitative analysis indicates that this temporal knowledge is shaped by various biases.
This work introduces CANVAS (Contrastive Art-aware Network for Vision-Language Alignment with Sheaves), a framework for learning relation-aware multimodal representations inspired by sheaf theory, and evaluates on three newly introduced benchmarks of artworks for multi-relational art understanding.
Ludovica Schaerf, Antonio Purificato, Piera Riccio et al.· 1 citation
It is found that visual coherence and text-image alignment are nearly uncorrelated across terms and jointly separate distinct failure modes, and fine-tuning improves retrieval overall, but its gains favour shallower terms in the hierarchy, where text-image alignment improves most, beyond what concept frequency explains...
Ratan J. Sebastian, Anett Hoppe, Christoph Rippe et al.· 0 citations
MMArt is introduced, a large-scale dataset of 74,234 WikiArt paintings, each annotated with four independently annotated perspectives plus a harmonized unified caption, produced by specialized vision-language models or human annotation and validated through complementary quality evaluations.
Shuai Wang, Wang-Yuan Ding, Yixian Shen et al.· 0 citations
This approach converts detailed visual features into descriptive terms, addressing a key challenge in art history, and connects the use of images as data with the semantic concerns of humanists, establishing vision-based computational art history as an area for future growth.
This work compares two parallel paradigms for composition analysis: a human-inspired method grounded in perceptual grouping, and fine-tuned foundation models enabled by recent large-scale compositional datasets.
F. Behrad, T. Tuytelaars, Johan Wagemans· 0 citations
Across OLMo-2, Llama-3.1, and Qwen-3, under both MEMIT and AlphaEdit and in batch and sequential regimes, Moir consistently extends preservation in the most vulnerable domains, suggesting that aligning the preservation distribution with the model's operative distribution is a key factor in non-destructive editing and t...
Jea Kwon, Jiwon Kim, Dong-Kyum Kim et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.