Skip to content
Book Open access

Group-Supervised Contrastive Learning for Semantic PCG Map Representations

Aug 2026 · International Conference on Foundations of Digital Games · 0 citations · 6 references
Computer Science

TL;DR

A group-supervised contrastive learning framework that addresses semantic ambiguity through two complementary mechanisms that expands parameter-based templates into diverse natural language descriptions using Large Language Models, and a group-supervised multi-positive contrastive objective that aligns text embeddings with sets of maps generated under shared control parameters is introduced.

Abstract

Learning general-purpose representations for symbolic procedural content generation (PCG) remains challenging due to the domain gap between discrete tile maps and natural images, and the lack of reusable semantic backbones for analyzing generated content. A key challenge in PCG is that diverse maps may share identical design intent when generated from the same control parameters, creating many-to-one semantic mappings. Standard contrastive learning approaches struggle in this setting, often treating semantically equivalent maps as negatives, leading to fragmented embedding spaces. In this paper, we present a controlled study on learning semantic representations for symbolic maps aligned with natural language. We introduce a group-supervised contrastive learning framework that addresses semantic ambiguity through two complementary mechanisms: (1) a data construction pipeline that expands parameter-based templates into diverse natural language descriptions using Large Language Models (LLMs), and (2) a group-supervised multi-positive contrastive objective that aligns text embeddings with sets of maps generated under shared control parameters. We evaluate our approach in a Zelda-based grid environment against visual (CLIP, ResNet) and statistical (Tile-MLP) baselines. Results show that explicitly modeling semantic groups leads to improved retrieval accuracy (60.8% R@5 versus 25.7% for statistical baselines), with larger gains under out-of-distribution settings. Moreover, the learned representations support zero-shot inference of several abstract gameplay attributes (e.g., solvability and threat level) within tile-aligned domains, without task-specific supervision. While cross-game transfer remains limited and sensitive to tile mapping quality and domain shift, these results suggest that parameter-guided semantic alignment is a practical step toward reusable representation backbones for symbolic PCG analysis within related domains.

Read PDF

Similar papers

Preprint Jul 2026

Art Beyond Semantics: Sheaf-Informed Contrastive Learning for Multi-Relational Representations

This work introduces CANVAS (Contrastive Art-aware Network for Vision-Language Alignment with Sheaves), a framework for learning relation-aware multimodal representations inspired by sheaf theory, and evaluates on three newly introduced benchmarks of artworks for multi-relational art understanding.

Ludovica Schaerf, Antonio Purificato, Piera Riccio et al. · 1 citation
2026

Enhancing Multimodal Compositional Understanding of Vision-Language Models With Semantic Decoupling and Feature Coupling

Vision-Language Models (VLMs) have achieved remarkable success across various downstream tasks. However, their compositional understanding of complex attributes and relations remains a significant challenge. While existing methods leverage compositional datasets and contrastive learning, they are often compromised by v...

Wenxiang Chen, Housheng Su · 0 citations
Preprint Aug 2026

Bi-semantic Chemical Embedder for Joint Representation Learning of SMILES and Natural Language

Transformer models have revolutionized natural language processing (NLP), and text-based molecular representations like SMILES have successfully extended these architectures to chemistry. However, domain-adaptive pre-training often causes models to overfit to chemical syntax, catastrophically forgetting their foundatio...

David Ming Segura, Jeremy Goumaz, Joshua W. Sin et al. · 1 citation
#computer vision Preprint Jul 2026

Full Glyph Images Beat Token Embeddings: A Controlled Study for Transformers

A dual-branch controlled framework is constructed in which both a Vision-based model and an index-based baseline share an identical decoder backbone, training objective, optimizer, and data curriculum, suggesting that transformers are more modality-agnostic than commonly assumed, and that discrete tokenization is not a...

Shuyang Xiang, Hao Guan · 0 citations
Open access Aug 2026

RoFLIP: Robust and Fine-Grained Alignment for Vision-Language Compositional Reasoning

The Robust and Fine-grained training framework for CLIP-based vision-language models (RoFLIP) is proposed, enhancing both the robustness and granularity of vision-language alignment and underscore RoFLIP’s compositional reasoning and generalization abilities.

Yiwei Sun, Chuan-Bin Liu, Shan-Cheng Fang et al. · 0 citations
Conference Open access 2026

Vector Calligrapher: Generating Scalable Vector Graphics via Structured Linguistic Supervision

This work proposes Vector Cal-ligrapher, a system that treats SVG generation as a conditional language modeling task optimized for both semantic grounding and representational efficiency, and introduces a structured linguistic supervision Font Description Framework that decomposes typo-graphic style into interpretable...

Bo Zhou, Xikang Chen, Yan Gong et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.