Skip to content
Open access

Team Poznan at SemEval-2026 Task 13: Detecting Machine-Generated Code with Multiple Programming Languages, Generators, and Application Scenarios

2026 · SemEval@ACL · pp. 2275-2280 · 0 citations · 19 references
Computer Science

TL;DR

Experimental results demonstrate that the GNN-based structural analysis outperforms standalone stylistic and transformer-based base-lines across all subtasks, particularly in multi-class and adversarial settings.

Abstract

Detecting machine-generated code is crucial for maintaining software security, quality and academic integrity. Traditional approaches often rely on stylistic or statistical features, which are increasingly circumvented by advanced code generation models. This paper introduces a novel approach leveraging Graph Neural Networks (GNNs) to capture the structural characteristics of code, specifically modeling source snippets as Abstract Syntax Trees (ASTs). To enhance semantic comprehension, we integrate pre-trained CodeBERT embeddings into the architecture, creating a hybrid model that incorporates structural and semantic information. We evaluate our approach on SemEval-2026 Task 13, covering binary detection, multi-class authorship attribution, and hybrid code classification. Experimental results demonstrate that our GNN-based structural analysis outperforms standalone stylistic and transformer-based base-lines across all subtasks, particularly in multi-class and adversarial settings. This work highlights the potential of GNNs for a more structural understanding of code authorship.

Read PDF

Similar papers

Open access Sep 2026

Graph Neural Networks with Code Structure Embeddings for Model-Agnostic Multi-Class Detection of AI-Generated Programs

GraphCSE, a detector for unseen generators of AI-generated code, represents a program as a heterogeneous code graph with four edge relations and fuses structural and semantic node channels through a learned per-node gate before relation-aware graph attention, restoring model-agnostic detection.

Dr.Hayder Kareem Algabri · 0 citations
Open access Aug 2026

Detecting AI-Generated Text and Code: An Empirical Study of Cross-Generator and Cross-Domain Generalization

A paired-prompt benchmark for human-versus-machine detection across English text, Python code, and mixed text–code documents shows that reliable deployment requires cross-domain evaluation, mixed-content testing, and calibration beyond in-distribution accuracy.

Neethika Alluri, Pardha Saradhi Varma Gottumukkala, H. Indukuri · 0 citations
Conference Sep 2026

Comparative Analysis of Rewriting-Based Large Language Model-Generated Synthetic Code Detection

The case of synthetic code detection (i.e., written by a human or generated by AI) becomes more important in the field of education and security. Current code detection tools that depend on probabilistic and classification-based approaches have limitations in detecting various programming styles. To address this challe...

Maulana Arya Alambana, Arif Nurwidyantoro · 0 citations
Open access Aug 2026

Multilingual Source Code Vulnerability Detection Using Deep Learning: A Semantic Representation and Transfer Learning Approach

This work presents a deep learning approach for multilingual vulnerability detection that emphasizes semantic transfer rather than architectural complexity and suggests that stabilizing semantic representations during transfer is key to improving generalization while maintaining practical efficiency under moderate comp...

Tuan Nguyen Kim, Nin Ho Le Viet, Chieu Ta Quang · 0 citations
Review Sep 2026

Stage-Supervised Latent Reasoning for Single-Shot JavaScript Deobfuscation

JavaScript obfuscation is widely used to protect code, but it also makes program analysis and security review substantially harder. Existing LLM-based deobfuscation methods usually treat the task as one-step translation, ignoring the staged structure of practical deobfuscation pipelines. This WIP paper proposes a stage...

Rong Feng, Suman Saha · 0 citations
Open access 2026

A Text-Based Refactoring Dataset for Multi-Type Prediction Using Code Snippets and Software Metrics

Refactoring is a disciplined process of improving the internal structure of software without changing its external behavior. Empirical studies have shown that refactoring contributes to maintainability and code quality; however, existing machine learning approaches for refactoring prediction rely predominantly on struc...

Amal Alazba, Muna Alrazgan, Nada Al Jamaan et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.