JediKG: Return of the Schema

Abstract

Benchmark datasets for Knowledge Graph Refinement typically contain only ground facts, discarding the schema available in the source knowledge graph. This limits the evaluation of Neural-Symbolic methods that leverage expressive schemas. We present JEDIKG the first resource that systematically addresses these gaps through two components: JDEX a general configurable tool for extracting complete, portable, modular dataset from any RDF/OWL knowledge graph; and JDSET, a curated suite of eleven datasets with varying expressivity, volume, and domain. JDEX preserves full schema expressivity, employs standard OWL reasoning to detect and correct inconsistencies and materialize implicit knowledge, applies schema modularization, and provides utilities for integration with mainstream machine learning libraries such as PyTorch and PyKEEN. We validated the completeness and portability of the datasets across several dimensions and preliminarily proved the utility of JEDIKG in experimental workflows combining data-driven methods with schema-driven reasoning.