Skip to content

Ground-truth Construction and Evaluation of LLM Contribution to Life Sciences Tool Annotation

· 0 citations · 13 references

TL;DR

This work compares the respective capabilities of domain experts and of an Large Language Model (LLM) agent to generate useful domain-specific annotations for classifying, indexing, and searching scientific resources, and shows the complementarity between domain experts and LLMs.

View source

Similar papers

Review

AI-Assisted Knowledge Graph Metadata Curation: An Empirical Evaluation

An AI-assisted form for KG metadata curation that enables a more efficient curation workflow, leads to more complete metadata, and is preferred by participants over both baselines is presented.

M. Mohammadi, Anas Elghafari, Chang Sun et al. · 0 citations
#artificial intelligence Preprint Oct 2026

LLM-Assisted Discovery of Typed Semantic Links for Ontology Network Construction

Constructing typed, justified semantic links between ontologies is essential for enabling interoperability across heterogeneous and interdisciplinary knowledge domains. However, manually curating such links is difficult to scale. To address this challenge, we propose an end-to-end framework for ontology network constru...

Nouha Hayouni, Sheeba Samuel, Alsayed Algergawy · 0 citations
#artificial intelligence Preprint Sep 2026

ArticleMiner: Ontology-Guided Knowledge Graph Construction from Scientific Publications

This work builds four modules (for drug-discovery chemistry, materials science, machine learning, and mineral geochemistry) in the ArticleMiner framework, and evaluates them on 163 papers, including a new geochemistry benchmark with expert-curated ground truth.

Md Abrar Jahin, Craig A. Knoblock, Jay Pujara · 0 citations
#artificial intelligence Preprint Aug 2026

Expert Knowledge&Machine Understanding: Bridging Reactome's Ontology with LLM Semantic Embeddings

This study explores whether human-written descriptions in Reactome can be used to infer the experts'defined global hierarchical structure and indicates that the global hierarchical structure of pathways can be inferred by experts textual metadata.

Susanna Bravi, R. De Luca, R. Sicilia et al. · 0 citations
#artificial intelligence Preprint Aug 2026

When Does Bigger Help? A Controlled Study of LLM Scale for Ontology Learning

Findings show that model size alone is an insufficient selection criterion for OL and provide empirical guidance for reproducible LLM-assisted ontology engineering and indicate that architecture and model lineage can outweigh nominal parameter count.

Hamed Babaei Giglou, S. Auer, Jennifer D'Souza · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.