Skip to content

The E6 model: span-level contrastive learning for enhancing biomedical named entity recognition

Aug 2026 · Neural computing & applications (Print) · Vol 38 · 0 citations · 45 references

TL;DR

This study introduces E6, a unique method that combines structured prediction utilizing Conditional Random Fields with BIOES labeling, domain-adapted language models (PubMedBERT), and a new span-level contrastive loss that specifically addresses boundary detection problems.

View source

Similar papers

Addressing Span Imbalance and Semantic Complexity in Nested Medical Named Entity Recognition

The proposed AGPNer integrates a heterogeneous dependency fusion encoder, which reconstructs masked entities to enhance token representations and fine-tunes a hybrid dependency modeling block to learn domain-specific patterns in medical texts; an imbalance-adaptive span decoder, which decouples entity and non-entity sp...

Yu-Ling Li, Yang-Juan Hu, Yi-Ming Bao et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Custom Named Entity Recognition and Topic Classification for Global Health Publications

How should natural language processing models be selected and adapted for global health literature in environments where annotated data and computational resources are limited? This thesis investigates these challenges through experiments on semantic tag discovery, named entity recognition (NER), and multi-label topic...

Genis Skura, A. Geissbühler, Jean-Luc Falcone · 0 citations
Conference Open access Sep 2026

Structure-Aware Contrastive Learning for Biomedical Embeddings: Bridging the Gap Between HPO and Clinical Literature

A new embedding adaptation procedure is defined whose fine-tuning approach is guided by a novel "Disease-Overlap" similarity measure, which prioritizes clinical co-occurrence of phenotypes over taxonomic distance, and optimizes the embedding space using AnglE Loss to mitigate gradient saturation.

Jose L. Mellina Andreu, Alejandro Cisterna García, Juan A. Botía · 0 citations
Open access Aug 2026

Biomedical Text Mining and Information Extraction Using Prompt-Enhanced and LoRA-Adapted Large Language Models

Biomedical named entity recognition (NER) and relation extraction (RE) remain challenging because biomedical texts contain ambiguous abbreviations, complex entity boundaries, domain-specific terminology, and implicit relations. This study proposes a prompt-enhanced and QLoRA-adapted large language model framework for b...

Feng Yan, De-Quan Zheng, Feng Yu et al. · 0 citations
#natural language process... Preprint Sep 2026

BELXTR: Biomedical Entity Linking via Contextualized Token Retrieval

BELXTR is presented, a novel embedding model based on the multi-vector (a.k.a. late interaction) architecture, which allows to leverage token-level matching information in biomedical entity linking by integrating an existing task-specific training objective and exploring active query expansion.

Samuele Garda, U. Leser · 0 citations
Open access 2026

Knowledge Distillation for Biomedical Text Classification: A Systematic Comparative Analysis of Multiple Teacher–Student Architectures

Findings demonstrate that compact models can achieve strong biomedical classification performance through KD under compatible teacher–student pairings, while also highlighting that KD effectiveness varies substantially depending on the specific model combination.

Amine Gonca Toprak, Aytuğ Onan · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.