Skip to content
Book Open access

Unified Semantic Modeling Framework for Large-Scale Job Understanding at LinkedIn

Jun 2026 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · pp. 5015-5020 · 0 citations · 37 references
Computer Science

TL;DR

A unified semantic modeling framework powered by a small language model (SLM) to address the challenges of job understanding in structured and unstructured contexts and provides practical insights into building industry-scale text understanding systems.

Abstract

Job understanding is critical to LinkedIn's mission of connecting talent with opportunity. This task involves transforming unstructured and noisy job postings into standardized or derived job attributes that power numerous LinkedIn products. However, building a scalable, cost-efficient, and high-performing job understanding system remains challenging. In this paper, we present a unified semantic modeling framework powered by a small language model (SLM) to address the challenges. We begin by fine-tuning an open-source SLM using a suite of carefully curated synthetic tasks augmented with reasoning traces. These tasks jointly target taxonomy-guided classification and taxonomy-agnostic entity extraction. This allows the resulting model to acquire robust zero-shot generalization for job understanding in structured and unstructured contexts. Building upon this foundation, we introduce a multi-adapter architecture with attribute grouping to facilitate efficient task-specific adaptation while streamlining model management across diverse downstream attributes. Offline evaluations and online A/B tests demonstrate significant performance improvement while reducing operational complexity. Our work provides practical insights into building industry-scale text understanding systems.

Read PDF

Similar papers

2026

Augmenting Datasets for Fine-Tuning Large Language Models Using Semantic Variations

This study explores a semantic variation methodology to augment training data by generating question-answer pairs with explicit control over semantic similarity, and shows that semantically controlled augmentation improves domain-specific knowledge acquisition while preserving consistency.

Alexander Chen, Caroline Tang, Jennifer Sleeman · 0 citations
Open access Aug 2026

TaSC-LLM: A Large Language Model–Enabled Business Intelligence Framework for Topic Analytics in Live-Streaming E-Commerce Systems

Empirical evaluation of TaSC-LLM shows that the proposed framework achieves strong taxonomy coverage, classification accuracy, and agreement with expert annotations, and suggests that LLM-based reasoning can help convert unstructured user-generated text into interpretable topic measures for downstream empirical and man...

Geng Peng, Xiaoxi Wang, Ruoshi Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

DocHop: Benchmarking Out-of-domain Multi-hop Reasoning in Information-Dense Documents

This work introduces DocHop, a benchmark for integrated chart--context reasoning in document-style images and constructs DocHop via a stochastic logic-first generation pipeline with controllable reasoning depth and visual density, to enable systematic evaluation.

Zhuoran Yu, Le Thien Phuc Nguyen, Jaden Park et al. · 1 citation
Book Open access Aug 2026

AgentsKG: A Hierarchical Multi-Agent Framework for Open-Domain Knowledge Graph Construction

Extensive experiments demonstrate that AgentsKG outperforms state-of-the-art training-free baselines in both extraction accuracy and structural quality, offering a robust approach to open-domain knowledge graph construction without additional training.

Shi-Long Liu, Yongqiang Liu, Jiye Liu et al. · 0 citations
#artificial intelligence Preprint Aug 2026

pro-team at LLMs4OL 2026 Tasks Flagship and Reuse: Retrieval-Augmented Generation and Vocabulary-Constrained Filtering for Ontology Learning

This work addresses both the End-to-End Flagship Task (Task A) and Ontology Extension Reuse Task (Task B) using an offline retrieval-augmented few-shot prompting pipeline, and achieves Semantic Graph Similarity but no non-taxonomic relations are extracted, highlighting limitations of closed, taxonomy-oriented relation...

Shivam Mishra, Dhannu Ram Meena, M. Ojha et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.