Jul 2026· 2026 6th International Conference on Inventive Computation and Information Technologies (ICICIT)· pp. 1752-1756· 0 citations· 21 references
Abstract
Natural Language Understanding (NLU) addresses cross-domain challenges in understanding language due to inconsistent data distributions, uncertain concept semantics, and inconsistent language use specific to individual domains across different geographical locations. The majority of classical deep learning systems perform poorly because it cannot generalize, leading to cross-domain underperformance in practical settings. Therefore, this research develops a new class of meta-learning that provides a systematic means to advance cross-domain adaptability for NLU in the context of distributed knowledge systems. More specifically, this approach combines federated learning methods, model-agnostic meta-learning (MAML), and domain-adaptive transformers for the first time to enable rapid extraction of domain-invariant representations while concurrently maintaining local contextual semantics across reasonably distributed datasets. The author conducted benchmark assessments on the most recent multi-domain evaluations and cross-lingual and domain-shifted data to simulate distributed knowledge systems. The custom model outperformed all baselines, transformers, and fine-tuning models by an average of 12.8% cross-domain accuracy, 15.3% lower generalization error, and 18.6% faster convergence rate. In the scenario, the new model decreased to less than 90% and maintained over 90% of its performance after a 40% reduction in training samples. Meta-learning enables superior transfer efficiency and model adaptation to new, previously unseen domains with minimal training. The new meta-learning frameworks successfully addressed the required performance and adaptability for advanced intelligent information systems for cross-domain NLU in distributed knowledge bases.
This study explores a semantic variation methodology to augment training data by generating question-answer pairs with explicit control over semantic similarity, and shows that semantically controlled augmentation improves domain-specific knowledge acquisition while preserving consistency.
Alexander Chen, Caroline Tang, Jennifer Sleeman· 0 citations
LMEnt is released to support studies of knowledge in LMs, including knowledge representations, plasticity, editing, attribution, hallucinations, and learning dynamics, finding that entity co-occurrence and mention forms—which are difficult to study with existing tools—affect learning trends.
Daniela Gottesman, Alon Gilaie-Dotan, Ido Cohen et al.· Transactions of the Associat...· 0 citations
The integration of Large Language Models into recommender systems has introduced a new paradigm in which models leverage their pre-trained knowledge to generate recommendations. A prevailing assumption is that an LLM’s inherent knowledge is sufficient to support high-quality recommendations across diverse domains. This paper challenges that assumption, positing that in specialized domains, recommendation efficacy is limited by the textual nature of an LLM’s knowledge. To address this limitation, we propose REKALM, a comprehensive integration framework for enhancing LLM-based recommenders through knowledge integration. Central to our approach is the extension of established text-conversion techniques to non-traditional data modalities. We utilize knowledge lexicalization, a process that translates heterogeneous data sources into a unified natural language format. This lexicalized corpus is then used in a knowledge-aware instruction-tuning pipeline to explicitly align the LLM’s internal representations with four distinct types of domain-specific information. We conduct experiments across four distinct domains to validate our framework. Our findings provide consistent empirical evidence that while an LLM’s inherent knowledge may suffice for universally familiar domains like movies, recommendation quality in more specialized areas is significantly improved through knowledge integration. The proposed approach demonstrates that augmenting LLMs with lexicalized, domain-specific knowledge is an effective system-level strategy for advancing the next generation of recommender systems.
Alessandro Petruzzelli, C. Musto, Marco de Gemmis et al.· ACM Transactions on Informat...· 0 citations
This paper proposes SeSyCo, a Semantic-Symbolic Knowledge Consensus framework, which leverages the semantic space to diverge monolingual queries into broad multilingual evidence, and subsequently utilize the symbolic space to eliminate language discrepancies, converging the gathered information into a robust consensus for precise SPARQL generation.
Yu Zhang, Ran Song, Xiaofei Gao et al.· Proceedings of the 32nd ACM...· 0 citations
This work proposes a novel framework, DOMINO, that learns a minimal sufficient domain representation from reference samples and leverages it to guide the generation of domain-aligned synthetic data, enabling practical and scalable domain adaptation without manual prompt design or natural language domain specifications.
Tong Ye, Hang Yu, Tengfei Ma et al.· Proceedings of the 32nd ACM...· 1 citation
This paper introduces Caduceus, a family of MoE-enhanced foundation models built with a hierarchical pre-training paradigm to jointly integrate biological and natural language, and incorporates a multi-task instruction tuning phase, enabling robust protein parsing and natural language question answering.
Mingze Yin, Yiheng Zhu, Jialu Wu et al.· Proceedings of the 32nd ACM...· 0 citations