This paper constructs TransBERT, which uses channel attention and bidirectional encoding representation of character-level features to explore the information in text, and shows that the performance of TransBERT is better than the current most advanced baseline model.
In order to solve the problems of domain entity lack and high noise, little human supervision in low resource specialized corpora, this work adopts the method of multi-feature fusion of dynamic domain dictionary expansion. The method includes dictionary matching, semantic confidence filtering and confidence-weighted na...
A comprehensive natural language processing (NLP) pipeline for extracting key information and identifying industries, which outperforms traditional machine learning baselines and single deep learning models, offering more reliable recognition for minority classes.
Xin-Yi Xu· Applied and Computational En...· 0 citations
This study validates the effectiveness of the BERT model in semantic similarity calculation, providing more accurate technical support for related application scenarios, and laying the foundation for subsequent model optimization and lightweighting research.
Jia-Cheng Gao· International Conference on...· 0 citations
An ERNIE-Transformer sentiment classification model that integrates ERNIE and Transformer architectures is proposed that achieves high classification accuracy for financial forum text sentiment analysis and provides an efficient and accurate solution for investor sentiment monitoring.
Xiu-Mei Li, Fei Chen, Wen-Chao Ling et al.· Journal of Electrical System...· 0 citations
This article proposes a three-stage enhancement strategy: a global self-attention mechanism to enhance contextual modeling and boundary semantic representation; a dropout reorganization strategy to mitigate over-regularization during prediction; a dynamic gated fusion network to achieve adaptive aggregation of structur...
Financial statement information extraction and technical document data management both face significant challenges due to complex formats, scattered layouts, and intricate proximity-based semantic relations within semi-structured documents. These challenges are particularly evident in engineering enterprises involving...
