A data maturity-deployment scale framework is introduced, arguing that engineering AI should be understood not as a search for a single best model, but as an evolving intelligence strategy that co-adapts with system maturity, operational context, and deployment scale.
Abstract
Machine learning (ML) has driven major advances across engineering domains, from early data-driven approaches to deep learning and, more recently, foundation models. Despite rapidly increasing model capabilities, the practical impact of ML in engineering systems remains limited. We argue that this gap arises from a fundamental misalignment between prevailing ML paradigms and the realities of engineering environments. Modern ML methods, largely developed for data-rich and statistically stable domains, are fundamentally ill-suited for engineering systems characterized by sparse, noisy, and context-dependent data, uncertain ground truth, non-stationary dynamics, strict deployment constraints, and strong physical and domain knowledge requirements. To address this mismatch, we first identify four core challenges: data and benchmark limitations, distribution shift and generalization, resource and deployment constraints, and insufficient integration of domain knowledge. Then we propose a corresponding four-shift framework: (i) from data quantity to engineered data foundations, (ii) from static learning to adaptive and robust learning, (iii) from model scaling to resource-efficient and deployment-aware intelligence, and (iv) from general-purpose models to domain-specific, knowledge-informed foundation models. Building on this framework, we outline four research directions toward Engineering Intelligence: data foundation intelligence, reliable and generalizable intelligence, sustainable and deployable intelligence, and knowledge-centric intelligence. Finally, we introduce a data maturity-deployment scale framework, arguing that engineering AI should be understood not as a search for a single best model, but as an evolving intelligence strategy that co-adapts with system maturity, operational context, and deployment scale.
Deep neural networks excel in various tasks but struggle to generalize across evolving data distributions, leading to significant performance degradation under domain shifts. Domain incremental learning (DIL) addresses this challenge by enabling models to continuously adapt while retaining prior knowledge. Among existing DIL approaches, the parameter-isolation paradigm achieves state-of-the-art performance. However, these methods often adopt a one-size-fits-all approach to adapt to new domains, resulting in either insufficient learning capacity or redundant parameters. In this work, we propose BPG, a unified framework that addresses both challenges through two complementary components: BPG-Adapter, which dynamically determines each domain's adapter hidden dimension based on domain-specific feature separability, and BPG-Inference, a soft domain mixture strategy that integrates multiple domain-specific models at test time, mitigating domain ID misselection. Experimental results on DomainNet, CDDB, and CORe50 demonstrate that BPG consistently outperforms uniform adapter-based approaches and hard domain selection strategies, achieving state-of-the-art average accuracy while reducing forgetting to as low as 0.22% on DomainNet.
Qiang Wang, Songlin Dong, Shaokun Wang et al.· 0 citations
The findings demonstrate that introducing prior structure, through strategic sparse supervision, pre-trained multimodal knowledge, or transferable representations, consistently compensates for limited labeled data across diverse vision tasks.
Experimental findings show that pretrained models outperform those trained from scratch in terms of accuracy, convergence speed, and robustness, and a unified framework is proposed to integrate both processes in a deep learning pipeline.
Kwame Nkosi· International Journal of App...· 0 citations
Although SDG methods improve performance under highly domain distinguishable stylized shifts, they exhibit limited robustness to background, correlation and corruption shifts on larger datasets, and increased shape bias does not consistently yield enhanced OOD performance, thereby underscoring the need for further research into developing more resilient and generalizable models.
K. Imbulgoda, Ruwan Tennakoon, W. Chuah et al.· International Journal of Com...· 0 citations
Empirical validation shows that GMHF substantially reduces deployment loss as expert reliability increases, and that the divergence between generated and target data falls under reliable feedback, directly corroborating the divergence-minimisation mechanism predicted by the theory.
This work proposes a neuro-symbolic DRL approach that incorporates background symbolic knowledge to improve both sample efficiency and generalization to more challenging, unseen tasks and demonstrates consistent performance improvements over a state-of-the-art reward machine baseline.
Celeste Veronese, Alessandro Farinelli, Daniele Meli· Proceedings of the TwentyThi...· 0 citations