Skip to content
Open access

Rethinking machine learning for engineering

Jul 2026 · Machine Learning: Engineering · Vol 2 · 0 citations · 72 references
Physics

TL;DR

A data maturity-deployment scale framework is introduced, arguing that engineering AI should be understood not as a search for a single best model, but as an evolving intelligence strategy that co-adapts with system maturity, operational context, and deployment scale.

Abstract

Machine learning (ML) has driven major advances across engineering domains, from early data-driven approaches to deep learning and, more recently, foundation models. Despite rapidly increasing model capabilities, the practical impact of ML in engineering systems remains limited. We argue that this gap arises from a fundamental misalignment between prevailing ML paradigms and the realities of engineering environments. Modern ML methods, largely developed for data-rich and statistically stable domains, are fundamentally ill-suited for engineering systems characterized by sparse, noisy, and context-dependent data, uncertain ground truth, non-stationary dynamics, strict deployment constraints, and strong physical and domain knowledge requirements. To address this mismatch, we first identify four core challenges: data and benchmark limitations, distribution shift and generalization, resource and deployment constraints, and insufficient integration of domain knowledge. Then we propose a corresponding four-shift framework: (i) from data quantity to engineered data foundations, (ii) from static learning to adaptive and robust learning, (iii) from model scaling to resource-efficient and deployment-aware intelligence, and (iv) from general-purpose models to domain-specific, knowledge-informed foundation models. Building on this framework, we outline four research directions toward Engineering Intelligence: data foundation intelligence, reliable and generalizable intelligence, sustainable and deployable intelligence, and knowledge-centric intelligence. Finally, we introduce a data maturity-deployment scale framework, arguing that engineering AI should be understood not as a search for a single best model, but as an evolving intelligence strategy that co-adapts with system maturity, operational context, and deployment scale.

Read PDF

Similar papers

Preprint Aug 2026

BPG: Balancing Plasticity and Generalization for Domain Incremental Learning

Deep neural networks excel in various tasks but struggle to generalize across evolving data distributions, leading to significant performance degradation under domain shifts. Domain incremental learning (DIL) addresses this challenge by enabling models to continuously adapt while retaining prior knowledge. Among existing DIL approaches, the parameter-isolation paradigm achieves state-of-the-art performance. However, these methods often adopt a one-size-fits-all approach to adapt to new domains, resulting in either insufficient learning capacity or redundant parameters. In this work, we propose BPG, a unified framework that addresses both challenges through two complementary components: BPG-Adapter, which dynamically determines each domain's adapter hidden dimension based on domain-specific feature separability, and BPG-Inference, a soft domain mixture strategy that integrates multiple domain-specific models at test time, mitigating domain ID misselection. Experimental results on DomainNet, CDDB, and CORe50 demonstrate that BPG consistently outperforms uniform adapter-based approaches and hard domain selection strategies, achieving state-of-the-art average accuracy while reducing forgetting to as low as 0.22% on DomainNet.

Qiang Wang, Songlin Dong, Shaokun Wang et al. · 0 citations

Transferring Deep Learning Technology to Industry

The findings demonstrate that introducing prior structure, through strategic sparse supervision, pre-trained multimodal knowledge, or transferable representations, consistently compensates for limited labeled data across diverse vision tasks.

Tobias Schiele · 0 citations
Open access 2023

Deep Learning Enhancements Using Pretraining and Fine-Tuning

Experimental findings show that pretrained models outperform those trained from scratch in terms of accuracy, convergence speed, and robustness, and a unified framework is proposed to integrate both processes in a deep learning pipeline.

Kwame Nkosi · 0 citations
Review Open access Aug 2026

Single Domain Generalization Benchmark: Current State and Challenges

Although SDG methods improve performance under highly domain distinguishable stylized shifts, they exhibit limited robustness to background, correlation and corruption shifts on larger datasets, and increased shape bias does not consistently yield enhanced OOD performance, thereby underscoring the need for further research into developing more resilient and generalizable models.

K. Imbulgoda, Ruwan Tennakoon, W. Chuah et al. · 0 citations
Preprint Jul 2026

Human-Machine Collaboration on Generative Meta-Learning: Model and Algorithm

Empirical validation shows that GMHF substantially reduces deployment loss as expert reliability increases, and that the divergence between generated and target data falls under reliable feedback, directly corroborating the divergence-minimisation mechanism predicted by the theory.

M. P. Unni, Samuel Kaski · 0 citations
Conference Open access Jul 2026

Symbolic Knowledge Transfer for Sample-Efficient Deep Reinforcement Learning

This work proposes a neuro-symbolic DRL approach that incorporates background symbolic knowledge to improve both sample efficiency and generalization to more challenging, unseen tasks and demonstrates consistent performance improvements over a state-of-the-art reward machine baseline.

Celeste Veronese, Alessandro Farinelli, Daniele Meli · 0 citations