Skip to content

Boosting Efficiency and Reducing Graph Reliance: Basis Adaptation Integration in Bayesian Multi-Fidelity Networks

· 1 citation · 70 references

TL;DR

This paper presents a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models.

View source

Similar papers

Preprint Sep 2026

Multivariate conformal uncertainty propagation in multitask atomistic simulation: Successes and pitfalls

This work presents the first exploration of multivariate conformal methods for chemical properties, including Bonferroni-corrected hyperrectangles, hyperellipsoidal sets based on the Mahalanobis distance, and custom loss functions within conformal risk control.

Katharine Fisher, M. Herbst, J. Kermode et al. · 1 citation
Open access Sep 2026

Probabilistic multi-fidelity climate model parameterization for better generalization

It is shown that a multi-fidelity approach can provide the best of both worlds: it generalizes to a warmer climate for which high fidelity data are not available, guided by abundant low-fidelity data from an even warmer climate, while retaining the accuracy of high-fidelity data, by learning a nonlinear mapping from lo...

B. Balogh, M. A. Bhouri, L. Peng et al. · 0 citations

Gradient-estimator design overcomes trainability barriers in neural-network-based variational optimization

An unbiased direct gradient estimator is derived and the adaptive minimum-variance phase (AMVP) estimator is introduced for neural-network variational optimization by improving the signal-to-noise ratio of weak gradients to enable reliable scientific calculations where training previously failed, while substantially re...

Yi-He Xue, Rui Wang, Bai-Geng Wang et al. · 0 citations
#machine learning Preprint Oct 2026

Adaptive Mean Estimation by In-Context Learning: A Gradient-Flow Analysis

This work studies how statistical adaptivity is learned in a controlled location-estimation problem, and combines attention experts through either a softmax mixture of experts or a gated linear unit (GLU), and analyze stagewise gradient flow.

Martin Eppert, K. Balasubramanian, Subhro Ghosh et al. · 0 citations
#machine learning Preprint Oct 2026

On architectural choices for interpretability and thermodynamic consistency in Physically Recurrent Neural Networks in the low-data regime

An adjoint encoder-decoder structure with positive scalar contributions ensures energy consistency across scales and non-negative dissipation, leading to even lower training requirements, and demonstrates that data efficiency can be improved with careful architectural choices rooted in the underlying physics.

M. A. Maia, K. Meyer, A. Van Gils et al. · 1 citation

A Distributional Optimisation Perspective on Combining Models in Deep Learning

Combining predictions from different models can improve performance at machine learning tasks, but the training of the individual models and the rule used to combine them are typically chosen separately, and by ad hoc means. Recent advances in distributional optimisation (i.e. where the optimisation occurs over the set...

Cong-Ye Wang, Yan-Kai Lin, Zhe-Yang Shen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.