Foundation Model-Assisted Full Waveform Inversion

Abstract

Full waveform inversion (FWI) can recover high-resolution subsurface velocity models. Conventional waveform-difference objectives, however, are vulnerable to cycle skipping when the starting model is inaccurate. We introduce an FWI objective that compares features produced from modeled and observed seismic traces by SeisLM, a pretrained seismic foundation model. The SeisLM encoder remains frozen during inversion, and the feature discrepancy is differentiated with respect to the modeled traces to construct an adjoint source compatible with the standard adjoint-state framework. We also test a scheduled hybrid loss that combines the SeisLM feature loss with the conventional $L_2$ objective. Time-shift diagnostics show that the loss computed from features produced by the pretrained encoder has a broader and smoother basin around the correct alignment than either the waveform $L_2$ objective or the feature loss obtained from an encoder with the same architecture and randomly initialized parameters. In the Marmousi experiment, the SeisLM and hybrid objectives produce similar improvements during early-stage inversion and provide useful models for subsequent reflection-based $L_2$ refinement. In the 2D Overthrust experiment, which begins from a laterally invariant linear-gradient model, the SeisLM feature-loss workflow outperforms the conventional and hybrid workflows, indicating that introducing the $L_2$ contribution too early can reintroduce cycle-skipping sensitivity. In the 3D Overthrust experiment, conventional $L_2$ inversion stalls near the initial linear gradient, whereas the SeisLM feature loss guides the inversion toward a background model from which $L_2$ refinement recovers the principal structures. These results support using features produced by pretrained seismic networks to define early-stage FWI objectives rather than complete replacements for waveform-domain misfits.