Speaker
Description
Deep geothermal energy exploitation relies heavily on predicting heat transport within highly heterogeneous porous formations. The multi-scale nature of subsurface geology (ranging from pore-scale variances to reservoir-scale fracture networks) coupled with the non-linear interaction between Darcy flow and advective-diffusive heat transfer, renders traditional numerical solvers computationally prohibitive for real-time optimization and many-query uncertainty quantification. Scientific Machine Learning, specifically Operator Learning, offers a promising path to overcome this bottleneck by learning mesh-independent solution operators.
In this work, we present a rigorous analysis of two leading operator learning paradigms: Fourier Neural Operators (FNO) and Deep Operator Networks (DeepONet). We utilize a high-fidelity benchmark of dipole flow and heat transport simulations in stochastically generated heterogeneous media to evaluate the capacity of these architectures to act as reliable surrogates for the management of geothermal reservoirs. We present an exhaustive comparative analysis of both architectures, focusing not just on global error metrics, but on the spatial and spectral distribution of residuals. Furthermore, we investigate the internal mechanisms of both models to understand their respective failure modes. By explicitly mapping how each architecture encodes physical heterogeneity, we propose novel strategies to mitigate spectral bias, enabling hybrid architectures that reconcile global spectral efficiency with the local resolution necessary for robust geothermal digital twins.
Our primary contribution is the demonstration and quantification of ``spectral bias'' in standard FNO architectures. While FNOs exhibit exceptional performance in diffusion-dominated regimes, our results reveal a structural inability to resolve high-frequency spatial features in advection-dominated scenarios. Specifically, the intrinsic frequency truncation in FNO layers acts as a low-pass filter, leading to significant localized errors around singularities (injection/production wells) and sharp thermal fronts. This smoothing effect compromises the physical fidelity required for operational decision-making in geothermal doublets.
Comparatively, Deep Operator Networks (DeepONet) utilize a dual Branch and Trunk structure that learns an adaptive basis, theoretically offering superior resolution for local singularities compared to the fixed Fourier basis of FNOs (Lu et al., 2021). However, recent analyses indicate that while DeepONets offer geometric flexibility, standard MLP-based trunks suffer from their own spectral bias, leading to slower convergence when resolving multimodal global fields compared to spectral methods (Wang et al., 2021; Rahaman et al., 2019). To reconcile these trade-offs, we propose a novel hybrid strategy inspired by recent `global-local' operator learning paradigms (Wen et al., 2022; Jiang et al., 2024). Our approach integrates FNOs to efficiently resolve the dominant global transport dynamics with a localized DeepONet correction module, specifically targeted to capture the high-frequency residuals at injection wells. This architecture aims to bridge the computational speed of spectral methods with the physical fidelity required for high-Péclet geothermal reservoir management.
| References | Lu et al. (2021): Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021). Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators. Nature Machine Intelligence, 3(3), 218-229. https://doi.org/10.1038/s42256-021-00302-5 Rahaman et al. (2019): Rahaman, N., Baratin, A., Arpit, D., Draxler, F., Lin, M., Hamprecht, F.,... & Courville, A. (2019). On the Spectral Bias of Neural Networks. International Conference on Machine Learning (ICML), 97, 5301-5310. http://proceedings.mlr.press/v97/rahaman19a.html Wang et al. (2021): Wang, S., Wang, H., & Perdikaris, P. (2021). On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 384, 113938. https://doi.org/10.1016/j.cma.2021.113938 Wen et al. (2022): Wen, G., Li, Z., Azizzadenesheli, K., Anandkumar, A., & Benson, S. M. (2022). U-FNO—An enhanced Fourier neural operator-based deep-learning model for multiphase flow. Advances in Water Resources, 163, 104180. https://doi.org/10.1016/j.advwatres.2022.104180 Jiang et al. (2024): Jiang, Z., Zhu, M., & Lu, L. (2024). Fourier-MIONet: Fourier-enhanced multiple-input neural operators for multiphase modeling of geological carbon sequestration. Reliability Engineering & System Safety, 251, 110392. https://doi.org/10.1016/j.ress.2024.110392 |
|---|---|
| Country | Spain |
| Student Awards | I would like to submit this presentation into both awards |
| Acceptance of the Terms & Conditions | Click here to agree |








