Hidden physics models: Machine learning of nonlinear partial differential equations
By Maizar Raissi, G. Em Karniadakis. 2017
1,333 citations recorded by the source corpus.
Abstract While there is currently a lot of enthusiasm about “big data”, useful data is usually “small” and expensive to acquire. In this paper, we present a new paradigm of learning partial differential equations from small data. In particular, we introduce hidden physics models, which are essentially data-efficient learning machines capable of leveraging the underlying laws of physics, expressed by time dependent and nonlinear partial differential equations, to extract patterns from high-dimensional data generated from experiments. The proposed methodology may be applied to the problem of learning, system identification, or data-driven discovery of partial differential equations. Our framework relies on Gaussian processes, a powerful tool for probabilistic inference over functions, that enables us to strike a balance between model complexity and data fitting. The effectiveness of the proposed approach is demonstrated through a variety of canonical problems, spanning a number of scientific domains, including the Navier–Stokes, Schrodinger, Kuramoto–Sivashinsky, and time dependent linear fractional equations. The methodology provides a promising new direction for harnessing the long-standing developments of classical methods in applied mathematics and mathematical physics to design learning machines with the ability to operate in complex domains without requiring large quantities of data.
Subfields: Artificial Intelligence, Statistical and Nonlinear Physics, Numerical Methods & Scientific Computing, AI for Physical Sciences
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Statistical and Nonlinear Physics
- G. Em Karniadakis
- Maizar Raissi
- Paris Perdikaris
- Lu Lu
- Ameya Dilip Jagtap
- Andrea Manzoni
- Liu Yang
- Dongkun Zhang
In Numerical Methods & Scientific Computing
- G. Em Karniadakis
- Maizar Raissi
- Paris Perdikaris
- Jens Berg
- Kaj Nyström
- Yibo Yang
- Stefania Fresca
- Andrea Manzoni
In AI for Physical Sciences
- G. Em Karniadakis
- Maizar Raissi
- Paris Perdikaris
- Lu Lu
- Steven L. Brunton
- Stefania Fresca
- Andrea Manzoni
- Jens Berg
Citations in the corpus
- Neural Ordinary Differential Equations (2018, neutral): “One can train feed-forward or recurrent neural networks to approximate a differential equation (Raissi and Karniadakis, 2018; Raissi et al., 2018a; Long et al., 2017), with applications such as fluid simulation (Wiewel et al.”
- An overview of deep learning in medical imaging focusing on MRI (2018, background): “learning hybrids [12,13], formed to reduce computational costs by having the”
- Differentiable Physics-informed Graph Networks (2019, background): “Based on this fundamental idea, a number of works for simulating and discovering PDEs have been published (Raissi & Karniadakis, 2018; Raissi, 2018).”
- fPINNs: Fractional Physics-Informed Neural Networks (2018, background): “Other examples include, but not limited to, [21, 22, 23].”
- Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations (2018, background): “One could avoid the first drawback concerning numerical differentiation by assigning prior distributions in the forms of Gaussian processes [38, 39, 40, 41] or neural networks [35, 34] to the unknown solution u .”
- Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems (2018, background): “…in the context of identifying nonlinear dynamics, there exist several deterministic and probabilistic tools including radial basis functions [6], neural networks [7], Gaussian processes [8, 9, 10, 11, 12], and nonlinear auto-regressive models such as NARMAX [13] and recurrent neural networks [14].”
- Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations (2017, methodology): “In this second part of our study, we shift our attention to the problem of data-driven discovery of partial differential equations [7, 8, 9].”
- Adversarial Uncertainty Quantification in Physics-Informed Neural Networks (2018, background): “[6, 7, 9, 10] have demonstrated how classical conservation laws and numerical discretization schemes can be used as structured prior information that can enhance the robustness and efficiency of modern machine learning algorithms, introducing a new class of data-driven solvers, as well as a physics-”
- Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations (2017, background): “First, in [9, 10] the authors had to locally linearize any nonlinear terms in time, thus limiting the applicability of the proposed methods to discrete-time domains and compromising the accuracy of their predictions in strongly nonlinear regimes.”
- Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems (2020, background): “Furthermore, Raissi et al. [225] show that the covariance function can explicitly encode the underlying physical laws expressed by differential equations in order to solve PDEs and learn with smaller datasets.”
- Deep Physical Informed Neural Networks for Metamaterial Design (2020, methodology): “More experimental detail can be found in [2], [9].”
- Variational Physics-Informed Neural Networks For Solving Partial Differential Equations (2019, background): “The recent development of PINNs has been well established for forward and inverse problem of solving di ff erential equations [30, 32, 39, 29] and since then a number of extensions has been made to tackle several physical and biomedical problems [28, 18, 19].”
- A Physics-Constrained Data-Driven Approach Based on Locally Convex Reconstruction for Noisy Database (2019, background): “Without the knowledge of the underlying data manifold, it requires a large amount of data to achieve sufficiently accurate predictions which is costly [20,31].”
- The Challenge of Machine Learning in Space Weather: Nowcasting and Forecasting (2019, background): “However, recent works have investigated how to solve differential equations by using deep NNs (see, e.g., Raissi & Karniadakis, 2018; Rudy et al., 2017).”