Multi-Fidelity Physics-Constrained Neural Network and Its Application in Materials Modeling
Training machine learning tools such as neural networks require the availability of sizable data, which can be difficult for engineering and scientific applications where experiments or simulations are expensive. In this work, a novel multi-fidelity physics-constrained neural network is proposed to reduce the required amount of training data, where physical knowledge is applied to constrain neural networks, and multi-fidelity networks are constructed to improve training efficiency. A low-cost low-fidelity physics-constrained neural network is used as the baseline model, whereas a limited amount of data from a high-fidelity physics-constrained neural network is used to train a second neural network to predict the difference between the two models. The proposed framework is demonstrated with two-dimensional heat transfer, phase transition, and dendritic growth problems, which are fundamental in materials modeling. Physics is described by partial differential equations. With the same set of training data, the prediction error of physics-constrained neural network can be one order of magnitude lower than that of the classical artificial neural network without physical constraints. The accuracy of the prediction is comparable to those from direct numerical solutions of equations.
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
- Sifan Wang
- Paris Perdikaris
- Nam-Ho Kim
- Xinling Yu
- M. Giselle Fernández-Godino
- Raphael T. Haftka
- Chanyoung Park
- G. Em Karniadakis
Citations in the corpus
- When and why PINNs fail to train: A neural tangent kernel perspective (2020, background): “Thanks to the approximation capabilities of neural networks, physics-informed neural networks (PINNs) have already led to a series of remarkable results across a range of problems in computational science and engineering, including fluids mechanics [1, 2, 4, 5], bio-engineering [6, 7], meta-material”
- Review of multi-fidelity models (2016, background): “Liu & Wang (2019) [138] further suggested integrating physics-based constraints within ANNs.”
- Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems (2020, unknown): “1) [266] [10] [219] [158] [140] [182] [203] [76] [86] [130] [174] [204] [231] [313] [121] [125] [187] [92] [306] [180] [298] [184] [267] [39] [247] [133] [130] [231] [298] [173] [66] [24] [255] [12] [17] [203] [204] [213] [239] [125] [281] [214] [176] [249] [310] [309] [311] [245] [78] [266] [297] [”
- Integrating Physics-Based Modeling with Machine Learning: A Survey (2020, unknown): “Improve prediction beyond physical model [287] [35] [102] [104] [271] [247] [4] [199] [139][128] [160] [183] [66] [74] [119] [153] [182] [213] [295] [109] [113] [165] [79] [285] [158] [276] [162] [248] [31] [230] [239] [114] [119] [213] [276] [152] [56] [17] [238] [6] [11] [183] [182] [193] [196] [2”