Physical Symmetries Embedded in Neural Networks

By Marios Mattheakis, Pavlos Protopapas, D. Sondak, Marco Di Giovanni, Efthimios Kaxiras. 2019

86 citations recorded by the source corpus.

Neural networks are a central technique in machine learning. Recent years have seen a wave of interest in applying neural networks to physical systems for which the governing dynamics are known and expressed through differential equations. Two fundamental challenges facing the development of neural networks in physics applications is their lack of interpretability and their physics-agnostic design. The focus of the present work is to embed physical constraints into the structure of the neural network to address the second fundamental challenge. By constraining tunable parameters (such as weights and biases) and adding special layers to the network, the desired constraints are guaranteed to be satisfied without the need for explicit regularization terms. This is demonstrated on upervised and unsupervised networks for two basic symmetries: even/odd symmetry of a function and energy conservation. In the supervised case, the network with embedded constraints is shown to perform well on regression problems while simultaneously obeying the desired constraints whereas a traditional network fits the data but violates the underlying constraints. Finally, a new unsupervised neural network is proposed that guarantees energy conservation through an embedded symplectic structure. The symplectic neural network is used to solve a system of energy-conserving differential equations and out-performs an unsupervised, non-symplectic neural network.

Subfields: Artificial Intelligence, Statistical and Nonlinear Physics

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Xuhui Meng
  2. Dongkun Zhang
  3. G. Em Karniadakis
  4. Zhen Li
  5. Maizar Raissi
  6. Paris Perdikaris
  7. Liu Yang
  8. Lu Lu

In Statistical and Nonlinear Physics

  1. Xuhui Meng
  2. G. Em Karniadakis
  3. Dongkun Zhang
  4. Zhen Li
  5. Lu Lu
  6. Maizar Raissi
  7. Paris Perdikaris
  8. Zhiping Mao

Citations in the corpus