Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations

By Christian Beck, W. E, Arnulf Jentzen. 2017

364 citations recorded by the source corpus.

High-dimensional partial differential equations (PDEs) appear in a number of models from the financial industry, such as in derivative pricing models, credit valuation adjustment models, or portfolio optimization models. The PDEs in such applications are high-dimensional as the dimension corresponds to the number of financial assets in a portfolio. Moreover, such PDEs are often fully nonlinear due to the need to incorporate certain nonlinear phenomena in the model such as default risks, transaction costs, volatility uncertainty (Knightian uncertainty), or trading constraints in the model. Such high-dimensional fully nonlinear PDEs are exceedingly difficult to solve as the computational effort for standard approximation methods grows exponentially with the dimension. In this work, we propose a new method for solving high-dimensional fully nonlinear second-order PDEs. Our method can in particular be used to sample from high-dimensional nonlinear expectations. The method is based on (1) a connection between fully nonlinear second-order PDEs and second-order backward stochastic differential equations (2BSDEs), (2) a merged formulation of the PDE and the 2BSDE problem, (3) a temporal forward discretization of the 2BSDE and a spatial approximation via deep neural nets, and (4) a stochastic gradient descent-type optimization procedure. Numerical results obtained using TensorFlow in Python illustrate the efficiency and the accuracy of the method in the cases of a 100-dimensional Black–Scholes–Barenblatt equation, a 100-dimensional Hamilton–Jacobi–Bellman equation, and a nonlinear expectation of a 100-dimensional G-Brownian motion.

Subfields: Finance, Ocean Engineering, Statistical and Nonlinear Physics

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Finance

In Ocean Engineering

In Statistical and Nonlinear Physics

Citations in the corpus

DGM: A deep learning algorithm for solving partial differential equations (2017, neutral): “In addition, the deep neural network architecture that we use, which is diﬀerent from the ones used in [15, 2], seems to be able to recover accurately the entire solution (at least for the equations that we studied).”
Deep Autoencoder based Energy Method for the Bending, Vibration, and Buckling Analysis of Kirchhoff Plates (2020, neutral): “Beck et al. [41] employed deep learning to solve nonlinear stochastic diﬀerential equations and Kolmogorov equations.”
Trainability and Accuracy of Artificial Neural Networks: An Interacting Particle System Approach (2018, background): “These successes open exciting possibilities in applied and computational mathematics that are only beginning to be explored [7–9,17,21,30,36].”
Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems (2020, neutral): “5) [226] [251] [301] [303] [70] [196] [228] [248] [318] [82] [102] [144] [292] [216] [195] [23] [90] [320] [154] [58] [236] [53] [70] [192] [252] [26] [61] [149] [88] [299] [216] [195] [225] [145] [198] [171] [44] [188]”
A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate (2021, background): “[39, 40] studied the deep learning in solving stochastic differential equations and Kolmogorov equations, and validated the accuracy and speed proposedmethod, especially in high dimensions.”
Neural Networks as Interacting Particle Systems: Asymptotic Convexity of the Loss Landscape and Universal Scaling of the Approximation Error (2018, background): “These successes open exciting possibilities in applied and computational mathematics that are only beginning to be explored [5–7,12,16,25,30].”
Integrating Physics-Based Modeling with Machine Learning: A Survey (2020, neutral): “Solve PDEs [147] [65] [140] [9] [215] [42] [264] [106] [235] [107] [131] [209] [234] [279] [281] [60] [177] [208] [231] [301] [71] [89] [129] [268] [194] [176] [16] [48] [218] [44] [60] [172] [235] [19] [51] [131] [76] [278] [194] [176] [206] [166]”
Weak Adversarial Networks for High-dimensional Partial Differential Equations (2019, background): “Solving general high-dimensional partial differential equations (PDE) has been a long-standing challenge in numerical analysis and computation [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 11].”