Papers
Topics
Authors
Recent
Search
2000 character limit reached

Error Bounds for Physics-Informed Neural Networks in Fokker-Planck PDEs

Published 28 Oct 2024 in cs.LG, cs.AI, cs.NA, math.NA, and physics.comp-ph | (2410.22371v2)

Abstract: Stochastic differential equations are commonly used to describe the evolution of stochastic processes. The state uncertainty of such processes is best represented by the probability density function (PDF), whose evolution is governed by the Fokker-Planck partial differential equation (FP-PDE). However, it is generally infeasible to solve the FP-PDE in closed form. In this work, we show that physics-informed neural networks (PINNs) can be trained to approximate the solution PDF. Our main contribution is the analysis of PINN approximation error: we develop a theoretical framework to construct tight error bounds using PINNs. In addition, we derive a practical error bound that can be efficiently constructed with standard training methods. We discuss that this error-bound framework generalizes to approximate solutions of other linear PDEs. Empirical results on nonlinear, high-dimensional, and chaotic systems validate the correctness of our error bounds while demonstrating the scalability of PINNs and their significant computational speedup in obtaining accurate PDF solutions compared to the Monte Carlo approach.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. Andrew R Barron. Approximation and estimation bounds for artificial neural networks. Machine learning, 14:115–133, 1994.
  2. Suman Chakravorty. A homotopic galerkin approach to the solution of the fokker-planck-kolmogorov equation. In 2006 American Control Conference, pp.  6–pp. IEEE, 2006.
  3. Error analysis for physics-informed neural networks (pinns) approximating kolmogorov pdes. Advances in Computational Mathematics, 48(6):79, 2022a.
  4. Generic bounds on the approximation error for physics-informed (and) operator learning. Advances in Neural Information Processing Systems, 35:10945–10958, 2022b.
  5. On the approximation of functions by tanh neural networks. Neural Networks, 143:732–750, 2021.
  6. Error estimates for physics-informed neural networks approximating the navier–stokes equations. IMA Journal of Numerical Analysis, 44(1):83–119, 2024.
  7. AN Drozdov and M Morillo. Solution of nonlinear fokker-planck equations. Physical Review E, 54(1):931, 1996.
  8. Lawrence C Evans. Partial differential equations, volume 19. American Mathematical Society, 2022.
  9. Kurt Hornik. Approximation capabilities of multilayer feedforward networks. Neural networks, 4(2):251–257, 1991.
  10. Applied analysis. World Scientific Publishing Company, 2001.
  11. Brownian motion and stochastic calculus, volume 113. springer, 2014.
  12. Error estimates for deeponets: A deep learning framework in infinite dimensions. Transactions of Mathematics and Its Applications, 6(1):tnac001, 2022.
  13. Deepxde: A deep learning library for solving differential equations. SIAM review, 63(1):208–228, 2021.
  14. On the almost sure convergence of stochastic gradient descent in non-convex problems. Advances in Neural Information Processing Systems, 33:1117–1128, 2020.
  15. Estimates on the generalization error of physics-informed neural networks for approximating pdes. IMA Journal of Numerical Analysis, 43(1):1–43, 2023.
  16. Bernt Øksendal. Stochastic differential equations. Springer, 2003.
  17. Steven E Shreve et al. Stochastic calculus for finance II: Continuous-time models, volume 11. Springer, 2004.
  18. Dgm: A deep learning algorithm for solving partial differential equations. Journal of computational physics, 375:1339–1364, 2018.
  19. BF Spencer and LA Bergman. On the numerical solution of the fokker-planck equation for nonlinear stochastic systems. Nonlinear Dynamics, 4:357–372, 1993.
  20. Numerical solution of the fokker–planck equation using physics-based mixture models. Computer Methods in Applied Mechanics and Engineering, 399:115424, 2022.
  21. Guaranteed approximation error estimation of neural networks and model modification. Neural Networks, 151:61–69, 2022.
  22. Dmitry Yarotsky. Error bounds for approximations with deep relu networks. Neural networks, 94:103–114, 2017.
  23. Gradient-enhanced physics-informed neural networks for forward and inverse pde problems. Computer Methods in Applied Mechanics and Engineering, 393:114823, 2022.
  24. New approximate-analytical solutions to partial differential equations via auxiliary function method. Partial Differential Equations in Applied Mathematics, 4:100045, 2021.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 1 like about this paper.