Efficient solution of the Fokker-Planck Equation via smooth particle hydrodynamics for nonlinear estimation

Duffy, Michael

Permalink

https://hdl.handle.net/2142/106319 Copy

Description

Title

Efficient solution of the Fokker-Planck Equation via smooth particle hydrodynamics for nonlinear estimation

Author(s)

Duffy, Michael

Issue Date

2019-09-30

Director of Research (if dissertation) or Advisor (if thesis)

• Bergman, Lawrence
• Chung, Soon-Jo

Doctoral Committee Chair(s)

Bergman, Lawrence

Committee Member(s)

• Masud, Arif
• Panesi, Marco

Department of Study

Aerospace Engineering

Discipline

Aerospace Engineering

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• Fokker-Planck Equation
• smooth particle hydrodynamics (SPH)
• meshfree methods
• nonlinear filtering
• state estimation
• Bayesian filter
• high-dimensional analysis
• stochastic processes

Abstract

Modeling and predicting the transient behavior of higher dimensional nonlinear dynamical systems subject to Gaussian white noise excitation remains an open problem with broad application to nonlinear estimation, uncertainty quantification, and reliability to name but a few. These problems remain open in large part due to the Curse of Dimensionality, where computational costs tend to increase exponentially, in time and/or memory, with the number of states of the system. This is especially true for sampling based methods that, while robust and often very simple to implement, quickly become computationally cost ineffective in many applications. Parametric models are usually able to scale far more efficiently as state dimension increases, but they are often limited to specific classes of systems due to not being as robust as sampling based methods. Another method to analyze the uncertainty in those dynamical systems is to solve the system's corresponding Fokker-Planck equation. The Fokker-Planck Equation (FPE) is the degenerate parabolic partial differential continuity equation that fully defines the evolution of the states' transition probability density function (PDF) over time. This also makes the transient solution to the FPE an option for estimation purposes. Since any dynamical system that is subject to Gaussian white noise excitation, either additive and/or multiplicative, and satisfies the Markov assumption has a corresponding FPE; this represents an extremely large class of systems of engineering interest. However, finding solutions to the transient Fokker-Planck equation remains difficult for the same reasons mentioned previously; solving partial differential equations in high dimensional state spaces also runs up against the Curse of Dimensionality. Analytical solutions only exist for linear systems and a handful of low dimension nonlinear systems to make evaluating simulation efficacy even more difficult. This work extensively modifies the Smooth Particle Hydrodynamics (SPH) meshfree method in order to rigorously assess its accuracy in simulating up to four state Fokker-Planck equations and explore its suitability for scaling further into higher dimensions. Due to the different potential applications of transient FPE solutions, SPH algorithm performance is analyzed from both an accuracy focused, runtime agnostic standpoint (relevant to reliability analysis) and a runtime focused, accuracy sacrificing standpoint more suited to nonlinear estimation. Rigorous analysis of the convergence characteristics of the algorithm as particle spatial resolution changes is given, as well as the performance impacts of the various accuracy and runtime modifications. The SPH algorithm turns out to be capable of simulating the transient FPE even at extremely low spatial resolution in a stable and robust manner across a variety of systems. However, the mathematical properties of the SPH algorithm make it unable to achieve an arbitrary accuracy concomitant with increasing particle spatial density, especially once one gets to four dimensions. Steep diminishing returns on increased accuracy for computational effort expended are also observed as particle count and state dimension increase. While not very suitable for applications where accuracy is essential far out into the tails of the time-dependent PDF, the SPH algorithm's ability to reliably approximate the probability evolution over time even at very low spatial resolution makes it a good candidate for use in nonlinear estimation. A novel Bayesian Filter based on the SPH simulated FPE is presented in detail, along with a resampling methodology developed to efficiently perform measurement likelihood updates without degeneracy of the SPH particle field occurring. This new FPE-SPH Filter is compared directly to the Extended Kalman Filter and Particle Filter with importance resampling for each system. The FPE-SPH Filter is able to accurately and robustly estimate a variety of two and four state dynamical systems with long times between state measurements, including the bi-modal Duffing oscillator that renders approaches such as the Extended Kalman Filter inconsistent. Lastly, a new method of visualizing the error of high dimensional PDFs is presented, referred to as Sub-Field Signatures (SFSs). These signatures make it easier to analyze at a glance both the distribution and balance of the field error to assess simulation performance at a given time regardless of state dimension. This provides a more information dense way to analyze error than traditional RMS error values, but one that is not nearly as involved as the collections of marginal distributions typically used to examine higher dimensional PDFs.

Graduation Semester

2019-12

Type of Resource

text

Permalink

http://hdl.handle.net/2142/106319

Copyright and License Information

Copyright 2019 - Michael Duffy

Owning Collections