Better inference for stochastic dynamical systems

Image 1 of 1
Figure shows two random time-evolving signals
The figure shows a two-dimensional stochastic process, with the blue curve representing X1 and the orange curve representing X2; the black circles mark the discrete noisy observations, indicating that the process is only partially observed with measurement noise.

Stochastic dynamical systems arise in many scientific fields and are also the topic of Petar Jovanovski’s PhD thesis. Many real-world systems, such as asset prices in financial markets, neural activity in the brain, or the spread of infection diseases, evolve in ways that are partly random.

These processes are described using differential equations. A classic example of randomness in dynamics is Brownian motion: the irregular movement of pollen particles suspended in water, driven by collisions with surrounding molecules. Unlike purely deterministic systems, where the trajectory is smooth and predictable, stochastic processes combine random fluctuations with an underlying trend. To study such phenomena, researchers use stochastic differential equations (SDEs).

Petar Jovanovski
Photo: Daniel Stahre

– Most of the thesis focuses on continuous-time models, though one paper also considers discrete-time systems. Even though the behaviour is continuous in time, we observe it only at discrete points, often corrupted by measurement noise. The central aim is parameter inference: estimating the parameters of these models in a Bayesian framework by computing their posterior distribution given the data. However, because the likelihood function is analytically intractable, standard statistical tools cannot be applied directly.

Methods that use the observed data to guide the simulations

Approximate Bayesian computation (ABC) is a branch of Bayesian statistics that relies on generating simulated data and then assessing how close the simulations are to the observed data. In the SDE context, the idea is to simulate parameters, generate trajectories under those parameters, and retain the simulations that are sufficiently close to the observed data. Some trajectories may be rejected simply due to randomness rather than because the parameters are poor. To address this, a data-conditional framework has been developed: instead of simulating trajectories entirely from the SDE, the simulations are conditioned directly on the observed data.

These methods have been applied, for example, to the highly variable Schlögl model, which exhibits noise-induced bistability, and in this challenging case inference was obtained. In addition, new splitting schemes for chemical reaction networks have been introduced that preserve structural properties which standard numerical methods fail to capture. Overall, these advances reduce simulation rejection rates and enable faster, more reliable inference for stochastic dynamical systems.

Combining SDE and statistics

Petar studied computer science and engineering in North Macedonia and then worked at the Macedonian Academy of Sciences and Arts in Skopje. When a new master’s programme in statistics and actuarial mathematics was introduced, he enrolled to build a stronger statistical foundation. He has always found SDEs interesting and wanted to combine them with statistics, although at that point he knew nothing about ABC.

Meanwhile, he had started to follow Umberto Picchini, professor of statistics at the Department of Mathematical Sciences, on Twitter. When a PhD position was announced, Petar applied and was accepted, and Umberto became his supervisor. Petar has enjoyed his time in Gothenburg. He found teaching “quite nice” and served as a teaching assistant in the course Stochastic Processes, the same course that first sparked his interest when he took it in North Macedonia. Looking ahead, Petar plans to pursue research in industry.

Petar Jovanovski will defend his PhD thesis Simulation-based parameter inference methods based on data-conditional simulation of stochastic dynamical systems on September 19 at 09:00 in the lecture hall Pascal, Hörsalsvägen 1. Supervisor is Umberto Picchini, assistant supervisors Petter Mostad and Moritz Schauer.

Petar Jovanovski
  • Doctoral Student, Applied Mathematics and Statistics, Mathematical Sciences

Author

Setta Aspström