A core task in statistical analysis, especially in the era of Big Data, is the fitting of flexible, high-dimensional, and non-linear models to noisy data in order to capture meaningful patterns. This can often result in challenging non-linear and non-convex global optimization problems. The large data volume that must be handled in Big Data applications further increases the difficulty of these problems. Swarm Intelligence Methods for Statistical Regression describes methods from the field of computational swarm intelligence (SI), and how they can be used to overcome the optimization bottleneck encountered in statistical analysis.


  • Provides a short, self-contained overview of statistical data analysis and key results in stochastic optimization theory
  • Focuses on methodology and results rather than formal proofs
  • Reviews SI methods with a deeper focus on Particle Swarm Optimization (PSO)
  • Uses concrete and realistic data analysis examples to guide the reader
  • Includes practical tips and tricks for tuning PSO to extract good performance in real world data analysis challenges


chapter Chapter 1|18 pages


chapter Chapter 2|18 pages

Stochastic Optimization Theory

chapter Chapter 3|8 pages

Evolutionary Computation and Swarm Intelligence

chapter Chapter 4|20 pages

Particle Swarm Optimization

chapter Chapter 5|24 pages

PSO Applications

chapter Appendix A|12 pages

Primer on Probability Theory

chapter Appendix B|6 pages


chapter Appendix C|12 pages

Analytical Minimization