ABSTRACT

Unmatched: 50 Years of Supercomputing: A Personal Journey Accompanying the Evolution of a Powerful Tool

The rapid and extraordinary progress of supercomputing over the past half-century is a powerful demonstration of our relentless drive to understand and shape the world around us. In this book, David Barkai offers a unique and compelling account of this remarkable technological journey, drawing from his own rich experiences working at the forefront of high-performance computing (HPC).

This book is a journey delineated as five decade-long ‘epochs’ defined by the systems’ architectural themes: vector processors, multi-processors, microprocessors, clusters, and accelerators and cloud computing. The final part examines key issues of HPC and discusses where it might be headed.

A central goal of this book is to show how computing power has been applied, and, more importantly, how it has impacted and benefitted society. To this end, the use of HPC is illustrated in a range of industries and applications, from weather and climate modeling to engineering and life sciences. As such, this book appeals to both students and general readers with an interest in HPC, as well as industry professionals looking to revolutionize their practice.

From the Foreword:

 

David Barkai's career has spanned five decades, during which he has had the rare opportunity to be part of some of the most significant developments in the field of supercomputing. His personal and professional insights, combined with his deep knowledge and passion for the subject matter, make this book an invaluable resource for anyone interested in the evolution of HPC and its impact on our lives.”

 

-Horst Simon, Director, Abu Dhabi Investment Authority (ADIA) Lab

chapter |16 pages

Short Introduction to Scientific Computing

The Third Pillar of Science and How It Works

part I|41 pages

The Epoch of Big Iron

chapter 18Chapter 1|5 pages

In the Old Days…

This was supercomputing 50 years ago

chapter Chapter 2|8 pages

Vector Processors

The early workhorses of HPC and going beyond mainframes

chapter Chapter 3|7 pages

Vectorizing Applications

Realizing Potential Performance is Challenging

chapter Chapter 4|11 pages

Numerical Weather Prediction

The Basics of Weather Forecasting and Climate Modeling

chapter Chapter 5|8 pages

Vector Processors for Weather

The Battle Between the Vendors

part II|43 pages

The Epoch of Multiprocessors

chapter Chapter 6|7 pages

Macro Parallelism

Multi-Vector Processors

chapter Chapter 7|8 pages

Making Use of Multi-Processors

Examples of Applications on MP Systems

chapter Chapter 8|11 pages

Attached Processors, Microprocessors, and Mini-Supers

Precursors to GPUs and Challenging Large Vector Processors' Hegemony

chapter Chapter 9|5 pages

Studying the Standard Model

QCD on supercomputers

chapter Chapter 10|3 pages

HPC for the Automotive Design: Early Days

How HPC Saves Time and Resources

chapter Chapter 11|8 pages

End of an Era

The last gasps of proprietary vector CPUs

part III|33 pages

The Epoch of Microprocessors

chapter 102Chapter 12|5 pages

Toward Massive Parallelism

Microprocessors Establish Presence in Top HPC Systems

chapter Chapter 13|3 pages

Engineering with HPC

How Engineering Apps Responded to Changing Architectures

chapter Chapter 14|10 pages

HPC for the Aero Industry

How HPC Saves Time and Resources

chapter Chapter 15|5 pages

The WRF Story

Multi-use Community Model

chapter Chapter 16|8 pages

Planning Ahead

A remarkable workshop

part IV|55 pages

The Epoch of Clusters

chapter Chapter 17|8 pages

Standardization

The Demise of propriety processors and software stacks

chapter Chapter 18|11 pages

HPC at Intel

The Role of a Major Technology Provider

chapter Chapter 19|9 pages

High Productivity in HPC

Initiatives for Achieving Higher Productivity from HPC Systems

chapter Chapter 20|8 pages

Weather Models' Impact on Our Lives

Applications of WRF and Other Models

chapter Chapter 21|7 pages

Computational Life Sciences

The Depth and Breadth of HPC Applications for Life Sciences

chapter Chapter 22|11 pages

Genomics and Beyond

Computations, Data, and its Impact

part V|60 pages

The Epoch of Accelerators and Cloud

chapter 190Chapter 23|14 pages

Codesign

Multidisciplinary Teams Prepare for Exascale

chapter Chapter 24|8 pages

The Changing Face of HPC

How Data Focus and AI are Changing What We Think of as HPC

chapter Chapter 25|7 pages

HPC in the Cloud

Delivering HPC Cycles from Remote Datacenters

chapter Chapter 26|5 pages

The NCAR Models

Suite of Models for Research and Applications

chapter Chapter 27|14 pages

Modeling the Earth System

The many facets of simulations of atmosphere, oceans, land, and ice

chapter Chapter 28|5 pages

HPC, Cloud, and AI for Engineering

Engineering Adapting to Modern HPC

chapter Chapter 29|3 pages

Two Scientific Anecdotes: LIGO, Fusion

The Invisible Hand of HPC

chapter Chapter 30|2 pages

The COVID-19 Campaign

HPC and the Fight Against the Coronavirus Pandemic

part VI|72 pages

Wrap-Up and Outlook

chapter 250Chapter 31|20 pages

P is for Performance

The metrics, the debates, and its importance for HPC

chapter Chapter 32|15 pages

Fortran: The Coarrays Story

Expressing Distributed Memory Parallelism: In-language or Library; MPI wins

chapter Chapter 33|6 pages

Fortran Today

The State of the Language and Related Projects

chapter Chapter 34|17 pages

Thoughts from the Guardians of Fortran

Reflections from Those Who Do the Work

chapter Chapter 35|4 pages

Measure of HPC Impact

Quantifying the ROI on Investment in HPC

chapter Chapter 36|8 pages

Looking Forward

Technology Transformation Ahead and Ongoing Expansion of Use Models and Users