HPC, Big Data, AI Convergence Towards Exascale provides an updated vision on the most advanced computing, storage, and interconnection technologies, that are at basis of convergence among the HPC, Cloud, Big Data, and artificial intelligence (AI) domains. Through the presentation of the solutions devised within recently founded H2020 European projects, this book provides an insight on challenges faced by integrating such technologies and in achieving performance and energy efficiency targets towards the exascale level. Emphasis is given to innovative ways of provisioning and managing resources, as well as monitoring their usage. Industrial and scientific use cases give to the reader practical examples of the needs for a cross-domain convergence.


All the chapters in this book pave the road to new generation of technologies, support their development and, in addition, verify them on real-world problems. The readers will find this book useful because it provides an overview of currently available technologies that fit with the concept of unified Cloud-HPC-Big Data-AI applications and presents examples of their actual use in scientific and industrial applications.

chapter 1|16 pages

Toward the Convergence of High-Performance Computing, Cloud, and Big Data Domains

ByMartin Golasowski, Jan Martinovič, Marc Levrier, Stephan Hachinger, Sophia Karagiorgou, Aikaterini Papapostolou, Spiros Mouzakitis, Ioannis Tsapelas, Monica Caballero, Marco Aldinucci, Jon Ander Gómez, Antony Chazapis, Jean-Thomas Acquaviva

chapter 2|19 pages

The LEXIS Platform for Distributed Workflow Execution and Data Management

ByMartin Golasowski, Jan Martinovič, Jan Křenek, Kateřina Slaninová, Marc Levrier, Piyush Harsh, Marc Derquennes, Frédéric Donnat, Olivier Terzo
Size: 4.01 MB

chapter 3|22 pages

Enabling the HPC and Artificial Intelligence Cross-Stack Convergence at the Exascale Level

ByAlberto Scionti, Paolo Viviani, Giacomo Vitali, Chiara Vercellino, Olivier Terzo

chapter 4|22 pages

Data System and Data Management in a Federation of HPC/Cloud Centers

ByJohannes Munke, Mohamad Hayek, Martin Golasowski, Rubén J. García-Hernández, Frédéric Donnat, Cédric Koch-Hofer, Philippe Couvee, Stephan Hachinger, Jan Martinovič
Size: 0.95 MB

chapter 5|23 pages

Distributed HPC Resources Orchestration for Supporting Large-Scale Workflow Execution

ByAlberto Scionti, Paolo Viviani, Giacomo Vitali, Chiara Vercellino, Olivier Terzo, Stephan Hachinger, Lukáš Vojacek, Václav Svatoň, Jan Křenek, Frédéric Donnat, François Exertier

chapter 6|25 pages

Advanced Engineering Platform Supporting CFD Simulations of Aeronautical Engine Critical Parts

ByDonato Magarielli, Ennio Spano, Tommaso Fondelli, Daniele Pampaloni, Antonio Andreini, Paolo Savio, Michele Marconcini, Francesco Poli

chapter 7|15 pages

Event-Driven, Time-Constrained Workflows

An Earthquake and Tsunami Pilot
ByRubén J. García-Hernández, Thierry Goubier, Danijel Schorlemmer, Natalja Rakowsky, Sven Harig, Andrea Ajmar, Lorenza Bovio, Stephane Louise, Tomáš Martinovič

chapter 8|18 pages

Exploitation of Multiple Model Layers within LEXIS Weather and Climate Pilot

An HPC-Based Approach
ByPaola Mazzoglio, Emanuele Danovaro, Laurent Ganne, Andrea Parodi, Stephan Hachinger, Antonella Galizia, Antonio Parodi, Jan Martinovič

chapter 9|26 pages

Data Convergence for High-Performance Cloud

ByChristian Pinto, Antony Chazapis, Christos Kozanitis, Yiannis Gkoufas, Panos Koutsovasilis, Srikumar Venugopal, Jean-Thomas Acquaviva, Angelos Bilas

chapter 10|26 pages

The DeepHealth HPC Infrastructure

Leveraging Heterogenous HPC and Cloud-Computing Infrastructures for IA-Based Medical Solutions
ByEduardo Quiñones, Jesus Perales, Jorge Ejarque, Asaf Badouh, Santiago Marco, Fabrice Auzanneau, François Galea, David González, José Ramón Hervás, Tatiana Silva, Iacopo Colonnelli, Barbara Cantalupo, Marco Aldinucci, Enzo Tartaglione, Rafael Tornero, José Flich, Jose Maria Martínez, David Rodriguez, Izan Catalán, Jorge Ejarque, Carles Hernández

chapter 11|23 pages

Applications of AI and HPC in the Health Domain

ByDana Oniga, Barbara Cantalupo, Enzo Tartaglione, Daniele Perlo, Marco Grangetto, Marco Aldinucci, Federico Bolelli, Federico Pollastri, Michele Cancilla, Laura Canalini, Costantino Grana, Cristina Muñoz Alcalde, Franco Alberto Cardillo, Monica Florea

chapter 12|15 pages


On the Convergence of HPC, Big Data Services, and AI Technologies
BySophia Karagiorgou, Aikaterini Papapostolou, Zeginis Dimitris, Yannis Georgiou, Eugene Frimpong, Ioannis Tsapelas, Spiros Mouzakitis, Konstantinos Tarabanis

chapter 13|18 pages


A Hybrid Architecture of HPC and Big Data for AI Applications in Agriculture
ByNaweiluo Zhou, Li Zhong, Dennis Hoppe, Branislav Pejak, Oskar Marko, Javier Cardona, Mikolaj Czerkawski, Ivan Andonovic, Craig Michie, Christos Tachtatzis, Emmanouil Alexakis, Philip Mavrepis, Dimosthenis Kyriazis, Marcin Pospieszny

chapter 14|18 pages

European Processor Initiative

Europe's Approach to Exascale Computing
ByMario Kovač, Jean-Marc Denis, Philippe Notton, Etienne Walter, Denis Dutoit, Frank Badstuebner, Stephan Stilkerich, Christian Feldmann, Benoît Dinechin, Renaud Stevens, Fabrizio Magugliani, Ricardo Chaves, Josip Knezović, Daniel Hofman, Mario Brčić, Katarina Vukušić, Agneza Krajna, Leon Dragić, Igor Piljić, Mate Kovač, Branimir Malnar, Alen Duspara