Parallel and distributed systems (PADS) have evolved from the early days of computational science and supercomputers to a wide range of novel computing paradigms, each of which is exploited to tackle specific problems or application needs, including distributed systems, parallel computing, and cluster computing, generally called high-performance computing (HPC). Grid, Cloud, and Fog computing patterns are the most important of these PADS paradigms, which share common concepts in practice.

Many-core architectures, multi-core cluster-based supercomputers, and Cloud Computing paradigms in this era of exascale computers have tremendously influenced the way computing is applied in science and academia (e.g., scientific computing and large-scale simulations). Implementing Parallel and Distributed Systems presents a PADS infrastructure known as Parvicursor that can facilitate the construction of such scalable and high-performance parallel distributed systems as HPC, Grid, and Cloud Computing.

This book covers parallel programming models, techniques, tools, development frameworks, and advanced concepts of parallel computer systems used in the construction of distributed and HPC systems. It specifies a roadmap for developing high-performance client-server applications for distributed environments and supplies step-by-step procedures for constructing a native and object-oriented C++ platform.


  • Hardware and software perspectives on parallelism
  • Parallel programming many-core processors, computer networks and storage systems
  • Parvicursor.NET Framework: a partial, native, and cross-platform C++ implementation of the .NET Framework
  • xThread: a distributed thread programming model by combining thread-level parallelism and distributed memory programming models
  • xDFS: a native cross-platform framework for efficient file transfer
  • Parallel programming for HPC systems and supercomputers using message passing interface (MPI)

Focusing on data transmission speed that exploits the computing power of multicore processors and cutting-edge system-on-chip (SoC) architectures, it explains how to implement an energy-efficient infrastructure and examines distributing threads amongst Cloud nodes. Taking a solid approach to design and implementation, this book is a complete reference for designing, implementing, and deploying these very complicated systems.

chapter Chapter 1|13 pages


chapter Chapter 2|8 pages

IoT and Distributed Systems

chapter Chapter 4|45 pages

Parallelism for the Many-Core Era

Hardware and Software Perspectives

chapter Chapter 5|63 pages

Parallelisation for the Many-Core Era

A Programming Perspective

chapter Chapter 6|22 pages

Storage Systems

A Parallel Programming Perspective

chapter Chapter 7|58 pages

Computer Networks

A Parallel Programming Approach

chapter Chapter 8|42 pages

Parvicursor.NET Framework

A Partial, Native, and Cross-Platform C++ Implementation of the .NET Framework

chapter Chapter 10|54 pages


A Native Cross-Platform Framework for Efficient File Transfers in Dynamic Cloud/Internet Environments