Parallel Computing Architecture Basics
The chapter commences by describing high-performance distributed computing. The chapter then describes benchmarks for performance evaluation. Benchmarks are a measure of efficient execution by the computer architecture of those features of a programming language that are most frequently used in actual programs. Benchmarks are considered to be representative of classes of applications envisioned for the architecture. Benchmarks are useful in evaluating hardware as well as software and single processor as well as multiprocessor systems. The chapter then looked at the degree of parallelism of an application which is simply the index of the number of computations that can be executed concurrently. Modeling and measurement of application characteristics can be used to optimize the design of a cluster, for example in terms of relative resources dedicated to computation, memory and interconnect. There are generally three main categories of parallel architectures: shared-memory parallel architecture, distributed memory parallel architecture and parallel accelerator architecture.