【正文】
Inc. Permission required for reproduction or display. Definitions ? Parallel puting ? Using parallel puter to solve single problems faster ? Parallel puter ? Multipleprocessor system supporting parallel programming ? Parallel programming ? Programming in a language that supports concurrency explicitly Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. Parallel Programming in C with MPI and OpenMP Michael J. Quinn Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. Chapter 1 Motivation and History Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. Why MPI? ? MPI = “Message Passing Interface” ? Standard specification for messagepassing libraries ? Libraries available on virtually all parallel puters ? Free libraries also available for works of workstations or modity clusters Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. Evolution of Superputing ? World War II ? Handputed artillery tables ? Need to speed putations ? ENIAC ? Cold War ? Nuclear weapon design ? Intelligence gathering ? Codebreaking Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. CPUs 1 Million Times Faster ? Faster clock speeds ? Greater system concurrency ?Multiple functional units ?Concurrent instruction execution ?Speculative instruction execution Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. Copycat Strategy ? Microprocessor ?1% speed of superputer ?% cost of superputer ? Parallel puter = 1000 microprocessors ?10 x speed of superputer ?Same cost as superputer Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. Beowulf Concept ? NASA (Sterling and Becker) ? Commodity processors ? Commodity interconnect ? Linux operating system ? Message Passing Interface (MPI) library ? High performance/$ for certain applications Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. Data Dependence Graph ? Directed graph ? Vertices = tasks ? Edges = dependences Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. Partial Sums Pipeline a [ 0 ]= + + +a [ 1 ] a [ 2 ] a [ 3 ]p [ 0 ] p [ 1 ] p [ 2 ]p [ 0 ] p [ 1 ] p [ 2 ] p [ 3 ]Copyright 169。 The McGrawHill Companies, Inc. Permission required for reproduction or display. Clustering Algorithm ? Compute document vectors ? Choose initial cluster centers ? Repeat ? Compute performance fu