CSE 375   Parallel Architectures and Programming (3) 

Instructor: 

Current Catalog Description
Introduction to parallel computing, covering both hardware and software topics such as interconnection networks, SIMD, MIMD, and hybrid parallel architectures, parallel languages, parallelizing compiler techniques and operating systems for parallel computers. Prerequisites: ECE 201 and CSE 303 previously or concurrently, or consent of the instructor.

Textbooks:
(1) Parallel Algorithms and Matrix Computation by Jagdish J. Modi; (2) The Design and Analysis of Parallel Algorithms by Selim G. Akl; (3) Highly Parallel Computing by George S. Almasi and Allan Gottlieb; (4) Parallel Processing From Applications to Systems by Dan I. Moldovan; (5) Introduction to Parallel Algorithms and Architectures: Arrays, Trees, Hypercubes by F. Thomson Leighton; (6) Parallel Programming by Barry Wilkinson and Michael Allen; (7) High Performance Cluster Computing by Rajkumar Buyya (plus other resources such as scholarly journal articles).

References

Course Goals
To introduce students to parallel architectures and parallel computing; to investigate the approaches used to exploit parallelism in specific applications such as sorting, searching, and matrix multiplication; to understand the purposes and application of parallelizing compilers.

Prerequisites by Topic
Binary Number System; 2's complement representation/arithmetic; Boolean Algebra; Combinational Circuits; Introduction to Sequential Circuits; Timing Diagrams; Knowledge of an assembly language.

Major Topics Covered in the Course
Introduction to parallel processing (3 classes); Interconnection networks (6 classes); Parallel architectures (8 classes); Constructs for parallel execution (6 classes); Parallelizing sequential code (6 classes); Operating systems for parallel computers (4 classes).

Laboratory projects (specify number of weeks on each): One major, semester-long project.

Estimate CSAB Category Content
                                                                        CORE      ADVANCED
Data Structures                                                                          0.5  
Computer Organization and Architecture                                      0.5
Algorithms Software Design                                                        1.0  
Concepts of Programming Languages                                          1.0
 
Oral and Written Communications: Every student is required to submit at least  __1___  written reports (not including exams, tests, quizzes, or commented programs) of typically  __20__  pages and to make __3__  oral presentations of typically  __20___  minutes duration. Include only material that is graded for grammar, spelling, style, and so forth, as well as for technical content, completeness, and accuracy.

Social and Ethical Issues:

Theoretical Content

Problem Analysis and Solution Design
In the class project, students are required to design and implement a parallel program solving a non-trivial computational problem.