This course covers parallel computing architectures and interconnection networks, issues such as speedup, efficiency cost, granularity and scalability, and topics in parallel algorithms for many important problems such as sparse and and dense matrix operations (e.g., transposition, matrix-vector multiplication, matrix-matrix multiplication, solution of linear system of equations), graph problems and other computationally intensive problems in numerical applications.