CSC4005/MDS6108 Parallel Programming 2023-24Fall

Prologue

Welcome to take course CSC4005/MDS6108: Parallel Programming offered by The Chinese University of HongKong, Shenzhen. In this semester, you will learn the basic principal and philosophy of parallel programming, including embarrassingly parallelism, reduction, synchronization, load balancing and so on. After taking this course, you should be familiar with some parallel programming languages, and be able to use them to design efficient parallel programs.

Parallel Programming Languages Used in This Course

• Vectorization/SIMD
• MPI (Message Passing Interface)
• Pthread
• OpenMP
• CUDA
• OpenACC

Grading Scheme

Projects (50%)

• Project 1: Embarrassingly Parallel Programming (Image Processing implemented with all six parallel programming languages) September 22nd, 2023 to October 10th, 2023
• Project 2: Parallel Programming with Reduction (Parallel Matrix Multiplication implemented with OpenMP) October 11th, 2023 to October 27th, 2023
• Project 3: Parallel Programming with Synchronization (Odd-Even Transposition Sort implemented with MPI) October 28th, 2023 to November 13th, 2023
• Project 4: Parallel Programming with CNN/DNN (implemented with CUDA/OpenACC) November 14th, 2023 to December 1st, 2023

Final Week(after November 28th)

Final Exam (30%)

Date: December 14th, 2023

Time: 8:30 A.M. to 10:00 A.M. (UTC +8:00)

Location: To be determined

The exam covers the all course materials through the whole semester.

Quizzes (15%)

• Notification will be announced in advance

Participation (5%)

• According to the professor himself, and everyone is suggested to attend lectures on site.

Teaching Stuff

Instructor:

• Prof.Wei-Chung HSU (徐慰中教授) [Email: hsuweichung@cuhk.edu.cn]\ Office Hour: 9:00 A.M. to 11:00 A.M., Wednesday\ Location: Daoyuan Building (道远楼) room 509a

Teaching Assistants:

• Mr. Yuxuan LIU (刘宇轩先生, L) [Email: yuxuanliu1@link.cuhk.edu.cn]\ Office Hour: 8:00 P.M. to 9:00 P.M., Thursday\ Location: Seat No.8, The Smaller Room of SDS Research Lab, 4th floor, Zhixin Building (the former library)\ (知新楼/旧图 四楼，SDS研究室8号座位)

• Mr. Weibin CHEN (陈伟彬先生) [Email: weibinchen1@link.cuhk.edu.cn]\ Office Hour: 8:30 A.M. to 9:30 A.M., Wednesday\ Location: Seat No.10, Room 324, Daoyuan Building (道远楼324房间10号桌)

• Mr. Yufan YANG (杨宇凡先生) [Email: yufanyang1@link.cuhk.edu.cn]\ Office Hour: 7:00 P.M. to 8:00 P.M., Thursday\ Location: Online Zoom Meeting (Meeting ID: 209 095 9510)\ Zoom Meeting Link: https://cuhk-edu-cn.zoom.us/j/2090959510

Undergraduate Student Teaching Fellow (USTF):

• Mr. Yebin ZHONG (钟业斌先生) [Email: yebinzhong@link.cuhk.edu.cn]\ Office Hour: 3:00 P.M. to 4:00 P.M., Tuesday\ Location: Seat No.7, The Smaller Room of SDS Research Lab, 4th floor, Zhixin Building (the former library)\ (知新楼/旧图 四楼，SDS研究室7号座位)

• Mr. Haonan XIE (薛浩楠先生) [Email: haonanxue@link.cuhk.edu.cn]\ Office Hour: 4:00 P.M. to 5:00 P.M., Thursday\ Location: Seat No.7, The Smaller Room of SDS Research Lab, 4th floor, Zhixin Building (the former library)\ (知新楼/旧图 四楼，SDS研究室7号座位)

• Miss. Na ZHANG (张娜女士) [Email: nazhang@link.cuhk.edu.cn]\ Office Hour: 4:00 P.M. to 5:00 P.M., Friday\ Location: Seat No.7, The Smaller Room of SDS Research Lab, 4th floor, Zhixin Building (the former library)\ (知新楼/旧图 四楼，SDS研究室7号座位)