| Week |
Topic |
| Feb. 18 |
Introduction |
|
|
|
|
| Feb. 20 |
Metrics for Evaluating Performance |
|
|
|
|
| Feb. 25 |
Parallel Computing 1/2 |
|
|
|
|
| Feb. 27 |
Coherence Refresher |
|
|
|
|
| Mar. 04 |
Software Optimizations 1/2 |
|
|
|
|
| Mar. 06 |
Software Optimizations 3 |
|
|
|
|
| Mar. 11 |
MPI 1/2 |
|
|
|
|
| Mar. 13 |
Memory Consistency 1 |
|
|
|
|
| Mar. 18 |
Memory Consistency 2/3 |
|
|
|
|
| Mar. 20 |
Language Level Consistency 1 |
|
|
|
|
| Mar. 25 |
Language Level Consistency 2/3 |
|
|
|
|
| Mar. 27 |
Synchronization 1 |
|
|
|
|
| Apr. 01 |
Synchronization 2/3 |
|
|
|
|
| Apr. 03 |
Transactional Memory |
|
|
|
|
| Apr. 08 |
Midterm Exam |
|
|
|
|
| Apr. 10 |
Continuation 1 |
|
|
|
|
| Apr. 15 |
Continuation 2, RPC 1 |
|
|
|
|
| Apr. 17 |
RPC 2 |
|
|
|
|
| Apr. 29 |
Context Switching Specifics, Hardware Multithreading 1 |
|
|
|
|
| May. 01 |
Hardware Multithreading 2 |
|
|
|
|
| May. 06 |
Intro to GPUs, Intro to CUDA Programming |
|
|
|
|
| May. 08 |
Register Space, Scratchpad, Constant memory, Global memory |
|
|
|
|
| May. 13 |
Control Flow Divergence, ITS, GPU Scheduler, Avoid Bank Conflict, Improve Coalescing/Limit Mem Divergence |
|
|
|
|
| May. 15 |
Synchornizaiton in CUDA, Scopes, Data Races |
|
|
|
|
| May. 20 |
Programming Tensor Cores, Mixed Precision, Multitenacy |
|
|
|
|
| May. 22 |
Memory oversubscription |
|
|
|
|
| May. 27 |
Scaling Trends/GPU |
|
|
|
|
| May. 29 |
Sustainability |
|
|
|
|
| May. 30 |
Final Exam |
|
|
|
|
