GPU Architectures, Spring 2016 (CS 780 / CS 680)

General Information


Students are expected to have a good understanding of the basic computer organization and design. Please talk to the instructor if you do not satisfy this requirement.

Course Description

This course provides an in-depth understanding of the architectural and micro-architectural details of a general purpose graphics processing unit (GPU). It also provides an in-depth coverage of important research issues associated with GPU computing by covering a range of latest papers that have appeared in leading international journals and conferences. Students are expected to read a variety of papers, critique them, and present them in the front of the class. In addition, students are expected to complete a semester-long research project and simulation-based assignments.

Grade Distribution

Submission Format

(I) Paper Critiques

All students are required to submit a detailed critique for each paper we discuss in the class. However, the student who presents the paper in-class is not allowed to submit the critique for that particular paper. Deadline for critique submission is one week from when the paper is discussed completely in the class. Please submit any FIVE critiques in the PDF format.

Submission Format: Each critique should not exceed one-page and must consists of four sections: 1) paper summary (2-3 lines), 2) strengths (2-3 lines), 3) weaknesses (2-3 lines), and 4) detailed comments (rest of the page). More details are already discussed in class and associated slides are submitted to the box folder (shared with students).

No collaboration is allowed on critiques.

(II) In-Class Presentations

Each student will present a maximum of two papers throughout the semester. If you plan to audit the course, you are required to present at least two papers. When you present a paper, be prepared to answer a variety of questions asked by the instructor or other fellow students. The goal is to make class lively. A list of papers will be provided to students. They can choose from that list or come up with their own suggestions. Suggestions would need approval from the instructor.

In-Class Paper Presentations: I expect students to first present necessary background (~15 minutes) and then paper details (~25 minutes). The remaining time will be for discussion driven by the fellow students and the instructor.

(III) Simulation-based Assignments

Assignments will be given based on the GPGPU-Sim simulator. GPGPU-Sim Installation guide (for bg machines at CS, WM) is here. No collaboration is allowed on assignments.

(IV) Semester-Long Research Project

Students are expected to perform a semester-long research project. All projects need to be approved by the instructor. Please contact the instructor early to brainstorm potential project ideas.

Project Timeline

Areas for In-class Presentations and Projects

Useful Simulators and Tools

Semester Schedule

Date Agenda Notes
Jan 21  Administrativia and Introductions HW#0 Out
Jan 26  Introduction to CUDA (1) HW#1 Out
Jan 28  Introduction to CUDA (2) HW#0 Due
Feb 2  Overview of GPU Architecture HW#1 Due
Feb 4  Overview of GPGPU-Sim HW#2 Out
Feb 9  GPU Micro-architecture/Architecture (1)
Feb 11  GPU Micro-architecture/Architecture (2)
Feb 16  GPU Memory System (1) HW#2 Due
Feb 18  GPU Memory System (2)
Feb 23  Advanced GPU Topics (1) HW#3 Out
Feb 25  Advanced GPU Topics (2)
Mar 1  Presenter: Bin Nie, GPU Reliability
Mar 3  Presenter: Lingfei Wu
Mar 8  Spring break, no classes
Mar 10  Spring break, no classes
Mar 15  Presenter: James Bieron, Paper: [P1] In-class Presentations Start, HW#3 Due
Mar 17  Presenter: Haonan Wang, Paper: [P2]
Mar 22  Presenter: Fan Luo, Paper: [P3] Critique [P1] Due, HW#4 Out
Mar 24  Presenter: Haonan Wang, Paper: [P4] Critique [P2] Due
Mar 29  Presenter: Fan Luo, Paper: [P5] Critique [P3] Due
Mar 31  Presenter: Shan Wang, Paper: [P6] Critique [P4] Due
Apr 5  Presenter: Yiqiang Lin, Paper: [P7] Critique [P5] Due, HW#4 Due
Apr 7  Presenter: Mohamed Assem Ibrahim, Paper: [P8] Critique [P6] Due
Apr 12  Presenter: James Bieron, Paper: [P9] Critique [P7] Due
Apr 14  Presenter: Mohamed Assem Ibrahim, Paper: [P10] Critique [P8] Due
Apr 19  Presenter: Yiqiang Lin, Paper: [P11] Critique [P9] Due
Apr 21  Presenter: Shan Wang, Paper: [P12] Critique [P10] Due
Apr 26  Final Project Presentations Critique [P11] Due
Apr 28  Final Project Presentations Critique [P12] Due


Academic Accommodations

It is the policy of The College of William and Mary to accommodate students with disabilities and qualifying diagnosed conditions in accordance with federal and state laws. Any student who feels s/he may need an accommodation based on the impact of a learning, psychiatric, physical, or chronic health diagnosis should contact Student Accessibility Services staff at 757-221-2509 or at to determine if accommodations are warranted and to obtain an official letter of accommodation. For more information, please click here.

Honor Code

Students are required to follow the Honor System of the College of William and Mary.