Calendar · Lecture Notes
MIT OpenCourseWare
Theory of Parallel Systems (SMA 5509)
Art: Palmer, Edward, 1803-1872, Figures 113-123. Plate Electrical Machines, 1840 · Public domain
- Instructors
- Dr. Bradley Kuszmaul, Prof. Charles Leiserson, Prof. Hsu Wen Jing, Prof. Michael Bender
- Term
- Fall 2003
- Level
- Graduate
- What's inside
- 1 lecture note · 1 reading · 92 other files · 4 web pages
- Materials open
- MIT OCW
About this course
Source: MIT OpenCourseWare 6.895 Theory of Parallel Systems (SMA 5509), Fall 2003, Dr. Bradley Kuszmaul, Prof. Charles Leiserson, Prof. Hsu Wen Jing, Prof. Michael Bender — original course page on ocw.mit.edu ↗. License: CC BY-NC-SA 4.0. Study order: MIT's own listing order, section by section. Taken from MIT's published course files, downloaded from ocw.mit.edu on September 23, 2026. How RedLectern is built.
Materials are grouped the way MIT organized them. A verified, course-wide order has not been established here.
Has MIT solutions
Before you start
Prerequisites are not listed here. Check MIT's own syllabus for this course.
How this course was organized
What's here, and what isn't
- A lecture sequence of 26 items is confirmed. It stays as organized materials rather than a full course order.
Not included here
2 items from the source could not be safely included:
- MIT's page format for this item wasn't recognized clearly enough to place it safely. (2 items)
Materials by section
Grouped by section, as MIT organized them. Not sequenced or ordered.
Readings
10 files
- Cilk Manual 5.3.2 Download
- Minicourse on Multithreaded Programming (Courtesy of Harald Prokop. Used with permission.) Download
- Sorting Code Handout Download
- C Code for Sorting Download
- ASM Code for Sorting (Excerpt) Download
- Cache-Oblivious Algorithms Prokop’s Masters Thesis Download
- FOCS Paper Download
- Lecture 4 · Determinacy Detection and Race Detection · Readings (Courtesy of Martin Farach-Colton and Michael Bender. Used with permission.) Download
- herlihy_mo93.pdf Download
- Huang, Kai. Data-Race Detection In Transaction Everywhere Parallel Programming. Download
Lecture Notes
18 files
- Dynamic Multithreading (Courtesy of Ben Adida and Abhi Shelat. Used with permission.) Download
- Cilk, Matrix Multiplication, and Sorting Download
- Serial Performance and Caching (Courtesy of Kenneth Barr and Zardosht Kasheff. Used with permission.) Download
- Determinacy Detection and Race Detection (Courtesy of Siddhartha Sen and Jim Sukha. Used with permission.) Download
- Analyzing Space Bounds (Courtesy of Jeremy Fineman and Siddhartha Sen. Used with permission.) Download
- Memory Contention (Courtesy of Barbara Mack and C. Scott Ananian. Used with permission.) Download
- Cilk Scheduler (Courtesy of Barbara Mack and Kevin Matulef. Used with permission.) Download
- Analysis of Cilk Scheduler (Courtesy of Alexandru Caracas and C. Scott Ananian. Used with permission.) Download
- Cilk Implementation Download
- Implementation of Memory Consistency (Courtesy of Seth Gilbert and Xie Yong. Used with permission.) Download
- Snoopy Caching and Spin-Block Problem Handwritten Notes Download
- Hypercubic Networks 1 Lecture Slides Download
- Handwritten Notes Download
- Hypercubic Networks 2 Download
- Hypercubic Networks 3 (Courtesy of Sriram Saroop and Wang Junqing. Used with permission.) Download
- Lecture Slides Download
- Permuting Data on Parallel Disks Handwritten Notes Download
- Sorting and Permuting Handwritten Notes Download
Assignments
Projects
37 files
- Kunal Agrawal and Siddhartha Sen, “Adaptively Parallel Processor Allocation for Cilk Jobs” · Proposals Download
- Kunal Agrawal and Siddhartha Sen, “Adaptively Parallel Processor Allocation for Cilk Jobs” · Final presentations Download
- Kunal Agrawal and Siddhartha Sen, “Adaptively Parallel Processor Allocation for Cilk Jobs” · Final papers Download
- Alexandru Caracas, “Fast Serial-Append File I/O Mode Support for Cilk” · Proposals (Courtesy of Alexandru Caracas. Used with permission.) Download
- Alexandru Caracas, “Fast Serial-Append File I/O Mode Support for Cilk” · Final presentations (Courtesy of Alexandru Caracas. Used with permission.) Download
- Alexandru Caracas, “Fast Serial-Append File I/O Mode Support for Cilk” · Final papers (Courtesy of Alexandru Caracas. Used with permission.) Download
- Jason Hickey and Tyeler Quentmeyer, “A Space-Efficient Global Scheduler for Cilk” · Proposals Download
- Jason Hickey and Tyeler Quentmeyer, “A Space-Efficient Global Scheduler for Cilk” · Final presentations Download
- Jason Hickey and Tyeler Quentmeyer, “A Space-Efficient Global Scheduler for Cilk” · Final papers Download
- Sajindra Jayasena and Sharad Ganesh, “Automatic Conversion of Non Series-Parallel DAGs to… · Proposals (Courtesy of Sharad Ganesh and Sajindra Jayasena. Used with permission.) Download
- Sajindra Jayasena and Sharad Ganesh, “Automatic Conversion of Non Series-Parallel DAGs to… · Final papers (Courtesy of Sharad Ganesh and Sajindra Jayasena. Used with permission.) Download
- C. Scott Ananian, “Language-Level Complex Transactions” · Proposals (Courtesy of C. Scott Ananian. Used with permission.) Download
- C. Scott Ananian, “Language-Level Complex Transactions” · Final presentations (Courtesy of C. Scott Ananian. Used with permission.) Download
- Sean Lie, “An Evaluation of Nested Concurrent Transactions” · Proposals (Courtesy of Sean Lie. Used with permission.) Download
- Sean Lie, “An Evaluation of Nested Concurrent Transactions” · Final presentations (Courtesy of Sean Lie. Used with permission.) Download
- Sean Lie, “An Evaluation of Nested Concurrent Transactions” · Final papers (Courtesy of Sean Lie. Used with permission.) Download
- Jim Sukha, “Atomic Transactions in Cilk” · Proposals (Courtesy of Jim Sukha. Used with permission.) Download
- Jim Sukha, “Atomic Transactions in Cilk” · Final presentations Download
- Jim Sukha, “Atomic Transactions in Cilk” · Final papers (Courtesy of Jim Sukha. Used with permission.) Download
- Xie Yong, “Transactions in Cilk” · Proposals (Courtesy of Xie Yong. Used with permission.) Download
- Xie Yong, “Transactions in Cilk” · Final presentations (Courtesy of Xie Yong. Used with permission.) Download
- Xie Yong, “Transactions in Cilk” · Final papers (Courtesy of Xie Yong. Used with permission.) Download
- Jeremy Fineman, “Linear Time Detection of Determinacy Races” · Proposals (Courtesy of Jeremy Fineman. Used with permission.) Download
- Jeremy Fineman, “Linear Time Detection of Determinacy Races” · Final presentations (Courtesy of Jeremy Fineman. Used with permission.) Download
- Jeremy Fineman, “Linear Time Detection of Determinacy Races” · Final papers (Courtesy of Jeremy Fineman. Used with permission.) Download
- Wang Junqing, “Parallel Nondeterminator” · Proposals (Courtesy of Wang Junqing. Used with permission.) Download
- Wang Junqing, “Parallel Nondeterminator” · Final papers Download
- Zardosht Kesheff, “Parallelizing METIS” · Proposals (Courtesy of Zardosht Kasheff. Used with permission.) Download
- Zardosht Kesheff, “Parallelizing METIS” · Final presentations (Courtesy of Zardosht Kasheff. Used with permission.) Download
- Zardosht Kesheff, “Parallelizing METIS” · Final papers (Courtesy of Zardosht Kasheff. Used with permission.) Download
- Advait D.Karande and Sriram Saroop, “Cache-Oblivious Sorting for Burrows-Wheeler… · Proposals (Courtesy of Advait Karande and Sriram Saroop. Used with permission.) Download
- Advait D.Karande and Sriram Saroop, “Cache-Oblivious Sorting for Burrows-Wheeler… · Final presentations (Courtesy of Advait Karande and Sriram Saroop. Used with permission.) Download
- Advait D.Karande and Sriram Saroop, “Cache-Oblivious Sorting for Burrows-Wheeler… · Final papers (Courtesy of Advait Karande and Sriram Saroop. Used with permission.) Download
- Zhang Jiahui and Neel Kamal, “New Cache-Oblivious Algorithms” · Proposals (Courtesy of Zhang Jiahu. Used with permission.) Download
- Seth Gilbert, “Cache-Oblivious, Lock-Free Algorithms” · Proposals (Courtesy of Seth Gilbert. Used with permission.) Download
- Seth Gilbert, “Cache-Oblivious, Lock-Free Algorithms” · Final presentations (Courtesy of Jeremy Fineman and Seth Gilbert. Used with permission.) Download
- Seth Gilbert, “Cache-Oblivious, Lock-Free Algorithms” · Final papers (Courtesy of Seth Gilbert. Used with permission.) Download
Other materials from this course
23 files
- feng97efficient.pdf Download
- lab1.pdf Download
- Outline of Lecture 5. Lecturer: Bradley C. Kuszmaul. Scribe: Alexandru Caracas and Rui Fan (lecture5.pdf) Download
- lecture14_notes.pdf Download
- Outline of Lecture 15. Lecturer: Bradley C. Kuszmaul and Michael Bender (lecture15.pdf) Download
- lecture19_notes.pdf Download
- lecture22_notes.pdf Download
- ps1_soln.pdf Download
- Research paper authored by Voon-Yee Vee and Wen-Jing Hsu, Centre for Advanced Information Systems… (vee99scalable.pdf) Download
- .Makefile Download
- Student project proposal (prpsal_heyuxiong.pdf) Download
- Student project (neel_zhang.pdf) Download
- Slides for student project presentation (fp_zhang_neel.pdf) Download
- strassen.cilk Download
- mm_simple.c Download
- Student project proposal (youn_project.pdf) Download
- dot.login Download
- Student project (youn.pdf) Download
- mmtest.c Download
- Slides for student project presentation (fp_he_wang.pdf) Download
- mm_simple.h Download
- Student project proposal (proposal_pham.pdf) Download
- Slides for student project presentation (fp_youn.pdf) Download
Course outline
Calendar · Lecture Notes
Lecture 2: Cilk, Matrix Multiplication, and Sorting
Calendar · Lecture Notes
Lecture 3: Serial Performance and Caching
Calendar · Lecture Notes
Lecture 4: Determinacy Detection and Race Detection
Calendar · Lecture Notes
Lecture 5: Consistency of the Memory Sub-System
Calendar · Lecture Notes
Lecture 6: Analyzing Space Bounds
Calendar · Lecture Notes
Lecture 7: Memory Contention
Calendar · Lecture Notes
Lecture 8: Cilk Scheduler
Calendar · Lecture Notes
Lecture 9: Analysis of Cilk Scheduler
Calendar · Lecture Notes
Lecture 10: Cilk Implementation
Calendar · Lecture Notes
Lecture 11: Project Presentations 1
Calendar · Lecture Notes
Lecture 12: Project Presentations 2
Calendar · Lecture Notes
Lecture 13: Implementation of Memory Consistency
Calendar · Lecture Notes
Lecture 14: Competitive Snoopy Caching
Calendar · Lecture Notes
Lecture 15: Snoopy Caching and Spin-Block Problem
Calendar · Lecture Notes
Lecture 16: Hypercubic Networks 1
Calendar · Lecture Notes
Lecture 17: Hypercubic Networks 2
Calendar · Lecture Notes
Lecture 18: Hypercubic Networks 3
Calendar · Lecture Notes
Lecture 19: Squish Routing
Calendar · Lecture Notes
Lecture 20: Permuting Data on Parallel Disks
Calendar · Lecture Notes
Lecture 21: Sorting and Permuting
Calendar · Lecture Notes
Lecture 22: Pick a Winner
Calendar · Lecture Notes
Lecture 23: Final Project Presentations
Calendar · Lecture Notes
Lecture 24: Final Project Presentations (cont.)
Calendar · Lecture Notes
Lecture 25: Final Project Presentations (cont.)
Calendar · Lecture Notes
Lecture 26: Final Project Presentations (cont.) Final Papers Due
MIT OpenCourseWare, Dr. Bradley Kuszmaul, Prof. Charles Leiserson, Prof. Hsu Wen Jing, Prof. Michael Bender, 6.895 Theory of Parallel Systems (SMA 5509), Fall 2003.
License: CC BY-NC-SA 4.0 · Edition: Fall 2003 · Open the original course on OCW ↗
Organized by RedLectern, independent of MIT and not endorsed by MIT.
Per-resource rights are recorded on each resource; All-Rights-Reserved items are link-only, never mirrored.
