Calendar · Lecture Notes
MIT OpenCourseWare
Introduction to Neural Networks
Art: User:Looie496 created file, Santiago Ramon y…, Cajal cortex drawings, 2009 · Public domain
- Instructor
- Prof. Sebastian Seung
- Term
- Spring 2005
- Level
- Graduate
- What's inside
- 1 lecture note · 1 reading · 30 other files · 4 web pages
- Materials open
- MIT OCW
About this course
Source: MIT OpenCourseWare 9.641J Introduction to Neural Networks, Spring 2005, Prof. Sebastian Seung — original course page on ocw.mit.edu ↗. License: CC BY-NC-SA 4.0. Study order: MIT's own listing order, section by section. Taken from MIT's published course files, downloaded from ocw.mit.edu on September 23, 2026. How RedLectern is built.
Materials are grouped the way MIT organized them. A verified, course-wide order has not been established here.
Before you start
Prerequisites are not listed here. Check MIT's own syllabus for this course.
How this course was organized
What's here, and what isn't
- A lecture sequence of 25 items is confirmed. Assignment and exam materials exist too, but MIT's own order for them could not be verified, so they're shown as materials below rather than a sequence.
Not included here
6 items from the source could not be safely included:
- MIT's page format for this item wasn't recognized clearly enough to place it safely. (5 items)
- Referenced in a table, but without MIT's own verified order, so it isn't used to claim a sequence.
Materials by section
Grouped by section, as MIT organized them. Not sequenced or ordered.
Lecture Notes
13 files
- From Spikes to Rates Download
- Lateral Inhibition and Feature Selectivity (PDF 1) Download
- Lateral Inhibition and Feature Selectivity (PDF 2) Download
- Lateral Inhibition and Feature Selectivity (PDF 3) Download
- Hamiltonian Dynamics Download
- Antisymmetric Networks Download
- Excitatory-Inhibitory Networks Learning Download
- This resource includes information on hypothesis: Hebbiansynaptic plasticity enables a perceptronto… (lec18_vq.pdf) Download
- PCA Download
- More PCA Delta Rule Download
- Conditioning Download
- Backpropagation Download
- More Backpropagation Download
Assignments
16 problem sets
- Problem Set 1: Integrate-and-Fire Neurons Download
- Problem Set 2: Perceptrons and Linear Networks Download
- Problem Set 3: Nonlinear Networks Download
- Problem Set 4: Lyapunov Functions Download
- Problem Set 5: Nonlinear Network Theory Again Download
- Problem Set 6: Deconvolution and Antisymmetric Networks Download
- This resource includes special .mat files to suppliment the contents in problem set 6 (telescope.mat) Download
- Problem Set 7: Models of Associative Memory Download
- Problem Set 8: PCA, k-means, and Ring Network Download
- This resource includes special .mat files to suppliment the contents in problem set 8 (faces.mat) Download
- This resource includes special .mat files to suppliment the contents in problem set 8 (kmeans.mat) Download
- Problem Set 9: Delta Rule and Gradient Descent Download
- This resource includes special .mat files to suppliment the contents in problem set 9 (ps9faces.mat) Download
- This resource includes special .m files to suppliment the contents in problem set 9 (perceptron_delta.m) Download
- This resource includes special .mat files to suppliment the contents in problem set 9 (mnistabridged.mat) Download
- Problem Set 10: Backpropagation, and Trajectory Learning Download
Other materials from this course
Course outline
Calendar · Lecture Notes
Lecture 2: Perceptrons: Simple and Multilayer
Calendar · Lecture Notes
Lecture 3: Perceptrons as Models of Vision
Calendar · Lecture Notes
Lecture 4: Linear Networks
Calendar · Lecture Notes
Lecture 5: Retina
Calendar · Lecture Notes
Lecture 6: Lateral Inhibition and Feature Selectivity
Calendar · Lecture Notes
Lecture 7: Objectives and Optimization
Calendar · Lecture Notes
Lecture 8: Hybrid Analog-Digital Computation Ring Network
Calendar · Lecture Notes
Lecture 9: Constraint Satisfaction Stereopsis
Calendar · Lecture Notes
Lecture 10: Bidirectional Perception
Calendar · Lecture Notes
Lecture 11: Signal Reconstruction
Calendar · Lecture Notes
Lecture 12: Hamiltonian Dynamics
Calendar · Lecture Notes
Lecture 13: Antisymmetric Networks
Calendar · Lecture Notes
Lecture 14: Excitatory-Inhibitory Networks Learning
Calendar · Lecture Notes
Lecture 15: Associative Memory
Calendar · Lecture Notes
Lecture 16: Models of Delay Activity Integrators
Calendar · Lecture Notes
Lecture 17: Multistability Clustering
Calendar · Lecture Notes
Lecture 18: VQ PCA
Calendar · Lecture Notes
Lecture 19: More PCA Delta Rule
Calendar · Lecture Notes
Lecture 20: Conditioning Backpropagation
Calendar · Lecture Notes
Lecture 21: More Backpropagation
Calendar · Lecture Notes
Lecture 22: Stochastic Gradient Descent
Calendar · Lecture Notes
Lecture 23: Reinforcement Learning
Calendar · Lecture Notes
Lecture 24: More Reinforcement Learning
Calendar · Lecture Notes
Lecture 25: Final Review
MIT OpenCourseWare, Prof. Sebastian Seung, 9.641J Introduction to Neural Networks, Spring 2005.
License: CC BY-NC-SA 4.0 · Edition: Spring 2005 · Open the original course on OCW ↗
Organized by RedLectern, independent of MIT and not endorsed by MIT.
Per-resource rights are recorded on each resource; All-Rights-Reserved items are link-only, never mirrored.
