| Date | Topics |
Reading
Assignments |
|---|---|---|
| Mon 3/31 |
Introduction, basic concepts. slides | Chapter
1.1,2,3,5 |
| Wed 4/2 | Linear
regression and decision theory slides |
Chapter 3.1 |
| Fri 4/4 | Linear
discriminant function slides |
Chapter 4.1 |
| Mon 4/7 | Perceptron
algorithm slides |
|
| Wed 4/9 | Logistic
regression slides |
Chapter 4.3 |
| Fri 4/11 | Generative
model (Gaussian) slides |
Chapter 4.2 |
| Mon 4/14 | Generative
model cont (naive bayes) slides |
Tom Mitchel's new book chapter on Generative vs discriminative models |
| Wed 4/16 | Decision trees
slides |
Chapter 1.6 Recommended reading: Nils Nilsson's Chapter on Decision Trees |
| Fri 4/18 | Neural
networks slides |
Chapter 5.1-5.4 |
| Mon 4/21 |
Neural networks cont | |
| Wed 4/23 | Nearest
Neighbor slides SVM slides |
nearest
neighbor: Chapter 2.5 SVM: Chapter 7.1 |
| Fri 4/25 | SVM cont slides |
|
| Mon 4/28 |
Kernels SVM
cont, Computational learning theory slides |
optional
reading: Sally Goldman's survey on COLT,
Section 1-3 |
| Wed 4/30 |
Colt cont. |
|
| Fri 5/2 |
Colt cont (complete colt slides) |
|
| Mon 5/5 |
Colt finish,
Model selection via cross-validation slides |
|
| Wed 5/7 |
Midterm review
slides |
|
| Fri 5/9 |
Midterm
Practice midterm exam (2007) Solution |
|
| Mon 5/12 |
Ensemble
methods, bagging slides |
|
| Wed 5/14 |
Boosting slides |
|
| Fri 5/16 |
Unsupervised
learning, HAC slides |
|
| Mon 5/19 |
Kmeans
clustering, GMM slides |
Chapter 9.1-3 optional reading: gap statistics by Tibshirani et al. |
| Wed 5/21 |
GMM cont slides | Optional
reading Useful alternative view of EM: optimizing lower bound of likelihood ftn |
| Fri 5/23 |
Spectral
clustering slides |
Optional
reading Shi and Malik PAMI 2000 Ng et al NIPS01 |
| Mon 5/26 |
Meomorial day
holiday |
|
| Wed 5/28 |
Dimensionality
reduction slides |
Chapter 12.1 |
| Fri 5/30 |
Nonlinear
dimension reduction slides |
|
| Mon 6/2 |
Semi-supervised
learning slides |
reading: Text Classification from Labeled and Unlabeled Documents using EM by Nigam et al. |
| Wed 6/4 |
||
| Fri 6/6 |
|
|
| Final |
6/10 12-1:50PM in class |