COL774: Machine Learning

General Information

Instructor: Parag Singla (email: parags AT

Class Timings (Slot F):
  • Tue, 11:00 am - 11:50am
  • Thu, 11:00 am - 11:50am
  • Fri, 11:00 am - 11:50am
Venue: Bharti 201.

Teaching Assistants (TAs)
TA Assignment


  • [Apr 1, 2015]: Assignment 3 is out! Due Date: Sunday Apr 26, 11:50 pm.
  • [Feb 22, 2015]: Assignment 2 is out! Due Date: Sunday Mar 15, 11:50 pm.
  • [Jan 18, 2015]: Assignment 1 is out! Due Date: Sunday Feb 8, 11:50 pm.

    Course Content

    WeekTopic Book ChaptersSupplementary Notes
    1 Introduction Duda, Chapter 1
    2,3 Linear and Logistic Regression, Gaussian Discriminant Analysis Bishop, Chapter 3.1, 4 lin-log-reg.pdf, gda.pdf
    4,5 Support Vector Machines Bishop, Chapter 7.1 svm.pdf
    6 Neural Networks Mitchell, Chapter 4 nnets.pdf nnets-hw.pdf
    7 Decision Trees Mitchell, Chapter 3 dtrees.pdf
    8,9 Naive Bayes, Bayesian Statistics Mitchell, Chapter 6 nb.pdf, bayes.pdf Conjugate Prior model.pdf
    10,11 K-Means, Gaussian Mixture Models, EM kmeans.pdf gmm.pdf em.pdf
    12 PCA pca.pdf
    13 Learning Theory, Model Selection Mitchell, Chapter 7 theory.pdf model.pdf
    14 Application of Machine Learning

    Additional Resources

    Review Material

    Topic Notes
    Probability prob.pdf
    Linear Algebra linalg.pdf
    Gaussian Distribution gaussians.pdf
    Convex Optimization (1) convex-1.pdf


    1. Machine Learning: A Probabilistic Perspective. Kevin Murphy. MIT Press, 2012.
    2. Pattern Recognition and Machine Learning. Christopher Bishop. First Edition, Springer, 2006.
    3. Pattern Classification. Richard Duda, Peter Hart and David Stock. Second Edition, Wiley-Interscience, 2000.
    4. Machine Learning. Tom Mitchell. First Edition, McGraw-Hill, 1997.

    Assignment Submission Instructions

    1. You are free to discuss the problems with other students in the class. You should include the names of the people you had a significant discussion with in your submission.
    2. All your solutions should be produced independently without referring to any discussion notes or the code someone else would have written.
    3. All the programming should be done in MATLAB. Include comments for readability.
    4. Code should be submitted using Moodle Page.
    5. Create a separate directory for each of the questions named by the question number. For instance, for question 1, all your submissions files (code/graphs/write-up) should be put in the directory named Q1 (and so on for other questions). Put all the Question sub-directories in a single top level directory. This directory should be named as "yourentrynumber_firstname_lastname". For example, if your entry number is "2009anz7535" and your name is "Nilesh Pathak", your submission directory should be named as "2009anz7535_nilesh_pathak". You should zip your directory and name the resulting file as "" e.g. in the above example it will be "". This single zip file should be submitted online.
    6. Honor Code: Any cases of copying will be awarded a zero on the assignment. More severe penalties may follow.
    7. Late Policy: You will lose 20% for each late day in submission. Maximum of 2 days late submissions are allowed.


    1. Assignment 3. Due: Sunday April 26, 2015. 11:50 pm.
    2. Assignment 2. Due: Sunday March 15, 2015. 11:50 pm.
    3. Assignment 1. Due: Sunday February 8, 2015. 11:50 pm.

    Grading Policy (Tentative)

    Assignments (3 or 4) 30%
    Quiz (1) 4%
    Minor I 15%
    Minor II 15%
    Major 36%