COV884 - Uncertainty in AI - Spring 2018
Wednesday 2:30-3:50 pm in Bharti 201


Instructor: Mausam
(mausam at cse dot iitd dot ac dot in)
Office hours: by appointment, SIT 402
TAs: (office hours by appointment)
Shivanshu Gupta (shivanshugupta1995 at gmail.com)

Course Contents

Decision theory; Markov decision processes; Bayesian networks representation, inference and learning; reinforcement learning; intro to deep reinforcement learning.

Schedule

Start End Topics & Lecture Notes Required Readings Additional Resources
Jan 3 Jan 17 Introduction AIMA Chapter 1
Applications of AI
Jan 17 Jan 17 Intro to Probability AIMA Chapter 13
History of Bayes Theorem
Jan 31 Jan 31 Bayesian Networks Representation AIMA Chapter 14.1-14.4
Influence Flow in Bayes Nets
Feb 21 Feb 21 Bayesian Networks Inference and Learning AIMA Chapter 14.5, 20
Log Probabilities
Feb 24 Mar 23 Programming Assignment
Mar 7 Mar 7 Decision Theory AIMA Chapter 16.1-16.3, 16.6

Mar 7Mar 14 Markov Decision Processes AIMA Chapter 17.1-17.3

Apr 4Apr 11 Reinforcement Learning AIMA Chapter 21.1-21.3
TD Learning for Backgammon
Apr 11Apr 11 Bandits and Monte Carlo Tree Search
Monte Carlo Planning (Sections 3.1-3.3)
AIMA Chapter 21.4
UCT for Go
Monte Carlo Planning

Textbook

Stuart Russell & Peter Norvig, Artificial Intelligence: A Modern Approach,
Prentice-Hall, Third Edition (2009) (required).

Grading

Assignment(s): 50%; Exam: 50%; Class participation, online discussions: extra credit.

There will be 1-2 programming assignments.

Course Administration and Policies

Cheating Vs. Collaborating Guidelines

As adapted from Dan Weld's guidelines.

Collaboration is a very good thing. On the other hand, cheating is considered a very serious offense. Please don't do it! Concern about cheating creates an unpleasant environment for everyone. If you cheat, you get a zero in the assignment, and additionally you risk losing your position as a student in the department and the institute. The department's policy on cheating is to report any cases to the disciplinary committee. What follows afterwards is not fun.

So how do you draw the line between collaboration and cheating? Here's a reasonable set of ground rules. Failure to understand and follow these rules will constitute cheating, and will be dealt with as per institute guidelines.