STATS 710: Sequential Decision Making with mHealth Applications
Fall 2016
Name: Susan Murphy
Office: 445D West Hall
Office Hours: By appointment
Email: samurphy@umich.edu
Name: Ambuj Tewari
Office: 454 West Hall
Office Hours: By appointment
Email: tewaria@umich.edu
This is an advanced graduate level course. Our expectation is that you will engage in the course out of intellectual curiosity. The formal course requirements will be rather minimal. The final grade in the course will be determined by the quality of your scribed lecture notes and one final project using the weights given below.
A tentative list of topics is as follows.
Lecture number  Day  Notes  Topics 
1  Sep 06  lec01.pdf 

2  Sep 08  lec02.pdf 

3  Sep 13  lec03.pdf 

4  Sep 15  lec04.pdf 

5  Sep 20  lec05.pdf 

6  Sep 22  lec06.pdf 

7  Sep 27  lec07.pdf 

8  Sep 29  lec08.pdf 

Oct 04 
 
9  Oct 06  lec09.pdf 

10  Oct 11  lec10.pdf 

11  Oct 13  lec11.pdf 

12  Oct 18  lec12.pdf 

13  Oct 20  lec13.pdf 

Oct 25 
 
Oct 27 
 
14  Nov 01  lec14.pdf 

15  Nov 03  lec15.pdf 

16  Nov 08  lec16.pdf 

17  Nov 10  lec17.pdf 

18  Nov 15  Slides from Elad’s talk 

19  Nov 17  lec19.pdf 

20  Nov 22  lec20.pdf 

Nov 24 
 
21  Nov 29  lec21.pdf 

22  Dec 01  lec22.pdf 

23  Dec 06  lec23.pdf 

24  Dec 08  lec24.pdf 

Dec 13 
 
Dec 14 
 
 
 

Books and Monographs
Bandit Problems
Partial Monitoring
Contextual Bandit Problems
Learning in MDPs
Overviews of mHealth