Unless otherwise indicated, homework problems were taken from the course textbook:
Bertsekas, Dimitri P. Dynamic Programming and Optimal Control, Volume I. 3rd ed. Athena Scientific, 2005. ISBN: 9781886529267.
Bertsekas, Dimitri P. Dynamic Programming and Optimal Control, Volume II: Approximate Dynamic Programming. 4th ed. Athena Scientific, 2012. ISBN: 9781886529441.
The two volumes can also be purchased as a set. ISBN: 9781886529083.
| SES # | PROBLEMS | SOLUTIONS |
|---|---|---|
| 1 | Volume I, Problems 1.2, 1.3, 1.22, 2.1, 2.7, and 2.9 | Problem Set 1 Solutions (PDF) |
| 2 | Volume I, Problems 4.1, 4.2, 4.29, 4.33, and 4.34 | Problem Set 2 Solutions (PDF) |
| 3 | Volume I, Problem 5.2(a), 5.7, and 5.14 | Problem Set 3 Solutions (PDF) |
| 4 | Volume I, Problem 6.2 (Ignore first two sentences), 6.10, 6.16, and 6.20 | Problem Set 4 Solutions (PDF) |
| 5 | Volume I, Problem 7.2 | Problem Set 5 Solutions (PDF) |
| 6 | Volume I, Problems 7.3, 7.5, 7.7, 7.8a, 7.10, and 7.11 | Problem Set 6 Solutions (PDF) |
| 7 | Volume I, 7.20, 7.22, 7.23, 7.24, 7.25, and 7.26 | Problem Set 7 Solutions (PDF) |
| 8 | Homework 8 (PDF) | Problem Set 8 Solutions (PDF) |
| 9 | Volume II: Problems 4.12 and 4.17 | solutions not available |