skip to main content
CS/CDS/IDS 185
Foundations of Algorithmic Decision-Making: Online Learning, Reinforcement Learning, and beyond
9 units (3-3-3)  | third term
Prerequisites: CS/CNS/EE/IDS 155, EE/CMS/CNS/CS/IDS 181, ACM/IDS 104, ACM/EE/IDS 116.

From game-playing agents to Large Language Models, Reinforcement Learning (RL) has become the engine behind many of the most significant breakthroughs in modern AI. This course provides a rigorous introduction to the mathematical foundations of algorithmic decision-making, moving from multi-armed bandits to reinforcement learning and concluding with special topics on how these principles are applied at scale to AI models and complex high-dimensional problems like robotics.  Through a mixture of mathematical analysis and algorithmic implementation, students will gain the tools to both understand and develop the next generation of decision-making agents. The course expects students to be comfortable with probability, linear algebra, and basic optimization.

Instructor: Mazumdar