Aditya Modi

Aditya Modi


Email: admodi [at] umich [dot] edu
Office: 3856, BBB, 2260 Hayward St.,
Univ. of Michigan, Ann Arbor, MI


I am a PhD candidate at the Computer Science and Engineering department in University of Michigan, Ann Arbor. I'm fortunate to be advised by Satinder Singh and Ambuj Tewari.

My research interests lie in developing methods with provable guarantees for interactive learning and sequential decision making frameworks like reinforcement learning, bandits and (general) online learning. My current focus is on the sample efficiency of reinforcement learning methods under various structural assumptions. Additionally, I've an active interest in real-world applications of reinforcement learning methods.

Before coming to Michigan, I completed my undergraduate degree in Computer Science from Indian Institute of Technology, Kanpur in May 2016.

Recent News

  • I will be visiting the Simons Institute for the Theory of RL program this Fall.
  • One paper accepted to ICML 2020 (Project led by Shengpu Tang).
  • Our paper on regret minimization in contextual reinforcement learning accepted to UAI 2020.
  • Our paper on RL with model ensembles is accepted at AISTATS 2020!


  1. Model-free Representation Learning and Exploration in Low-rank MDPs
    Aditya Modi*, Jinglin Chen*, Akshay Krishnamurthy, Nan Jiang, Alekh Agarwal
    * Equal contribution.

  2. Clinician-in-the-Loop Decision Making: Reinforcement Learning with Near-Optimal Set-Valued Policies
    Shengpu Tang, Aditya Modi, Michael Sjoding, Jenna Wiens
    International Conference on Machine Learning (ICML), 2020.

  3. No-regret Exploration in Contextual Reinforcement Learning
    Aditya Modi and Ambuj Tewari
    Conference on Uncertainty in Artificial Intelligence (UAI), 2020.
    Abridged version accepted to ICML 2019 workshop on RL for Real Life and RLDM 2019.

  4. Sample Complexity of Reinforcement Learning using Linearly Combined Model Ensembles
    Aditya Modi, Nan Jiang, Ambuj Tewari, Satinder Singh
    International Conference on Artificial Intelligence and Statistics (AISTATS), 2020.

  5. Metareasoning in Modular Software Systems: On-the-Fly Configuration using Reinforcement Learning with Rich Contextual Representations
    Aditya Modi, Debadeepta Dey, Alekh Agarwal, Adith Swaminathan, Besmira Nushi, Sean Andrist, Eric Horvitz
    AAAI Conference on Artificial Intelligence (AAAI), 2020.
    Invited poster, ICML 2019 Workshop on RL for Real Life.

  6. Markov Decision Processes with Continuous Side Information
    Aditya Modi, Nan Jiang, Satinder Singh, Ambuj Tewari
    Algorithmic Learning Theory (ALT) 2018.


  • Microsoft Research, Redmond
    Research Intern, Adaptive Systems and Interaction group.
    July-October 2018.

  • Microsoft Research, Bangalore
    Research Intern, Applied Sciences group.
    May-July 2015.

Professional Service/Activity

  • Reviewing: AAAI 2019, AISTATS 2019-21, ICML 2019-21 (Top reviewer '20), NeurIPS 2019-20 (Top reviewer '19,'20)
  • Organization: Statistical Machine Learning Reading Group (EECS,2017-18).


  • Introduction to Machine Learning - Winter 2017
    Prof. Jenna Wiens, University of Michigan