Skip to content (access key 's')
Logo of Technion
Logo of CS Department
Events

Events

Data Science & Deep Learning: State Visitation Fairness in Average-Reward MDPs
event speaker icon
Vineet Nair (CS, Technion)
event date icon
Monday, 19.4.2021, 12:30
event location icon
Zoom Lecture: 93378688224
For password to lecture, please contact: mayasidis@cs.technion.ac.il
Fairness has emerged as an important concern in automated decision-making in recent years, especially when these decisions affect human welfare. In this work, we study fairness in temporally extended decision-making settings, specifically those formulated as Markov Decision Processes (MDPs). Our proposed notion of fairness ensures that each state's long-term visitation frequency is more than a specified fraction. In an average-reward MDP setting, we formulate the problem as a bilinear saddle point program and, for a generative model, solve it using a Stochastic Mirror Descent (SMD) based algorithm. The proposed solution guarantees a simultaneous approximation of the expected average-reward and the long-term state-visitation frequency.
[Back to the index of events]