Successor Features

PsiPhi-Learning: Reinforcement Learning with Demonstrations using Successor Features and Inverse Temporal Difference Learning
PsiPhi-Learning learns successor representations for the policies of other agents and the ego agent, using a shared underlying state representation. Learning from other agents helps the agent take better actions at inference time, and learning from RL experience improves modeling of other agents.
A. Filos, C. Lyle, Y. Gal, S. Levine, Natasha Jaques*, G. Farquhar*
2021 In International Conference on Machine Learning (ICML) Oral (top 3% of submissions)
PDF Cite Project ICML talk
PsiPhi-Learning: Reinforcement Learning with Demonstrations using Successor Features and Inverse Temporal Difference Learning