Publications

(2021). Explore and Control with Adversarial Surprise. In Unsupervised Reinforcement Learning workshop at ICML 2021.

PDF Cite Code Project

(2021). Environment Generation for Zero-Shot Compositional Reinforcement Learning. In Neural Information Processing Systems (NeurIPS).

PDF Cite

(2021). PsiPhi-Learning: Reinforcement Learning with Demonstrations using Successor Features and Inverse Temporal Difference Learning. In International Conference on Machine Learning (ICML) Long talk (top 3% of submissions).

PDF Cite Project ICML talk

(2021). Learning Social Learning. In International Conference on Machine Learning (ICML); NeurIPS Cooperative AI Workshop Best Paper.

PDF Cite Code Poster Slides Cooperative AI talk ICML talk

(2021). Joint Attention for Multi-Agent Coordination and Social Learning. In ICRA Social Intelligence Workshop Spotlight talk.

PDF Cite Code Poster Video

(2020). Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Design. In Neural Information Processing Systems (NeurIPS) Oral (top 1% of submissions).

PDF Cite Code Poster Slides Videos NeurIPS Oral Science article Google AI Blog

(2020). Human-Centric Dialog Training via Offline Reinforcement Learning. In Empirical Methods in Natural Language Processing (EMNLP).

PDF Cite Code Dataset Slides EMNLP Talk

(2019). Tackling Climate Change with Machine Learning. In ACM Computing Surveys.

PDF Cite CCAI Organization MIT Tech Review article National Geographic article

(2019). Social Influence as Intrinsic Motivation for Multi-Agent Deep Reinforcement Learning. In International Conference on Machine Learning (ICML) Best Paper Honourable Mention (top 0.26% of submissions).

PDF Cite Poster Slides Videos ICML talk IEEE Spectrum article ICML 2019 Best Papers

(2019). Social and Affective Machine Learning. In Massachusetts Institute of Technology.

PDF Cite Thesis Defense

(2019). Hierarchical Reinforcement Learning for Open-Domain Dialog. In Association for the Advancement of Artificial Intelligence (AAAI) Oral (top 7.8% of submissions).

PDF Cite Code Dataset Talk

(2019). Automatic Triage and Analysis of Online Suicide Risk with Document Embeddings and Latent Dirichlet Allocation. In Affective Computing and Intelligence Interaction (ACII) workshop on Machine Learning for Mental Health.

PDF Cite

(2019). Approximating Interactive Human Evaluation with Self-Play for Open-Domain Dialog Systems. In Neural Information Processing Systems (NeurIPS).

PDF Cite Code Dataset Poster

(2018). Vomit Comet Physiology: Autonomic Changes in Novice Flyers. In IEEE Engineering in Medicine and Biology Society (EMBC).

PDF Cite

(2018). Learning via Social Awareness: Improving a Deep Generative Sketching Model with Facial Feedback. In International Conference on Learning Representations (ICLR) workshop.

PDF Cite Slides Quartz article

(2017). Sequence Tutor: Conservative Fine-Tuning of Sequence Generation Models with KL-control. In International Conference on Machine Learning (ICML).

PDF Cite Code ICML talk Generated music Magenta blog MIT Tech Review article

(2017). Predicting Tomorrow’s Mood, Health, and Stress Level using Personalized Multitask Learning and Domain Adaptation. In Proceedings of Machine Learning Research.

PDF Cite Slides

(2017). Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health. In IEEE Transactions on Affective Computing (TAFFC) Best Paper; NeurIPS Machine Learning for Healthcare (ML4HC) Workshop Best Paper.

Cite Code Video ML4HC Best Paper TAFFC Journal Best Paper

(2017). Multimodal Autoencoder: A Deep Learning Approach to Filling in Missing Sensor Data and Enabling Better Mood Prediction. In International Conference on Affective Computing and Intelligent Interaction (ACII).

PDF Cite Code Slides

(2017). Importance of Sleep Data in Predicting Next-Day Stress, Happiness, and Health in College Students. In Journal of Sleep and Sleep Disorders Research (suppl_1).

PDF Cite

(2016). Understanding and Predicting Bonding in Conversations Using Thin Slices of Facial Expressions and Body Language. In Intelligent Virtual Agents (IVA).

PDF Cite

(2016). Tuning Recurrent Neural Networks with Reinforcement Learning. In International Conference on Learning Representations (ICLR) - workshop.

PDF Cite Code Magenta blog MIT Tech Review article

(2016). Personality, Attitudes, and Bonding in Conversations. In Intelligent Virtual Agents (IVA).

PDF Cite

(2016). Machine Learning of Sleep and Wake Behaviors to Classify Self-Reported Evening Mood. In Sleep.

PDF Cite Code

(2016). Interactive Musical Improvisation with Magenta. In Neural Information Processing Systems (NeurIPS) Best Demo.

Cite Code Video NeurIPS Demo Magenta Blog post

(2016). BITxBIT: Encouraging Behavior Change with N=2 Experiments. In Proceedings of the CHI Conference Extended Abstracts on Human Factors.

PDF Cite Code

(2015). Wavelet-based motion artifact removal for Electrodermal Activity. In International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

PDF Cite

(2015). SmileTracker: Automatically and Unobtrusively Recording Smiles and their Context.. In Proceedings of the CHI Conference Extended Abstracts.

PDF Cite Slides Boston Magazine article CBC news

(2015). Recognizing academic performance, sleep quality, stress level, and mental health using personality traits, wearable sensors and mobile phones. In Wearable and Implantable Body Sensor Networks (BSN).

PDF Cite

(2015). Prediction of happy-sad mood from daily behaviors and previous sleep history. In International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

PDF Cite

(2015). Predicting students' happiness from physiology, phone, mobility, and behavioral data. In International Conference on Affective Computing and Intelligent Interaction (ACII).

PDF Cite NCBI link

(2015). Multi-task Multi-Kernel Learning for Estimating Individual Wellbeing. In Neural Information Processing Systems (NeurIPS) Workshop on Multimodal Machine Learning.

PDF Cite Code

(2015). Engaging the workplace with challenges. In International Conference on Persuasive Technologies.

PDF Cite Video Extended paper

(2015). Automatic identification of artifacts in Electrodermal Activity data. In International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

PDF Cite Code EDA Explorer tool Artifact detection tutorial SCR detection tutorial Research which uses EDA Explorer

(2015). Active learning for Electrodermal Activity classification. In IEEE Conference on Signal Processing in Medicine and Biology (SPMB).

PDF Cite

(2014). Predicting Affect in an Intelligent Tutoring System. In University of British Columbia.

PDF Cite Slides

(2014). Predicting Affect from Gaze Data During Interaction with an Intelligent Tutoring System. In Intelligent Tutoring Systems.

PDF Cite Slides

(2013). Understanding attention to adaptive hints in educational games: an eye-tracking study. In International Journal of Artificial Intelligence in Education.

PDF Cite

(2013). Emotionally Adaptive Intelligent Tutoring Systems using POMDPs. In Unpublished manuscript.

PDF Cite