R. Freedman

Publications

Also on Google Scholar.

2026
Supervising author

Reward Basis Decomposition for Interpreting Preference Heterogeneity

Mohamed I. Eldagla, Ifesi Onubogu, Prerana Rane, Harsh Sharma, Rachel Freedman
InterpScience Workshop at NeurIPS 2026
2026
Lead author

Active Teacher Selection for Reward Learning

Rachel Freedman, Justin Svegliato, Kyle Wray, Stuart Russell
Transactions on Machine Learning Research (TMLR 2026); also Contributed talk at PRL @ AAAI 2025; Contributed talk at TAIS 2025
PaperarXivCode
2026
Lead author

Adaptive Pluralistic Alignment: A Pipeline for Dynamic Artificial Democracy

Rachel Freedman
BiAlign Workshop at NeurIPS 2026; also Pluralistic Alignment Workshop at ICML 2026
Oral (top 15%)
PaperICML workshop page
2025
Contributing author

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Stephen Casper, Xander Davies, Claudia Shi, Thomas Krendl Gilbert, Jérémy Scheurer, Javier Rando, Rachel Freedman, Tomasz Korbak, David Lindner, Pedro Freire, Tony Wang, Samuel Marks, Charbel-Raphaël Segerie, Micah Carroll, Andi Peng, Phillip Christoffersen, Mehul Damani, Stewart Slocum, Usman Anwar, Anand Siththaranjan, Max Nadeau, Eric J. Michaud, Jacob Pfau, Dmitrii Krasheninnikov, Xin Chen, Lauro Langosco, Peter Hase, Erdem Bıyık, Anca Dragan, David Krueger, Dorsa Sadigh, Dylan Hadfield-Menell
International Conference on Learning Representations (ICLR 2025); also Transactions on Machine Learning Research (TMLR 2023)
1,000+ citations
PaperarXiv
2024
Supervising author

Linear Probe Penalties Reduce LLM Sycophancy

Henry Papadatos, Rachel Freedman
Socially Responsible Language Modelling Research Workshop (SoLaR) at NeurIPS 2024
PaperarXiv
2024
Contributing author

Position: Social Choice Should Guide AI Alignment in Dealing with Diverse Human Feedback

Vincent Conitzer, Rachel Freedman, Jobst Heitzig, Wesley H. Holliday, Bob M. Jacobs, Nathan Lambert, Milan Mossé, Eric Pacuit, Stuart Russell, Hailey Schoelkopf, Emanuel Tewolde, William S. Zwicker
International Conference on Machine Learning (ICML 2024)
100+ citations
PaperarXiv
2023
Supervising author

Active Reward Learning from Multiple Teachers

Peter Barnett, Rachel Freedman, Justin Svegliato, Stuart Russell
SafeAI Workshop at AAAI 2023
Best Paper Award Finalist
PaperarXiv
2022
Supervising author

The Expertise Problem: Learning from Specialized Feedback

Oliver Daniels-Koch, Rachel Freedman
ML Safety Workshop at NeurIPS 2022
AI Risk Analysis Award
PaperarXiv
2020
Lead author

Adapting a Kidney Exchange Algorithm to Align with Human Values

Rachel Freedman, Jana Schaich Borg, Walter Sinnott-Armstrong, John Dickerson, Vincent Conitzer
Artificial Intelligence Journal (AIJ, vol. 283, 2020); also AAAI 2018; AIES 2018; MD4SG 2018; Participatory ML Workshop at ICML 2020
Outstanding Student Paper Honorable Mention at AAAI 2018 · 100+ citations
Journal paperConference paperarXivTalkPosterCodeQuartz coverageOutline coverage
2020
Lead author

Choice Set Misspecification in Reward Inference

Rachel Freedman, Rohin Shah, Anca Dragan
Workshop on Artificial Intelligence Safety at IJCAI-PRICAI 2020
Best Paper Award
PaperarXivTalk
2020
Contributing author

Benefits of Assistance over Reward Learning

Rohin Shah, Pedro Freire, Neel Alex, Rachel Freedman, Dmitrii Krasheninnikov, Lawrence Chan, Michael Dennis, Pieter Abbeel, Anca Dragan, Stuart Russell
Cooperative AI Workshop at NeurIPS 2020
Best Paper Award
PaperPDFTalk