Vita

Honors

  • AI 10 to Watch by IEEE Intelligent Systems, 2013
  • Bert Kay Dissertation Award (for best dissertation from UT Austin Computer Science), 2013
  • IFAAMAS-12 Victor Lesser Distinguished Dissertation Award (Runner-up), 2013
  • ICSR Best Paper Award, 2013
  • Ro-Man CoTeSys Cognitive Robotics Best Paper (Finalist), 2012
  • AAMAS Pragnesh Jay Modi Best Student Paper Award, 2010
  • NSF Graduate Research Fellowship, 2008 – 2011

Academic Organization

Research Competitions

Robocup @Home League (home assistant robotics)
2007: 2nd place — Austin Villa @Home Website

Robocup Coach League (opponent modeling)
2006: 2nd place
2005: Champion — Austin Villa 2005 Coach Website

 

Selected Publications

Errata

Journal Articles

Guangliang LiShimon Whiteson, W. Bradley Knox, and Hayley Hung Using informative behavior to increase engagement while learning from human reward. Autonomous Agents and Multi-Agent Systems (JAAMAS). To appear.
pdf

W. Bradley Knox and Peter Stone. Framing Reinforcement Learning from Human Reward: Reward Positivity, Temporal Discounting, Episodicity, and Performance. Artificial Intelligence, 225, 24–50. August 2015.
pdf (author’s pre-print)
Artificial Intelligence Journal page

Saleema Amershi*, Maya Cakmak, W. Bradley Knox, and Todd Kulesza. Power to the People: The Role of Humans in Interactive Machine Learning. AI Magazine 35 (4): 105-120. January 2015.
pdf
AI Magazine page
*All authors contributed equally

A. Ross Otto, W. Bradley Knox, Art Markman, and  Bradley C. Love. Behavioral and Physiological Signatures of Reflective Exploratory Choice. Cognitive, Affective, & Behavioral Neuroscience. 1-17. March 2014
pdf
CABN Journal page

Jin Joo Lee, W. Bradley Knox, Jolie Baumann, Cynthia Breazeal, and David DeSteno. Computationally Modeling Interpersonal Trust. Frontiers in Psychology, 4, 893. 2013.
pdf
Frontiers in Psychology article page

W. Bradley Knox, Brian D. GlassBradley C. LoveW. Todd Maddox, and Peter Stone. How Humans Teach Agents: A New Experimental Perspective. International Journal of Social Robotics. 4(4) , 409-421. July 2012.
pdf
The final publication is available here at www.springerlink.com.

W. Bradley Knox*, A. Ross OttoPeter Stone, and Bradley C. Love. The Nature of Belief-Directed Exploratory Choice in Human Decision-making. Frontiers in Psychology, 2, 398. 2012.
pdf
Frontiers in Psychology article page
*First two authors contributed equally

Juhyun Lee, W. Bradley Knox, and Peter Stone. Inter-Classifier Feedback for Human-Robot Interaction in a Domestic Setting. Journal of Physical Agents, 2(2):41–50, July 2008. Special Issue on Human Interaction with Domestic Robots
pdf

 

Conference Papers

W. Bradley Knox, Samuel Spaulding, and Cynthia Breazeal. Learning from the Wizard: Programming Social Interaction through Teleoperated Demonstrations. In Proceedings of the Fifteenth International Conference on Autonomous Agents and Multiagent Systems (AAMAS). May, 2016.
pdf
AAMAS 2016

Guangliang Li, Hayley Hung, Shimon Whiteson, and W. Bradley Knox.  Learning from Human Reward Benefits from Socio-competitive Feedback. In Proceedings of the IEEE International Conference on Development and Learning and on Epigenetic Robots (ICDL-EpiRob). October, 2014.
pdf
ICDL-EpiRob

W. Bradley Knox, Cynthia Breazeal, and Peter Stone. Training a Robot via Human Feedback: A Case Study. In Proceedings of the International Conference on Social Robotics (ICSR). October, 2013.
Best Paper Award
pdf
ICSR 2013

Guangliang Li, Hayley Hung, Shimon Whiteson, and W. Bradley Knox. Using Informative Behavior to Increase Engagement in the TAMER Framework. In Proceedings of the Twelfth International Conference on Autonomous Agents and Multiagent Systems (AAMAS). May, 2013.
pdf
AAMAS 2013

W. Bradley Knox and Peter Stone. Learning Non-Myopically from Human-Generated Reward. In Proceedings of the International Conference on Intelligent User Interfaces (IUI). March 2013.
pdf
IUI 2013

W. Bradley Knox and Peter Stone. Reinforcement Learning from Simultaneous Human and MDP Reward. In Proceedings of the Eleventh International Conference on Autonomous Agents and Multiagent Systems. June 2012.
pdf
AAMAS 2012

W. Bradley Knox, Cynthia Breazeal, and Peter Stone. Learning from feedback on actions past and intended. In Proceedings of 7th ACM/IEEE International Conference on Human-Robot Interaction, Late-Breaking Reports Session. March 2012.
pdf
HRI 2012

W. Bradley Knox and Peter Stone. Combining Manual Feedback with Subsequent MDP Reward Signals for Reinforcement Learning. In Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems. May 2010.
Pragnesh Jay Modi Best Student Paper Award
pdf
Poster: [pdf] (2.9 MB)
AAMAS 2010

W. Bradley Knox and Peter Stone. Interactively Shaping Agents via Human Reinforcement: The TAMER Framework. In Proceedings of The Fifth International Conference on Knowledge Capture. September 2009.
pdf
Supplemental site
K-CAP09

Gregory Kuhlmann, William B. Knox, and Peter Stone. Know Thine Enemy: A Champion RoboCup Coach Agent. In Proceedings of the Twenty-First National Conference on Artificial Intelligence, pp. 1463–68, July 2006.
pdf
AAAI 2006

 

Archival Symposia Papers

Jin Joo Lee, W. Bradley Knox, and Cynthia Breazeal. Modeling the Dynamics of Nonverbal Behavior on Interpersonal Trust for Human-Robot Interactions. In AAAI Spring 2013 Symposium on Trust and Autonomous Systems, March 2013.
pdf

W. Bradley Knox and Peter Stone. Reinforcement Learning from Human Reward: Discounting in Episodic Tasks. In Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication (Ro-Man). September 2012.
Finalist for CoTeSys Cognitive Robotics Best Paper award
pdf
Ro-Man 2012

W. Bradley Knox, Ian Fasel, and Peter Stone. Design Principles for Creating Human-Shapable Agents. In AAAI Spring 2009 Symposium on Agents that Learn from Human Teachers, March 2009.
pdf
AAAI Spring 2009 Symposium: Agents that Learn from Human Teachers

 

Workshop Papers 

W. Bradley Knox, Samuel Spaulding, and Cynthia Breazeal. Learning Social Interaction from the Wizard: A Proposal. In 3rd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication  (MLIS-2014). July 2014.
pdf
MLIS-2014

W. Bradley Knox, Matthew Taylor, and Peter Stone. Understanding Human Teaching Modalities in Reinforcement Learning Environments: A Preliminary Report. In 2011 IJCAI Workshop on Agents Learning Interactively from Human Teachers (ALIHT), July 2011.
pdf
2011 IJCAI Workshop on Agents Learning Interactively from Human Teachers (ALIHT)

W. Bradley Knox and Ole Mengshoel. Diagnosis and Reconfiguration using Bayesian Networks: An Electrical Power System Case Study. In IJCAI 2009 Workshop on Self-* and Autonomous Systems. July 2009.
pdf
IJCAI09-SAS