Machine Perception Laboratory

RUBI Project

Rubi1

The goal of the rubi project is to accelerate progress in the development of social robots by addressing the problem at multiple levels, including the development of a scientific agenda, research methods, formal approaches, software, and hardware. the project is based on the idea that progress will go hand-in-hand with the emergence of a new scientific discipline that focuses on understanding the organization of adaptive behavior in real-time within the environments in which organisms operate. as such, the rubi project emphasizes the process of {\em design by immersion}, i.e., embedding scientists, engineers and robots in everyday life environments so as to have these environments shape the hardware, software, and scientific questions as early as possible in the development process. the focus of the project so far has been on social robots that interact with 18 to 24 month old toddlers as part of their daily activities at the early childhood education center at the university of california, san diego. in this document we present an overall assessment of the lessons and progress through year two of the project.

Publications

Tanaka F., Cicourel A., Movellan, J. R. (in press). Socialization between toddlers and robots at an early childhood education center. Proceedings of the National Academy of Science.
Download Butko, N. J., Movellan, J.R. (2007)Learning to Learn. IEEE International Conference on Development and Learning
Download Movellan, J.R., Tanaka, F., Taylor, C. Ruvolo, P., Eckhardt, M. (2007) The RUBI Project: A Progress Report. Proceedings of the 2nd ACM/IEEE International Conference of Human-Robot Interaction
  Fasel, I.R. (2006). Learning Real-Time Object Detectors: Probabilistic Generative Approaches. Doctoral dissertation, Department of Cognitive Science, University of California, San Diego.
  Tanaka, F. and J.R. Movellan (2006). The RUBI Project: Designing Everyday Robots by Immersion. Fifth International Conference on Development and Learning (ICDL)Bloomington, U.S.A., June 2006.
  Tanaka, F. and J.R. Movellan (2006). Behavior Analysis of Children’s Touch on a Small Humanoid Robot: Long-term Observation at a Daily Classroom over Three Months. Proceedings of the 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), in press Hatfield, United Kingdom, September 2006.
Download Tanaka, F., J. R. Movellan, B. Fortenberry, and K. Aisaka (2006). Daily HRI evaluation at a classroom environment: Reports from dance interaction experiments. In Proceedings of the 2006 Conference on Human-Robot Interaction (HRI), Salt Lake City, 2006.
Download MPT, the machine perception toolbox. If you use it, please cite those below:
Fasel, Ian, Bret Fortenberry, and J. R. Movellan. A generative framework for boosting with applications to real-time eye coding. Computer Vision and Image Understanding, 2005.
  Fasel, Ian, Bret Fortenberry, and J. R. Movellan. A generative framework for real-time object detection and classification. Computer Vision and Image Understanding, 98, 2005.
  Fasel, Ian and Javier R Movellan. Weakly-supervised robust, real-time object detection and localization. In NIPS Workshop on Automatic Discovery of Object Categories, Whistler, BC, December 2005.
  Movellan, J.R. (2005). An infomax controller for real time detection of contingency. In Proceedings of the International Conference on Development and Learning (ICDL05), Osaka, Japan, 2005.
Download Movellan, J.R., F. Tanaka, B. Fortenberry, and K. Aisaka. (2005). The RUBI project: Origins, principles and first steps. In Proceedings of the International Conference on Development and Learning (ICDL05), Osaka, Japan, 2005.
Download Tanaka, F., B. Fortenberry, K. Aisaka, and J. R. Movellan (2005). Plans for developing real-time dance interaction between qrio and toddlers in a classroom environment. In Proceedings of the International Conference on Development and Learning (ICDL05), Osaka, Japan, 2005
Download Tanaka, F., B. Fortenberry, K. Aisaka and J.R. Movellan (2005).
Developing Dance Interaction between QRIO and Toddlers in a Classroom Environment: Plans for the First Steps.
Proceedings of the 2005 IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN), p.223-228
Nashville, U.S.A., August 2005. (Best Paper Award).
Download Littlewort, G.C., Bartlett, M.S., Chenu, J., Fasel, I., Kanda, T., Ishiguro,H., & Movellan, J.R. (2004). Towards social robots: Automatic evaluation of human-robot interaction by face detection and expression classification. In S. Thrun & L. Saul & B. Schoelkopf, (Eds.) Advances in Neural Information Processing Systems, Vol 16. pg 1563-1570, MIT Press.
Download Littlewort G., Marian Stewart Bartlett, Ian Fasel, Joel Chenu, and Javier R. Movellan. Analysis of machine learning methods for real-time recognition of facial expressions from video. Computer Vision and Pattern Recognition, 2004 (Face Processing Workshop).
Download Littlewort, G.C., Bartlett, M.S., Chenu, J., Fasel, I., Kanda, T., Ishiguro,H., & Movellan, J.R. (in press). Towards social robots: Automatic evaluation of human-robot interaction by face detection and expression classification. In S. Thrun & B. Schoelkopf, (Eds.) Advances in Neural Information Processing Systems, Vol 16. MIT Press.