In order to build machines with common sense we need to find ways to integrate a wide variety of specific ways to represent knowledge, reason with that knowledge, and arrange such resources into a larger architecture. To study this problem we are building a rich, simulated environment in which a pair of simulated robots live and perform various tasks: walking about, manipulating objects, building structures together, and conversing with each other about events in their world.