Video Recordings

This talk will provide an overview of a new DARPA program focused on Communicating with Computers, CwC. One of the applications in CwC is a Blocks World domain, where the actions are very simple and concrete, such as “Add a block to the tower.” However, even in this restricted world, getting the appropriate contextual interpretation of a sentence can be challenging. The talk will review the progress we have made so far on achieving the goal of contextual interpretation. This requires the bringing to bear of many resources, including James Allen’s TRIPS ontology and parser, Jerry Hobbs’s axiomatization of many object and action definitions, James Pustejovsky’s Generative Lexicon (GL), and VerbNet (VN). A main focus of the talk will be the ways in which we are modifying VerbNet to more closely align with Generative Lexicon Event Structure representations, to produce GL—VN. Working with Julia Hockenmaier, we are also synchronizing these VerbNet with the lexical entries of a Combinatory Categorial Grammar (CCG) semantic parser so that it produces the appropriate sentence representations, including implicit arguments, for the Blocks World domain. This CCG/VN semantic parser approach will also be described. The talk will conclude with both short term and long term goals for our collaborations on CwC, with respect to  both GL-VN and CCG-VN.