On Wednesday 23 March 2011, Professor Dana H. Ballard, of the Department of Computer Sciences University of Texas at Austin, will speak on 'Modular Reinforcement Learning as a Model of Embodied Cognition', as part of QBI's regular neuroscience seminar series.
The severe speed limitations of the brain’s neural circuitry mean that vast amounts of indexing must be performed during development so that appropriate behavioral responses can be rapidly accessed. One way this could happen would be if the brain used some kind of decomposition whereby behavioral primitives could be quickly accessed and combined. This realization motivates our research program, which studies the capabilities of groups of independent sensori-motor Markov decision process (MDP) modules in directing behavior.
We use virtual environments (VEs) to explore the sensitivity of the modular models to environmental complexity. VEs allow the manipulation of environmental parameters in a systematic way. Another component of that we depend on is the use of realistic humanoid avatars that can learn from motion capture human data. Our test settings are urban walking and driving environments with an array of rewarded sites that allows exploration of tradeoffs between the goals of different modules. By manipulating these, together with environmental complexity, we obtain parametric data on the extent to which modular MDPs are useful models.
Date: Wednesday 23 March 2011
Place: Level 7 Auditorium, QBI Building (#79), St.Lucia Campus
Seminars will be followed by a sandwich lunch for all attendees.
For a list of upcoming seminars at QBI, go to www.qbi.uq.edu.au/neuroscience-seminars.