Academia.eduAcademia.edu
paper cover icon
Active Bayesian perception and reinforcement learning

Active Bayesian perception and reinforcement learning

2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2013
Tony J Prescott
Abstract
ABSTRACT In a series of papers, we have formalized an active Bayesian perception approach for robotics based on recent progress in understanding animal perception. However, an issue for applied robot perception is how to tune this method to a task, using: (i) a belief threshold that adjusts the speed-accuracy tradeoff; and (ii) an active control strategy for relocating the sensor e.g. to a preset fixation point. Here we propose that these two variables should be learnt by reinforcement from a reward signal evaluating the decision outcome. We test this claim with a biomimetic fingertip that senses surface curvature under uncertainty about contact location. Appropriate formulation of the problem allows use of multi-armed bandit methods to optimize the threshold and fixation point of the active perception. In consequence, the system learns to balance speed versus accuracy and sets the fixation point to optimize both quantities. Although we consider one example in robot touch, we expect that the underlying principles have general applicability.

Tony J Prescott hasn't uploaded this paper.

Let Tony know you want this paper to be uploaded.

Ask for this paper to be uploaded.