Probability and Bayes
One key element of a Bayesian approach is that the 'answer' (e.g. an interpretation of a visual scene) comes from a limited set of pre-defined possibilities. The ideas described here, in particular the limited set of stored sensory+motivational contexts, are closely related. A second key element concerns the different responses to rich or sparse sensory information. When sensory information is poor, an observer's prior expectation dominates their response. Given a richer sensory input they are able to discriminate between scenes that would be indistinguishable on the basis of the poor sensory data alone and hence their prior expectations play much less of a role. This approach is based on sound probablistic principles and has proved hugely successful in computer vision.
The representation described in these pages can have much the same characteristics as a Bayesian one even though the operations are described differently. A useful example was introduced earlier in relation to recognising a face. A person gradually walked towards the observer or, in another example, fine scale detail became available over the first 250ms of viewing a stimulus. The change that occurs when extra, discriminative information becomes available can be understood in terms of a movement of the current sensory+motivational state from one Voronoi cell to another. The figure on this page shows a slightly adapted version of the previous version. Here, a person reacts to a novel image that is compatible with there being a predator in the scene. Then, over the first 250ms of viewing, the person gains sufficient sensory information to reject that hypothesis. The 'prior' interpretation in this example, i.e. the action associated with the initial Voronoi cell, is to prepare to flee. When extra information arrives that allows the sensory data to be discriminated from other possibilities, including the predator Voronoi cell, the response changes and the 'prior' is over-ridden.
What is doing the work here, to replace all the calculations of probabilities that are carried out in a Bayesian account (prior, likelihood and loss function)? There is an assumption that the boundaries of the Voronoi cells are known in advance, built up through experience. If these boundaries are appropriate, the suggestion is, then the resultant behaviour may appear similar (from the outside) to an agent operating on Bayesian principles.
- Every Voronoi cell has an action (or equivalent) associated with it and, however impoverished or unfamiliar the situation, the current sensory+motivational state always falls within some Voronoi cell. This aspect has similarities with a Bayesian approach.
- There may be several Voronoi cells whose 'footprint' (when projected down onto a hyperplane that omits fine scale detail, for example) falls within the Voronoi cell corresponding to impoverished information (e.g. one that relies only on a coarse scale information). The action/interpretation/perception associated with the 'coarse scale' Vornonoi cell might be described as a 'prior' while the action associated with the 'fine scale' Vornonoi cell is more dependent on the sensory data in the image (which, in this example, only becomes available when the exposure duration is increased, eg 250ms).
- Knill, D. C., & Richards, W. (Eds.). (1996). Perception as Bayesian inference. Cambridge University Press.
- Körding, K. P., & Wolpert, D. M. (2004). Bayesian integration in sensorimotor learning. Nature, 427(6971), 244-247.
- Prince, S. J. (2012). Computer vision: models, learning, and inference. Cambridge University Press. PDF available here