Article Information

• PDF (469 kb)
• Full Text with Thumbnail Figures
• Full Text with Large Figures
• Cited by in Scopus (60)
• Request permission

PubMed

• Articles by Geoffrey E. Hinton

Related Articles

• What Is Optimal about Motor Control?

  What Is Optimal about Motor Control? Neuron, Volume 72, Issue 3, 3 November 2011, Pages 488-498 Karl Friston Summary This article poses a controversial question: is optimal control theory useful for understanding motor behavior or is it a misdirection? This question is becoming acute as people start to conflate internal models in motor control and perception (Poeppel et al., 2008; Hickok et al., 2011,Poeppel et al., 2008; Hickok et al., 2011). However, the forward models in motor control are not the generative models used in perceptual inference. This Perspective tries to highlight the differences between internal models in motor control and perception and asks whether optimal control is the right way to think about things. The issues considered here may have broader implications for optimal decision theory and Bayesian approaches to learning and behavior in general. Summary | Full Text | PDF (1206 kb)

• Canonical Microcircuits for Predictive Coding

  Canonical Microcircuits for Predictive Coding Neuron, Volume 76, Issue 4, 21 November 2012, Pages 695-711 Andre M. Bastos, W. Martin Usrey, Rick A. Adams, George R. Mangun, Pascal Fries and Karl J. Friston Summary This Perspective considers the influential notion of a canonical (cortical) microcircuit in light of recent theories about neuronal processing. Specifically, we conciliate quantitative studies of microcircuitry and the functional logic of neuronal computations. We revisit the established idea that message passing among hierarchical cortical areas implements a form of Bayesian inference—paying careful attention to the implications for intrinsic connections among neuronal populations. By deriving canonical forms for these computations, one can associate specific neuronal populations with specific computational roles. This analysis discloses a remarkable correspondence between the microcircuitry of the cortical column and the connectivity implied by predictive coding. Furthermore, it provides some intuitive insights into the functional asymmetries between feedforward and feedback connections and the characteristic frequencies over which they operate. Summary | Full Text | PDF (1325 kb)

• Motor control: Mechanisms of motor equivalence in handwriting

  Motor control: Mechanisms of motor equivalence in handwriting Current Biology, Volume 10, Issue 6, 15 March 2000, Pages R245-R248 Alan M. Wing Summary Handwriting is a classic example of how the details of movement can be scale and plane invariant: letter forms reflecting personal style are unchanged, whether one is writing on a piece of paper, on a blackboard or in the sand using the foot. Recent research points to a role for the parietal cortex in such motor equivalence. Summary | Full Text | PDF (163 kb)

• …more

Get Bookmark

• Add Bookmark
  • Delicious
  • Digg
  • Reddit
  • Facebook
  • StumbleUpon

Abstract

To achieve its impressive performance in tasks such as speech perception or object recognition, the brain extracts multiple levels of representation from the sensory input. Backpropagation was the first computationally efficient model of how neural networks could learn multiple layers of representation, but it required labeled training data and it did not work well in deep networks. The limitations of backpropagation learning can now be overcome by using multilayer neural networks that contain top-down connections and training them to generate sensory data rather than to classify it. Learning multilayer generative models might seem difficult, but a recent discovery makes it easy to learn nonlinear distributed representations one layer at a time.