Numenta Introduces Breakthrough Theory for Intelligence and Cortical Computation
The Thousand Brains Theory of Intelligence offers significant implications for the fields of neuroscience and artificial intelligence
REDWOOD CITY, CA – October 15, 2018—Understanding how the human brain works is considered one of the greatest unsolved scientific challenges. Neuroscientists have amassed an enormous amount of detailed factual knowledge about the brain, yet there remains no unifying theory as to what intelligence is and how the brain produces it. After more than a decade of research, scientists at Numenta believe they have made a major advance toward solving this problem.
In a new scientific paper titled, “A Framework for Intelligence and Cortical Function Based on Grid Cells in the Neocortex,” the Numenta researchers propose a broad framework for understanding what the neocortex does and how it works. “The neocortex is the organ of intelligence,” explained Jeff Hawkins, the lead author of the new paper. “It is composed of a repeating circuit that creates our perceptions, language, and high-level thoughts. We identified a key piece of this circuit that had been missed, which led to a cascade of discoveries including a new interpretation of how the neocortex works as a whole.”
The key insight described in the paper relates to a type of neuron called grid cells. Grid cells exist in an older part of the brain that learns maps of environments. As you move, grid cells keep track of the location of your body relative to these maps. Numenta researchers deduced that grid cells also must exist throughout the neocortex. These “cortical grid cells” track the locations of your sensors as they move relative to the objects in the world. The authors propose that cortical grid cells allow the neocortex to learn models of objects similar to how the older part of the brain learns maps of environments.
Co-author Subutai Ahmad elaborated, “Today it is commonly believed that the brain recognizes objects by extracting sensory features in a series of processing steps, which also is how deep learning networks work. Our new theory suggests the brain works differently. Instead of learning one big model of the world, the neocortex learns thousands of distributed models that operate in parallel. We call this the Thousand Brains Theory of Intelligence.”
The paper proposes how we learn the structure and behavior of objects based on locations and location spaces defined by cortical grid cells. The paper also predicts the presence of a new type of neuron called “displacement cells,” which partner with cortical grid cells to represent the positions of objects relative to each other. Displacement cells allow the neocortex to learn new objects as compositions of previously learned objects, an important form of generalization. The authors propose that these mechanisms apply to concepts as well as physical objects, thus providing a framework for all forms of intelligent thought.
Scientists Comment on the New Paper “Hawkins consistently concentrates on the big picture: the theoretical frameworks that might explain how the whole system functions. His secret power is to understand the data on the ground while adopting a 30,000 foot view – and this is what allows the possibility of surmounting incrementalism to make real advances in neuroscience,” said David Eagleman, Neuroscientist, adjunct professor in the Department of Psychiatry & Behavioral Sciences at Stanford, and Co-founder and Chief Executive Officer at Neosensory, Inc.
“Numenta’s previous research on learning temporal sequences provided new insights into the role of dendrites, neurons and prediction. Their latest paper offers a novel unifying framework for understanding how the entire brain works,” said Weinan Sun, a neuroscientist at the Howard Hughes Medical Institute. “It will impact the field of neuroscience as well as artificial intelligence.”
Resources The new paper is being submitted for publication and is available in pre-print form on bioRxiv. Numenta also has written a companion piece designed to explain the framework in plain language, making it accessible to non-neuroscientists. In addition to the main paper and the companion piece, Numenta released another scientific manuscript titled, “Locations in the Neocortex: A Theory of Sensorimotor Object Recognition Using Cortical Grid Cells.” This paper describes a detailed network model showing how grid cells can be used to learn and infer objects, and it includes results from modeling some of these networks. Links to these and other resources can be found on Numenta’s website https://numenta.com/. Jeff Hawkins presented the new theory in a keynote address at the Human Brain Project Summit on October 15, 2018, in Maastricht, the Netherlands.
Implications for Artificial Intelligence (AI) Numenta’s new framework for how the brain creates intelligence could offer a roadmap for the future of AI. Many leading AI researchers have concluded that deep learning convolutional networks have severe limitations and that new approaches will be needed. Numenta’s brain theory differs sharply from today’s AI techniques. Numenta’s belief is that the Thousand Brains Theory, which incorporates the ability to represent compositional structure, learn through movement, and integrate knowledge across modalities, will prove to be the ultimate framework for artificial general intelligence and robotics.
Numenta scientists and engineers are working on one of humanity’s grand challenges: understanding how the brain works. The company has a dual mission: to reverse-engineer the neocortex and to enable machine intelligence technology based on cortical theory. Co-founded in 2005 by technologist and scientist Jeff Hawkins, Numenta is developing a framework for how the neocortex works. The team tests their theories via simulation, mathematical analysis, and experimental partnerships. Numenta publishes its progress in open access scientific journals, makes all of its code public in an open source project, and licenses its intellectual property and technology for commercial purposes.