Numenta Newsletter — November 10, 2016
I’m pleased to share that we have published a new research paper titled
Continuous Online Sequence Learning with an Unsupervised Neural Network Model,
in the peer-reviewed journal Neural Computation. This paper is a companion
piece to a paper we published earlier this year that introduced Numenta’s theory
of how the brain learns and understands sequences of patterns. We refer to the
theory as HTM sequence memory. In this new paper, authors Yuwei Cui, Subutai
Ahmad and Jeff Hawkins compare HTM sequence memory to other state of the art
machine learning methods for streaming data.
Writing this paper is another important step for Numenta, as we continue to
publish peer-reviewed research that demonstrates the importance of brain theory
in creating machine intelligence. What makes this paper particularly interesting
is that it compares HTM sequence memory to several other sequence learning
algorithms, including statistical methods and recurrent neural networks. HTM
achieves comparable accuracy results while displaying several important
properties that apply to both biological systems and real-world streaming
applications. These properties include continuous online learning, the ability
to make multiple simultaneous predictions, robustness to sensor noise and fault
tolerance, and good performance without the need for task-specific tuning. We
are finding an increased interest in brain models from the machine learning
community. We hope the performance comparisons to a wide variety of techniques
in this paper will introduce a neocortical theory-based approach to a new
audience and encourage people to apply HTM to real-time sequence learning
problems.
Speaking of machine learning, Numenta will be sponsoring MLconf SF on
November 11 for the second year in a row. MLconf targets the San Francisco
machine learning and data scientist community. At our booth, we will give demos
of our tools and example applications, discuss our latest papers, and answer
questions. Please stop by if you’re planning to attend. If you’re not in the
area, you can still check out this recent blog post from MLconf Technical
Chair, Nick Vasiloglou, who interviewed Numenta engineer Austin Marshall about
Numenta’s view of neural networks and AI.
In case you missed them on our Twitter feed, we have some new pieces on the
website, including a preprint of a journal submission titled
“The HTM Spatial Pooler: A Neocortical Algorithm for Online Sparse Distributed Coding”
and a guest post for InsideBigData on
“The Importance of Brain Theory in Machine Intelligence”.