Training dense networks requires large numbers of GPUs or TPUs, and can take days or even weeks, resulting in large carbon footprints and spiraling costs. We believe the solution to this problem lies in the brain’s efficiency and power to learn, which arises from sparse connections and activations of neurons.
Greg Maltz • Science and Technology Writer 
From releasing a book to publishing scientific papers, 2021 was quite a busy year for Numenta. If you haven’t had a chance to catch up on what we’ve been up to, I’ve rounded up our top content of the past year.
Charmaine Lai • Senior Marketing Specialist 
Six years ago, we wrote a blog about Classic AI, Simple Neural Networks, and Biological Neural Networks. Fast forward to today and it’s no surprise that the terms have continued to evolve. In this blog post, we’ll revisit these approaches, look at how they hold up today, and compare them to each other. We’ll also explore how each approach might address the same real-world problem.
Numenta •
Christy Maver, Donna Dubinsky and Subutai Ahmad 
How can we take a step towards the brain’s efficiency without sacrificing accuracy? One strategy is to invoke sparsity. Today I’m excited to share a step in that direction – a 10x parameter reduction in BERT with no loss of accuracy on the GLUE benchmark.
Ben Cohen • Senior Research Engineer 
In our new pre-print titled “Going Beyond the Point Neuron: Active Dendrites and Sparse Representations for Continual Learning”, we investigated how to augment neural networks with properties of real neurons, specifically active dendrites and sparse representations.
Karan Grewal • Research Engineer 
