AI Frontiers is a professional organization for AI practitioners in the Silicon Valley that aims to bring together data scientists, engineers, and business people working in AI and big data area.
In this online meetup, Subutai Ahmad will give a talk titled, “Sparsity in the Neocortex and Its Implications for AI.”
Most deep learning networks today rely on dense representations. This is in stark contrast to our brains which are extremely sparse. I will review what is known about the sparsity of activations and connectivity in the neocortex. I then discuss how these insights from the brain can be applied to practical machine learning applications. I will show how sparse representations can give rise to improved robustness, continuous learning, and improved computational efficiency.