HTM

New HTM paper – “Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex”

The artificial neuron model used by Jeff Hawkins and Subutai Ahmad in their new paper (image reproduced from their paper, and cropped). Their neuron model is inspired by the pyramidal cells found in neocortex layers 2/3 and 5. It has been several years since Jeff Hawkins and Numenta published the… Read More »New HTM paper – “Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex”

Another look at the retina

by David Rawlinson and Gideon Kowadlo Why the retina is worth a deeper look Recently, we have been looking at the retina – light sensitive cell layers inside the eyeball, that detect wavelength and intensity, and compute some initial encoding of this data that is transmitted to the brain proper… Read More »Another look at the retina

Sparse Distributed Representations (SDRs)

TL;DR: An SDR is a Sparse Distributed Representation, described below SDRs are biologically plausible data structures SDRs have powerful properties SDRs have received a lot of attention recently There are a few really great new resources on the topic: Presentation by Subutai Ahmad of Numenta Older introductory presentation by Jeff Hawkins Excellent… Read More »Sparse Distributed Representations (SDRs)

Toward a Universal Cortical Algorithm: Examining Hierarchical Temporal Memory in Light of Frontal Cortical Function

This post is about a fantastic new paper by Michael R. Ferrier, titled:   Toward a Universal Cortical Algorithm: Examining Hierarchical Temporal Memory in Light of Frontal Cortical Function   The paper was posted to the NUPIC mailing list and can be found via:   http://numenta.org/community-content.html   The paper itself… Read More »Toward a Universal Cortical Algorithm: Examining Hierarchical Temporal Memory in Light of Frontal Cortical Function

Recent HTM projects

It’s exciting to see growing interest and participation in the AGI community. This is another brief post to share two examples. In this case, they both build on one approach to AGI, and that is HTM. FXAI – Explorations Into Computational Intelligence A blog that is pretty well described by… Read More »Recent HTM projects

A Unifying View of Deep Networks and Hierarchical Temporal Memory

Browsing the NUPIC Theory mailing list, I came across a post by Fergal Byrne on the differences and similarities between Deep Learning and MPF/HTM. It’s a great background into some of the pros and cons of each. Given the popularity and demonstrated success of Deep Learning methods it’s good to understand… Read More »A Unifying View of Deep Networks and Hierarchical Temporal Memory

On Predictive Coding and Temporal Pooling

Introduction Predictive Coding (PC) is a popular theory of cortical function within the neuroscience community. There is considerable biological evidence to support the essential concepts (see e.g. “Canonical microcircuits for predictive coding” by Bastos et al). PC describes a method of encoding messages passed between processing units. Specifically, PC states that… Read More »On Predictive Coding and Temporal Pooling