Skip to content

Theory

Toward a Universal Cortical Algorithm: Examining Hierarchical Temporal Memory in Light of Frontal Cortical Function

This post is about a fantastic new paper by Michael R. Ferrier, titled:   Toward a Universal Cortical Algorithm: Examining Hierarchical Temporal Memory in Light of Frontal Cortical Function   The paper was posted to the NUPIC mailing list and can be found via:   http://numenta.org/community-content.html   The paper itself… Read More »Toward a Universal Cortical Algorithm: Examining Hierarchical Temporal Memory in Light of Frontal Cortical Function

Cortical Learning Algorithms with Predictive Coding for a Systems-Level Cognitive Architecture

This is a quick post to link a poster paper by Ryan McCall, who has experimented with a Predictive-Coding / Cortical Learning Algorithm (PC-CLA) hybrid approach. We found the paper via Ryan writing to the NUPIC theory mailing list. What’s great about the paper is it links to some of… Read More »Cortical Learning Algorithms with Predictive Coding for a Systems-Level Cognitive Architecture

A Unifying View of Deep Networks and Hierarchical Temporal Memory

Browsing the NUPIC Theory mailing list, I came across a post by Fergal Byrne on the differences and similarities between Deep Learning and MPF/HTM. It’s a great background into some of the pros and cons of each. Given the popularity and demonstrated success of Deep Learning methods it’s good to understand… Read More »A Unifying View of Deep Networks and Hierarchical Temporal Memory

On Predictive Coding and Temporal Pooling

Introduction Predictive Coding (PC) is a popular theory of cortical function within the neuroscience community. There is considerable biological evidence to support the essential concepts (see e.g. “Canonical microcircuits for predictive coding” by Bastos et al). PC describes a method of encoding messages passed between processing units. Specifically, PC states that… Read More »On Predictive Coding and Temporal Pooling

Connectome browser – hierarchy viewer?

Hierarchy Viewer? Ongoing research to map out the patterns of connectivity in the human brain continues to produce stunning visuals. Are we looking at the hierarchy as proposed in the Memory-Prediction framework? In any case, it’s fun to explore, which you can do here: http://www.humanconnectomeproject.org/data/relationship-viewer/

Thalamocortical architecture

by Gideon Kowadlo and David Rawlinson Introduction One of the keys to understanding the neocortex as a whole, and the emergence of intelligence, is to understand how the cortical hierarchical levels interconnect. This includes: the physical connections, the meaning of the signals being transmitted, and possibly also the way the… Read More »Thalamocortical architecture