Skip to content

Cortical Learning Algorithms with Predictive Coding for a Systems-Level Cognitive Architecture

This is a quick post to link a poster paper by Ryan McCall, who has experimented with a Predictive-Coding / Cortical Learning Algorithm (PC-CLA) hybrid approach. We found the paper via Ryan writing to the NUPIC theory mailing list. What’s great about the paper is it links to some of… Read More »Cortical Learning Algorithms with Predictive Coding for a Systems-Level Cognitive Architecture

A Unifying View of Deep Networks and Hierarchical Temporal Memory

Browsing the NUPIC Theory mailing list, I came across a post┬áby Fergal Byrne on the differences and similarities between Deep Learning and MPF/HTM. It’s a great background into some of the pros and cons of each. Given the popularity and demonstrated success of Deep Learning methods it’s good to understand… Read More »A Unifying View of Deep Networks and Hierarchical Temporal Memory

On Predictive Coding and Temporal Pooling

Introduction Predictive Coding (PC) is a popular theory of cortical function within the neuroscience community. There is considerable biological evidence to support the essential concepts (see e.g. “Canonical microcircuits for predictive coding” by Bastos et al). PC describes a method of encoding messages passed between processing units. Specifically, PC states that… Read More »On Predictive Coding and Temporal Pooling

Connectome browser – hierarchy viewer?

Hierarchy Viewer? Ongoing research to map out the patterns of connectivity in the human brain continues to produce stunning visuals. Are we looking at the hierarchy as proposed in the Memory-Prediction framework? In any case, it’s fun to explore, which you can do here: http://www.humanconnectomeproject.org/data/relationship-viewer/

Thalamocortical architecture

by Gideon Kowadlo and David Rawlinson Introduction One of the keys to understanding the neocortex as a whole, and the emergence of intelligence, is to understand how the cortical hierarchical levels interconnect. This includes: the physical connections, the meaning of the signals being transmitted, and possibly also the way the… Read More »Thalamocortical architecture

Constraints on intelligence

by Gideon Kowadlo and David Rawlinson Introduction This article contains some musings on the factors that limit the increase of intelligence as a species. We speculate that ultimately, our level of intelligence is limited by at least two factors, and possibly a third: our own cultural development, physical constraints, and… Read More »Constraints on intelligence