Temporal Pooling

Some interesting finds: Acyclic hierarchical modelling and sequence unfolding

This week we have a couple of interesting links to share. From our experiments with generative hierarchical models, we claimed that the model produced by feed-forward processing should not have loops. Now we have discovered a paper by Bengio et al titled “Towards biologically plausible deep learning” [1] that supports this… Read More »Some interesting finds: Acyclic hierarchical modelling and sequence unfolding

On Predictive Coding and Temporal Pooling

Introduction Predictive Coding (PC) is a popular theory of cortical function within the neuroscience community. There is considerable biological evidence to support the essential concepts (see e.g. “Canonical microcircuits for predictive coding” by Bastos et al). PC describes a method of encoding messages passed between processing units. Specifically, PC states that… Read More »On Predictive Coding and Temporal Pooling

Architecture of the Memory Prediction Framework / Cortical Learning Algorithm / Hierarchical Temporal Memory

by David Rawlinson and Gideon Kowadlo Introduction The Memory Prediction Framework (MPF) is a general description of a class of algorithms. Numenta’s Cortical Learning Algorithm (CLA) is a specific instance of the framework. Numenta’s Hierarchical Temporal Memory (HTM) was an earlier instance of the framework. HTM and CLA adopt different… Read More »Architecture of the Memory Prediction Framework / Cortical Learning Algorithm / Hierarchical Temporal Memory