Figure 1: Our interpretation of the Thalamocortical system as 3 interacting sub-systems (objective, subjective and executive). The structure of the diagram indicates the dominant direction of information flow in each system. The objective system is primarily concerned with feed-forward data flow, for the purpose of building a representation of the… Read More »How to build a General Intelligence: An interpretation of the biology
Figure 1: Our headline image is from the Cognitive Consilience: An atlas of key pathways cross-referenced to supporting literature articles. The complexity and variety of routing within the brain can be appreciated with this beautiful illustration. Note in particular the specialisation of cortical cells and the way this affects their… Read More »How to build a General Intelligence: Circuits and Pathways
Figure 1: The physical architecture of general intelligence in the brain, namely the Thalamo-Cortical system. The system comprises a central hub (the Thalamus) surrounded by a surface (the Cortex, shown in blue). The Cortex is made up of a number of functionally-equivalent units called Columns. Each Column is a stack… Read More »How to Build a General Intelligence: Reverse Engineering
The artificial neuron model used by Jeff Hawkins and Subutai Ahmad in their new paper (image reproduced from their paper, and cropped). Their neuron model is inspired by the pyramidal cells found in neocortex layers 2/3 and 5. It has been several years since Jeff Hawkins and Numenta published the… Read More »New HTM paper – “Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex”
Authors: D Rawlinson and G Kowadlo This is the first of three articles detailing our latest thinking on general intelligence: A one-size-fits-all algorithm that, like people, is able to learn how to function effectively in almost any environment. This differs from most Artificial Intelligence (AI), which is designed by people… Read More »How to build a General Intelligence: What we think we already know
We have found a fantastic resource, part of the IBM Blue Brain Project, that clearly and interactively maps out interactions between neocortical neurons. The data comes from their attempts to simulate a piece of cortex down to the level of biologically-realistic neurons. Interactive neocortex browser tool here: https://bbpnmc.epfl.ch/nmc-portal/web/guest/microcircuit The… Read More »Digital Reconstruction of Neocortical Microcircuitry (resource)
Erik Laukien is back with a demo of Sparse, Distributed Representation with Reinforcement Learning. This topic is of intense interest to us, although the problem is quite a simple one. SDRs are a natural fit with Reinforcement Learning because bits jointly represent a state. If you associate each bit-pattern with… Read More »SDR-RL (Sparse, Distributed Representation with Reinforcement Learning)
An interesting article by Gerard Rinkus comparing the qualities of sparse distributed representation and quantum computing. In effect, he argues that because distributed representations can simultaneously represent multiple states, you get the same effect as a quantum superposition. The article was originally titled “sparse distributed coding via quantum computing” but… Read More »“Quantum computing” via Sparse distributed coding?
By David Rawlinson and Gideon Kowadlo The aim of this post is to take a short departure from more technical issues and deal with some of the philosophical questions about Artificial General Intelligence (AGI). The Elephant in the room This metaphor implies willful ignorance of something blindingly obvious. Something that’s difficult… Read More »Consciousness & “Free Will”: The Elephants in the Room
By Gideon Kowadlo and David Rawlinson In our last blog post, we discussed the repeating functional columnar structure of the neocortex, and the inconsistent terminology used to discuss it throughout the literature. As mentioned in that post, the function of the column is an important concept for understanding the function of the… Read More »A nomenclature for Cortical Columns and related concepts.