Introduction Will highly intelligent machines inevitably think like us? Our experiences with AI that is simultaneously incredibly powerful and incredibly flawed are evidence that not all forms of intelligence are the same. Until recently, all human-level intelligence was human. Now, AI seems to threaten our monopoly. But truly human-level and human-like artificial general… Read More »Not like us: Why AI feels alien, and how to fix it
Authors: Hoang Long Dang and David RawlinsonUPDATE: Full HRM-Agent paper now available. When the Hierarchical Reasoning Model was released, we were very excited about its combination of small size and impressive reasoning abilities. These qualities seem to be enhanced by recurrent processing, but with a surprisingly simple gradient update based on the converged recurrent… Read More »HRM-Agent: Using the Hierarchical Reasoning Model in Reinforcement Learning
Since the arrival of Chat GPT, I’ve felt that progress in AI has been largely incremental. Of course, even Chat GPT was/is mostly just a scaled up Transformer model, which was introduced by Vaswani et al in 2017. The belief that AI is advancing relatively slowly is a radical and unpopular opinion… Read More »Why I’m excited about the Hierarchical Reasoning Model
We are very happy to announce that we’ve been awarded an Artificial Intelligence for Decision Making Initiative grant from Defence Science Institute on Effective updating of deep learning models with limited new data. More specifically, the grant is for the Continual Few-Shot Learning project that we blogged about recently.
In continual learning, the neural network learns from a stream of data, acquiring new knowledge incrementally. It’s not possible to assume an i.i.d. stationary dataset available in one batch. Catastrophic forgetting of previous knowledge is a well known challenge. A wide variety of approaches fall broadly into 3 categories [6]:… Read More »Continual Few-Shot Learning with Hippocampal Replay
We were really excited to present a couple of papers recently at IJCNN, the International Joint Conference on Neural Networks. One of those papers was an extension to the work that we previously published on AHA, Artificial Hippocampal Algorithm based on Complementary Learning Systems by O’Reilly and McClelland (see that… Read More »One-shot learning for the long term: consolidation with an artificial hippocampal algorithm
Executive Control is core to what most people recognise as true intelligence. For example, the ability to attend to relevant cues and maintain task dependent information whilst ignoring distracting details and taking appropriate actions. Working Memory (WM) is a core component of Executive Control. “Working memory is a short-term repository… Read More »Towards Biologically Inspired Executive Control
We’ve just undertaken a review and refresh of our research roadmap! The topics and approach we will take in the coming year are all laid out in a new page: Research Roadmap Our primary topics for the coming year include: Continual Few-Shot Learning (CFSL) via our Episodic memory system Using… Read More »Research Roadmap: 2020-2021
The Whole Brain Architecture Initiative (WBAI) aims to foster research into architectural approaches to general intelligence. They have held a series of events – the Hackathons – that encourage and support the development of new models which provide working solutions to questions about the possible architecture of general intelligence in… Read More »5th WBAI Hackathon
We’re very happy to report that we recently published a preprint on AHA, an ‘Artificial Hippocampal Algorithm’ for Episodic Machine Learning. It’s the culmination of a multi-year research project and is a starting point for the next wave of developments. This article describes the motivation for developing AHA and a… Read More »AHA! an ‘Artificial Hippocampal Algorithm’ for Episodic Machine Learning