Hippocampus

DSI Grant

Grant – Continual Few-Shot Learning

We are very happy to announce that we’ve been awarded an Artificial Intelligence for Decision Making Initiative grant from Defence Science Institute on Effective updating of deep learning models with limited new data. More specifically, the grant is for the Continual Few-Shot Learning project that we blogged about recently.
seahorse

Continual Few-Shot Learning with Hippocampal Replay

In continual learning, the neural network learns from a stream of data, acquiring new knowledge incrementally. It’s not possible to assume an i.i.d. stationary dataset available in one batch. Catastrophic forgetting of previous knowledge is a well known challenge. A wide variety of approaches fall broadly into 3 categories [6]:… Read More »Continual Few-Shot Learning with Hippocampal Replay

One-shot learning for the long term: consolidation with an artificial hippocampal algorithm

We were really excited to present a couple of papers recently at IJCNN, the International Joint Conference on Neural Networks. One of those papers was an extension to the work that we previously published on AHA, Artificial Hippocampal Algorithm based on Complementary Learning Systems by O’Reilly and McClelland (see that… Read More »One-shot learning for the long term: consolidation with an artificial hippocampal algorithm
Hippocampus

AHA! an ‘Artificial Hippocampal Algorithm’ for Episodic Machine Learning

We’re very happy to report that we recently published a preprint on AHA, an ‘Artificial Hippocampal Algorithm’ for Episodic Machine Learning. It’s the culmination of a multi-year research project and is a starting point for the next wave of developments. This article describes the motivation for developing AHA and a… Read More »AHA! an ‘Artificial Hippocampal Algorithm’ for Episodic Machine Learning

Exciting New Directions in ML/AI

Over the last few years, there have been several breakthroughs and exciting new research directions in Reinforcement Learning, Hippocampus Inspired Architectures, Attention and Few-Shot Learning. There has been a move towards multi-component, heterogeneous, stateful architectures, many guided by ideas from cognitive sciences. Google DeepMind and Google Brain are leading the… Read More »Exciting New Directions in ML/AI