Fei Tang & Michael Kopp

In their recent paper titled “Large Associative Memory Problem in Neurobiology and Machine Learning” the authors gave a biologically plausible microscopic theory from which one can recover many dense associative memory models discussed in the literature. We show that the layers of the recent “MLP-mixer” as well as the essentially equivalent model in “Feed-Forward Layers” are amongst them.

arXiv:2105.15034, 2021-06-03

Download
View paper
IARAI Authors
Dr Michael Kopp​
Research
A Theory of AI
Keywords
Associative Memory, Attention Mechanism, Hopfield Networks

©2021 IARAI - INSTITUTE OF ADVANCED RESEARCH IN ARTIFICIAL INTELLIGENCE

Imprint | Privacy Policy

Stay in the know with developments at IARAI

We can let you know if there’s any

updates from the Institute.
You can later also tailor your news feed to specific research areas or keywords (Privacy)
Loading

Log in with your credentials

Forgot your details?

Create Account