Sepp Hochreiter

Cognitive abilities

Hierarchical model of cognitive abilities of AI systems.

Despite big successes in artificial intelligence (AI) and deep learning, there have been critical assessments made to current deep learning methods. Deep learning is data hungry, has limited knowledge transfer capabilities, does not quickly adapt to changing tasks or distributions, and insufficiently incorporates world or prior knowledge. While deep learning excels in natural language processing and vision benchmarks, it often underperforms at real-world applications. Deep learning models were shown to fail at new data, new applications, deployments in the wild, and stress tests.

Current AI research has tried to overcome the criticisms and limitations of deep learning. AI research and machine learning in particular aims at a new level of AI—a “broad AI”—with considerably enhanced and broader capabilities for skill acquisition and problem solving. We contrast “broad AI” to “narrow AI,” which are the AI systems currently applied. A broad AI considerably surpasses a narrow AI in the following essential properties: knowledge transfer and interaction, adaptability and robustness, abstraction and advanced reasoning, and efficiency. A broad AI is a sophisticated and adaptive system, which successfully performs any cognitive task by virtue of its sensory perception, previous experience, and learned skills.

Communications of the ACM, 65, 4, 56-57, 2022-03-19.

View paper
IARAI Authors
Dr Sepp Hochreiter
A Theory of AI
Artificial Intelligence, Deep Learning, Graph Neural Networks, Hopfield Networks, Machine Learning, Self-Supervised Learning, Symbolic Artificial Intelligence, Transfer Learning


Imprint | Privacy Policy

Stay in the know with developments at IARAI

We can let you know if there’s any

updates from the Institute.
You can later also tailor your news feed to specific research areas or keywords (Privacy)

Log in with your credentials

Forgot your details?

Create Account