


Simulating brain functions, this AI model truly achieves continuous learning like a human being
As breakthroughs in various AI fields such as image processing, smart healthcare, self-driving cars, and smart cities demonstrate, deep learning is undoubtedly experiencing a golden age. Over the next decade or so, AI and computer systems will finally have human-like learning and thinking capabilities to process a constant flow of information and interact with the real world.
However, current AI models suffer performance losses when continuously trained on new information. This is because whenever new data is generated, it is written on top of the existing data, erasing the previous information. This effect is called "catastrophic forgetting." The stability-plasticity dilemma results in the need for AI models to update their memory to continuously adapt to new information while maintaining the stability of current knowledge. This issue prevents SOTA AI models from continuously learning from real-world information.
Meanwhile, edge computing systems allow computing to be moved from cloud storage and data centers closer to the original source, such as devices connected to the Internet of Things. Efficiently applying continuous learning on resource-limited edge computing devices remains a challenge, although many continuous learning models have been proposed in the field to solve this problem. Traditional models require high computing power and large storage capacity.
Recently, a research team from the Singapore University of Technology and Design (SUTD) designed a new model that can achieve a highly energy-efficient continuous learning system, studying "Continual Learning Electrical Conduction in Resistive-Switching-Memory Materials" ” was published in the journal Advanced Theory and Simulation.
Paper address: https://onlinelibrary.wiley.com/doi/abs/10.1002/adts.202200226
The The team proposed a model inspired by the brain, Brain-Inspired Replay (BIR), which can naturally carry out continuous learning. The BIR model is based on artificial neural networks and variational autoencoders to simulate the functions of the human brain and performs well in incremental learning-like scenarios without stored data. Researchers have also used BIR models to represent the growth of conductive filaments using electric current in digital memory systems.
The upper left of the figure below shows the generative playback settings, the upper right shows the training of artificial neural network with generative playback; the lower left and lower right show the normalized current accuracy of the conventional and BIR models respectively.
Assistant Professor Loke, one of the corresponding authors of the paper, explained, “In BIR, knowledge is saved in the trained model, thereby introducing additional tasks. The performance loss is minimized at the same time, and there is no need to refer to data from previous work. Therefore, this approach can save a lot of energy."
He also added, "In the absence of stored data, Achieved 89% SOTA accuracy on the compliance challenge of current learning tasks, which is approximately two times higher than traditional continuous learning models, and achieves high energy efficiency."
In addition, in order To enable the BIR model to independently process real-world field information, the team plans to expand its tunability in the next phase of research.
Loke said the research is based on a small-scale demonstration and is still in its early stages. However, taking this approach promises to allow edge AI systems to develop independently without human control.
The above is the detailed content of Simulating brain functions, this AI model truly achieves continuous learning like a human being. For more information, please follow other related articles on the PHP Chinese website!

Running large language models at home with ease: LM Studio User Guide In recent years, advances in software and hardware have made it possible to run large language models (LLMs) on personal computers. LM Studio is an excellent tool to make this process easy and convenient. This article will dive into how to run LLM locally using LM Studio, covering key steps, potential challenges, and the benefits of having LLM locally. Whether you are a tech enthusiast or are curious about the latest AI technologies, this guide will provide valuable insights and practical tips. Let's get started! Overview Understand the basic requirements for running LLM locally. Set up LM Studi on your computer

Guy Peri is McCormick’s Chief Information and Digital Officer. Though only seven months into his role, Peri is rapidly advancing a comprehensive transformation of the company’s digital capabilities. His career-long focus on data and analytics informs

Introduction Artificial intelligence (AI) is evolving to understand not just words, but also emotions, responding with a human touch. This sophisticated interaction is crucial in the rapidly advancing field of AI and natural language processing. Th

Introduction In today's data-centric world, leveraging advanced AI technologies is crucial for businesses seeking a competitive edge and enhanced efficiency. A range of powerful tools empowers data scientists, analysts, and developers to build, depl

This week's AI landscape exploded with groundbreaking releases from industry giants like OpenAI, Mistral AI, NVIDIA, DeepSeek, and Hugging Face. These new models promise increased power, affordability, and accessibility, fueled by advancements in tr

But the company’s Android app, which offers not only search capabilities but also acts as an AI assistant, is riddled with a host of security issues that could expose its users to data theft, account takeovers and impersonation attacks from malicious

You can look at what’s happening in conferences and at trade shows. You can ask engineers what they’re doing, or consult with a CEO. Everywhere you look, things are changing at breakneck speed. Engineers, and Non-Engineers What’s the difference be

Simulate Rocket Launches with RocketPy: A Comprehensive Guide This article guides you through simulating high-power rocket launches using RocketPy, a powerful Python library. We'll cover everything from defining rocket components to analyzing simula


Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

AI Hentai Generator
Generate AI Hentai for free.

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Dreamweaver Mac version
Visual web development tools

WebStorm Mac version
Useful JavaScript development tools

Zend Studio 13.0.1
Powerful PHP integrated development environment