search
HomeTechnology peripheralsAIMIT's new materials create 'Artificial Synapse 2.0' to simulate deep learning training and speed up 1 million times!

In recent years, as scientists continue to push the boundaries of machine learning, the time, energy, and money required to train increasingly complex neural network models have grown rapidly. "The model can be built, but the training is too slow" has become a headache that troubles more and more researchers.

Recently, a new field of artificial intelligence called "analog deep learning" promises faster computing with less energy. Programmable resistors are a key part of analog deep learning, just as transistors are core elements of digital processors.

By repeatedly arranging programmable resistors in complex layers, researchers can create a simulated network of artificial neurons and synapses that perform calculations like a digital neural network. This network can be trained to implement complex artificial intelligence tasks such as image recognition and natural language processing.

MITs new materials create Artificial Synapse 2.0 to simulate deep learning training and speed up 1 million times!

The calculation speed of the simulated neural network depends largely on the transmission speed of the "artificial synapse". This is what a team from MIT is trying to solve. They have previously developed an artificial simulated synapse, and what they need to do now is to develop a new material that surpasses the original old version.

This time, they used a practical inorganic material in the manufacturing process to allow the aforementioned programmable resistor to operate a million times faster than previous versions. , and also achieved about 1 million times faster than the synapses in the human brain. In addition, this material makes resistors extremely energy efficient. Unlike those used in earlier versions of the device, the new material is compatible with silicon manufacturing technology. This change makes it possible to fabricate devices at the nanometer scale and may pave the way for integration into commercial computing hardware for deep learning applications. This research paper has been published in Science.

MITs new materials create Artificial Synapse 2.0 to simulate deep learning training and speed up 1 million times!

Paper link: https://www.science.org/doi/pdf/10.1126/science.abp8064

"With this key discovery, we are able to Coupled with MIT.nano's powerful nanofabrication technology, we have been able to put these pieces together and demonstrate that these devices are inherently very fast and can operate at reasonable voltages." "The device works by The smallest ions - protons - are electrochemically inserted into the insulating oxide to modulate its electronic conductivity. Because the devices we use are so thin, we can accelerate the movement of this ion and push these ion devices through the use of strong electric fields. Towards nanosecond operations," explained Bilge Yildiz, corresponding author of the paper and Breene M. Kerr Professor in the Department of Nuclear Science and Engineering and the Department of Materials Science and Engineering. Ju Li, corresponding author of the paper and a professor in the Department of Nuclear Science and Engineering and a professor in the Department of Materials Science and Engineering at Battelle Energy Alliance, said:

"Action potentials in biological cells rise and fall on a millisecond scale. , because a voltage difference of about 0.1 volts is governed by the stability of water." Here we apply voltages up to 10 volts on a special nanometer-thick solid glass film that can conduct protons without permanent damage it. Also, the stronger the electric field, the faster the ionization device will operate. Co-authors of the paper also include Frances M. Ross, the Ellen Swallow Richards Professor in the Department of Materials Science and Engineering; postdocs Nicolas Emond and Baoming Wang; and EECS graduate student Difei Zhang.

These programmable resistors greatly increase the speed of training neural networks while greatly reducing the cost and energy consumption of training. This could help scientists develop deep learning models more quickly for applications such as self-driving cars, fraud detection, or medical image analysis. "Once you have an analog processor, you no longer have to train the network that other people are working on. You can train a network with unprecedentedly high complexity that no one else can afford. In other words, it's not just Not just a fast car, but a plane." Said Murat Onen, the first author of the paper and a postdoctoral fellow at MIT.

1 million times accelerated deep learning

There are two main reasons why analog deep learning is faster and more energy-efficient than its digital counterpart.

First of all, the calculations are performed in memory, so huge data loads are not transferred back and forth from memory to the processor. Analog processors also operate in parallel. If the matrix grows, the analog processor does not need more time to complete the new operation because all calculations are performed simultaneously. A key element of MIT's new analog processor technology is called a proton-programmable resistor. These resistors are measured in nanometers and are arranged in an array, like a checkerboard. MITs new materials create Artificial Synapse 2.0 to simulate deep learning training and speed up 1 million times!

Nanosecond Proton Programmable Resistor

In order to develop an ultra-high speed, high energy efficiency For programmable proton resistance, the researchers looked at different electrolyte materials. While other devices use organic compounds, Onen focuses on inorganic phosphosilicate glass (PSG). PSG is basically silica, a powdered desiccant material used to remove moisture.

The researchers studied it as a proton conductor for fuel cells under humidified conditions. It is also the best-known oxide in silicon processing. To make PSG, a small amount of phosphorus is added to the silicon, giving it special properties of proton conduction. Onen hypothesized that the optimized PSG could have high proton conductivity at room temperature without the need for water, which would make it an ideal solid electrolyte.

Amazing Speed

PSG is capable of ultrafast motion of protons because it contains a large number of nanometer-sized pores whose surface provides paths for protons to diffuse.

It can also withstand very strong pulsed electric fields.

#This is crucial because applying more voltage to the device can make the protons move extremely fast," explains Onen. "This speed is quite surprising," Onen said. "Normally, we wouldn't use such strong magnetic fields on devices to avoid them turning to ash. But instead, the protons ended up zipping through the pile of devices at tremendous speeds. And it's still a million times faster than what we were doing before. Also, because protons are small and have low mass, this motion doesn't destroy anything. It's almost like teleportation."

Because protons do not damage the material, resistors can operate for millions of cycles without failure.

MITs new materials create Artificial Synapse 2.0 to simulate deep learning training and speed up 1 million times!Ultrafast and energy-efficient modulation properties of proton programmable resistors

## This new electrolyte enables programmable proton resistors that are 1 million times faster than previous devices and can operate efficiently at room temperature, which is important for their incorporation into computing hardware.

Due to the insulating properties of PSG, when protons move, almost no current flows through the material. "This makes the device very energy efficient," Onen added. "Now that they have demonstrated the effectiveness of these programmable resistors, the researchers plan to develop them," del Alamo said. Redesign for high-volume production. They can then study the properties of the resistor array and scale it up to embed it into a system."

Yildiz added: "These Another exciting direction that Ionic devices can enable is energy-efficient hardware to simulate neural circuits and synaptic plasticity rules derived from neuroscience, beyond simulating deep neural networks. We have already begun such collaborations with neuroscience, getting Supported by MIT Quest for Intelligence.”

MITs new materials create Artificial Synapse 2.0 to simulate deep learning training and speed up 1 million times!

Our collaboration is critical to future innovation. The road ahead remains full of challenges Challenging, but also very exciting!"

William Chueh, associate professor of materials science and engineering at Stanford University, said: "Intercalation reactions such as those found in lithium-ion batteries have been used in memory devices. have been extensively explored. This work shows that proton-based memory devices offer impressive and surprising switching speeds and durability."

######But William Chueh did not did not participate in this study. ######

The above is the detailed content of MIT's new materials create 'Artificial Synapse 2.0' to simulate deep learning training and speed up 1 million times!. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
崩坏星穹铁道黄泉突破材料崩坏星穹铁道黄泉突破材料Mar 15, 2024 pm 02:28 PM

崩坏星穹铁道黄泉将在2.1版本上线,很多玩家想知道黄泉突破材料有哪些,小编已经把突破材料全部总结出来了,想要培养黄泉的玩家可以提前收集材料了,具体内容一起来看看这篇崩坏星穹铁道黄泉突破材料一览。崩坏星穹铁道攻略大全崩坏星穹铁道黄泉突破材料1、等级突破材料20级,熄灭原核×4、信用点×3200。30级,熄灭原核×8、信用点×6400。40级,微光原核×5、炼形者雷枝×2、信用点×12800。50级,微光原核×8、炼形者雷枝×5、信用点×32000。60级,蠢动原核×5、炼形者雷枝×15、信用点×6

荣耀Magic V3独创采用航天特种纤维:抗冲击性能是玻璃40倍荣耀Magic V3独创采用航天特种纤维:抗冲击性能是玻璃40倍Jul 19, 2024 am 09:53 AM

7月12日消息,今天下午荣耀MagicV3正式发布,实现9.2mm的惊人厚度,再次打破厚度纪录。荣耀MagicV3采用航天特种纤维作为机身材料,替代常规玻纤材料的使用,实现减重的同时,达成玻璃40倍的抗冲击性能,更好地保护内部零件。据介绍,航天特种纤维的强度高达5800MPa,密度却仅有1.56g/cm3,在实现了与碳纤维5000—6000MPa强度相当的同时,(密度1.9g/cm3)却拥有更轻的重量。与此同时,航天特种纤维也比碳纤维,以及市售其他手机常用的芳纶纤维、UPE纤维、玻璃纤维、玻璃

探索复合材料中的原子扩散,加州大学开发神经网络动力学方法探索复合材料中的原子扩散,加州大学开发神经网络动力学方法Jun 19, 2024 am 05:04 AM

编辑|绿罗就像随风扩散、扑面而来的花香,材料中的原子与分子也在进行着它们的「扩散」。材料中的分散决定了沉淀、新相形成和微观结构演化的动力学,并强烈影响机械和物理性能。成分复杂的材料固有的化学复杂性,给原子扩散建模和化学有序结构的形成带来了挑战。在这方面,加州大学的研究人员提出了一种神经网络动力学(NNK)方法,用于预测成分复杂材料中的原子扩散,并由此产生的微观结构演化。该框架基于高效的晶格结构和化学表征,结合人工神经网络,能够精确预测所有依赖于路径的迁移势垒和单个原子跳跃。可扩展的NNK框架为探

崩坏星穹铁道花火行迹突破材料有哪些崩坏星穹铁道花火行迹突破材料有哪些Mar 05, 2024 pm 01:40 PM

崩坏星穹铁道花火行迹突破材料有哪些?崩坏星穹铁道里面大家要是想花火变强的话那么就需要拉满花火的行迹了呢,在游戏里面我们需要准备好足够的材料才能完成这次突破,大家还不知道需要哪些材料,小编接下来就为大家带来其中的游戏攻略。《崩坏:星穹铁道》花火行迹突破材料一览lv2:永寿幼芽*3、信用点*2500lv3:谐乐小调*3、永寿幼芽*6、信用点*5000lv4:家族颂歌*3、永寿天华*3、信用点*10000、2.0新版本周本材料lv5:家族颂歌*5、永寿天华*3、信用点*20000、2.0新版本周本材料

AI做题家卷疯了!高数考试正确率81%,竞赛题成绩超过计算机博士AI做题家卷疯了!高数考试正确率81%,竞赛题成绩超过计算机博士Apr 11, 2023 pm 11:10 PM

高数考不好,不知道是多少人的噩梦。如果说你高数考得还不如AI好,是不是就更难以接受了?没错,来自OpenAI的Codex已经在MIT的7门高数课程题目中正确率达到81.1%,妥妥的MIT本科生水平。课程范围从初级微积分到微分方程、概率论、线性代数都有,题目形式除了计算、甚至还有画图。这件事最近还登上了微博热搜。△“仅”得81分,对AI的期待也太高了吧现在,谷歌那边又传来了最新大消息:不止数学,我们的AI甚至在整个理工科上,都已经拿到最高分啦!看来在培养“AI做题家”这件事上,科技巨头们已经卷出了

MIT发布加强版「高数」求解器:7门课程正确率达81%MIT发布加强版「高数」求解器:7门课程正确率达81%Apr 12, 2023 pm 04:04 PM

​不光玩小学数学应用题,AI已经开始攻克高数了! 最近MIT的研究人员宣布他们基于OpenAI Codex预训练模型,在本科生级别的数学问题上通过few-shot learning成功达到81%的正确率! 论文链接:https://arxiv.org/abs/2112.15594代码链接:https://github.com/idrori/mathq 先来几个小问题看看答案,比如计算单变量函数的图形绕轴旋转产生的体积、计算洛伦茨吸引子及投影、计算和描绘奇异值分解(SVD)的几何形状,不光能正确解

AI好奇心,不只害死猫!MIT强化学习新算法,智能体这回「难易通吃」AI好奇心,不只害死猫!MIT强化学习新算法,智能体这回「难易通吃」Apr 13, 2023 pm 04:19 PM

​人人都遇见过一个古老的难题。周五晚上,你正试图挑选一家餐厅吃饭,但没有预定。你应该去你最爱的那家人满为患的餐厅排队等位,还是尝试一家新餐厅,希望能发现一些更好吃的惊喜?后者确实有可能带来惊喜,但这种好奇心驱动的行为是有风险的:你去尝试的那家新餐厅的东西可能会更难吃。好奇心作为AI探索世界的驱动力,实例已经不胜枚举了——自主导航、机器人决策、优化检测结果等等。在某些情况下,机器使用「强化学习」来完成一个目标,在这一过程中,AI智能体从被奖励的好行为和被惩罚的坏行为中反复学习。就像人类在选择餐厅时

谷歌AI有人格?MIT这个「疯」教授说Alexa也有谷歌AI有人格?MIT这个「疯」教授说Alexa也有Apr 09, 2023 am 09:11 AM

​「我和AI聊出了感情。」一夜之间,谷歌工程师Blake Lemoine成为众人眼里的疯子。不论是Gary Marcus、斯坦福经济学家,还是各路专家纷纷对其否认。或许你不敢相信,一位来自麻省理工学院的物理学教授Max Tegmark却对Lemoine的观点持开放态度。他并不认为Lemoine是一个疯子。甚至,他还认为亚马逊的语音助手Alexa也有感情...Max TegmarkLaMDA有人格?MIT教授称Alexa也有Tegmark表示,「我们没有充足的证据表明LaMDA有主观上的情感,但我

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
Repo: How To Revive Teammates
1 months agoBy尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
1 months agoBy尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Dreamweaver Mac version

Dreamweaver Mac version

Visual web development tools

VSCode Windows 64-bit Download

VSCode Windows 64-bit Download

A free and powerful IDE editor launched by Microsoft

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

PhpStorm Mac version

PhpStorm Mac version

The latest (2018.2.1) professional PHP integrated development tool

SAP NetWeaver Server Adapter for Eclipse

SAP NetWeaver Server Adapter for Eclipse

Integrate Eclipse with SAP NetWeaver application server.