IBM launches AI chip NorthPole: built-in memory, claimed to be able to 'simulate the operation of the human brain'

IT Home News on October 24, IBM Research recently launched the AI ​​chip NorthPole, which is said to be inspired by the operation of the human brain. Its inferred performance is said to surpass 4nm GPUs and is suitable for edge computing and other fields.

IT House learned after inquiries that the NorthPole chip is the successor of the TrueNorth chip that IBM used to "simulate the operation of the human brain" in 2014. The chip development is also led by Dharmendra Modha, the head of the TrueNorth chip.

▲ Picture source IBM

It is reported that in the traditional semiconductor industry, chips mainly follow the same basic architecture, and the processing unit and stored information are separated from each other. Although this architecture simplifies the chip design model, it also occurs because the transmission speed cannot keep up with the processing speed. The "von Neumann Bottleneck" has been eliminated, and Dharmendra Modha believes that the human brain is the most energy-efficient processor currently known, and therefore continues to look for ways to digitally replicate the human brain.

The biggest difference between the NorthPole chip currently launched by IBM and traditional chips is the "chip built-in memory". Without the "Von Neumann bottleneck", the AI ​​inference capability of the NorthPole chip is better than that of competitors on the market. Taste.

Although NorthPole uses a 12nm process, 22 billion transistors are placed on 800 square millimeters, and it has 256 cores. At 8-bit precision, each core can perform 2048 operations per cycle. If it is 4-bit or 2 With -bit precision, the number of operations can be doubled.

▲ PCIe card equipped with NorthPole, picture source IBM

In terms of specific architecture, NorthPole claims to blur the boundaries between computing and storage, which makes it easy to integrate NorthPole into the system and significantly reduces the load of equipment equipped with chips.

IBM Research tested NorthPole on the ResNet-50 model. Compared with competing GPU products based on the 12nm process, NorthPole's energy efficiency in identifying frames per second is 25 times that of competing products, regardless of latency or computing space. In terms of requirements, the performance is better than all mainstream architectures on the market, even better than GPUs based on the 4nm process.

However, NorthPole’s advantage is also its weakness. NorthPole can only easily read local data information integrated in the chip. When reading external data, it has no computing speed advantage.

Dharmendra Modha claims that while NorthPole cannot be used to host GPT-4, it should meet the model inference requirements required by many enterprises.

Currently IBM Research is still studying the applicable fields of NorthPole. Many edge computing researchers that require instant processing of large amounts of data may be very suitable for NorthPole, such as autonomous driving, remote sensing communications and other fields, where NorthPole can be used.

Advertising Statement: The external jump links (including but not limited to hyperlinks, QR codes, passwords, etc.) contained in the article are used to convey more information and save selection time. The results are for reference only and are owned by IT House Articles contain this statement.

The above is the detailed content of IBM launches AI chip NorthPole: built-in memory, claimed to be able to 'simulate the operation of the human brain'. For more information, please follow other related articles on the PHP Chinese website!