Samsung tests memory with built-in processing for AI-centric servers
Samsung hopes to complete PIM’s standardization in the first half of 2022
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
Samsunghas showcased the advancements it has made with the processing-in-memory (PIM) technology, as it strives to bringmemoryand logic closer together.
Announced earlier this year, the PIM technology integrates an artificial intelligence (AI) processor together with a high bandwidth memory (HBM) chip to boost compute intensive tasks like machine learning (ML).
At the Hot Chips conference,Samsungannounced that testing the new HBM-PIM memory with theXilinxAlveo Ultrascale+AIdata center accelerator cards, delivers more than double the performance while consuming less than half the electricity.
“HBM-PIM is the industry’s first AI-tailored memory solution being tested in customer AI-accelerator systems, demonstrating tremendous commercial potential,” commented Nam Sung Kim, senior vice president of DRAM Product & Technology at Samsung Electronics.
Mainstream use
Importantly, Samsung also shared plans to use the PIM technology beyond HBM chips and integrate them into mainstream DIMMs and mobile memory components to accelerate conventional memory-bound workloads.
Oliver Rebholz, head of HANA core research and innovation at SAP, revealed that the company has been working with Samsung on the new memory technology, which it hopes to use to enhance the performance on theSAP HANAin-memory database.
“Based on performance projections and potential integration scenarios, we expect significant performance improvements for in-memory database management system (IMDBMS) and higher energy efficiency via disaggregated computing on AXDIMM,” shared Rebholz.
Are you a pro? Subscribe to our newsletter
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
Moving forward Samsung even hopes to integrate PIM with itsmobile memorytechnology. At the conference Samsung revealed that early simulation tests with LPDDR5-PIM resulted in impressive performance gains for applications such as voice recognition, and machine translation.
With almost two decades of writing and reporting on Linux, Mayank Sharma would like everyone to think he’sTechRadar Pro’sexpert on the topic. Of course, he’s just as interested in other computing topics, particularly cybersecurity, cloud, containers, and coding.
Samsung plans record-breaking 400-layer NAND chip that could be key to breaking 200TB barrier for ultra large capacity AI hyperscaler SSDs
Adobe’s decision to eliminate perpetual licensing for its Elements software has stirred controversy among consumers
New fanless cooling technology enhances energy efficiency for AI workloads by achieving a 90% reduction in cooling power consumption
