[10p-B21-1~8] Advancing the frontiers of AI electronics x Research on Systems

3:45 PM - 4:15 PM JST(6:45 AM - 7:15 AM UTC)

[10p-B21-5] Basics of Processing-using-DRAM and Its AI Applications

〇Shinya Takamaeda^1,2 (1.Univ. of Tokyo, 2.RIKEN)

Keywords:

Processing in Memory,DRAM,Processing-using-DRAM

In this talk, we introduce the fundamentals and AI applications of Processing-using-DRAM (PuD), a computing technology that leverages the structure and operating principles of DRAM. First, we explain the operating principles of PuD using commodity DRAM and describe how its basic operations are realized. We then discuss a dynamic PuD computation scheme for achieving practical acceleration of LLM inference, as well as an analysis of the major causes of computation errors using real DRAM modules and calibration techniques to mitigate them.