A Case Study of a DRAM-NVM Hybrid Memory Allocator for Key-Value Stores

Minjae Kim, Bryan S. Kim, Eunji Lee, Sungjin Lee

Research output: Contribution to journalArticlepeer-review

Abstract

As non-volatile memory (NVM) technologies advance, commercial NVDIMM devices have been made readily available for various computing systems. To efficiently utilize the high-density and high-capacity of NVM, the latest Xeon CPUs support a special Memory Modethat turns the DRAM into a last-level (L4) cache and uses NVM as the user-addressable system memory. Unfortunately, Memory Mode often provides low performance, even slower than when only NVM is used without any DRAM cache. According to our analysis, this is due to the inefficient management of a DRAM cache by the integrated memory controller, which results in high miss rates. This paper proposes a new hybrid memory allocator, called TARMAC. By employing intelligent yet lightweight memory management policies at the memory allocator level, TARMAC manages two different types of memory devices more efficiently, achieving 37% higher cache hit rate, 67% higher throughput, and 40% shorter memory latency than the hardware-based Memory Mode, on average. TARMAC exposes memory interfaces compatible with traditional memory allocators, enabling existing software to use TARMAC without any manual modification.

Original languageEnglish (US)
Pages (from-to)81-84
Number of pages4
JournalIEEE Computer Architecture Letters
Volume21
Issue number2
DOIs
StatePublished - 2022

Keywords

  • memory allocator
  • memory performance analysis
  • Non-volatile memory

ASJC Scopus subject areas

  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'A Case Study of a DRAM-NVM Hybrid Memory Allocator for Key-Value Stores'. Together they form a unique fingerprint.

Cite this