Integrating LSM Trees with Multichip Flash Translation Layer for Write-Efficient KVSSDs

Sung Ming Wu, Kai Hsiang Lin, Li Pin Chang

Research output: Contribution to journalArticle

Abstract

Log-structured-merge (LSM) trees are a highly write-optimized data structure for lightweight, high-performance Key-Value (KV) stores. Furthermore, solid state drives (SSDs) are a crucial component for I/O acceleration. Conventional LSM-over-SSD designs involve multiple software layers, including the LSM tree, host file system, and flash translation layer (FTL), which introduce cascading write amplifications. To manage the write amplifications from different layers, we propose KVSSDs, which are a close integration of LSM trees and the FTL. KVSSDs exploit the FTL mapping mechanism to implement copy-free compaction of LSM trees, and they enables direct data allocation in flash memory for efficient garbage collection. Our design also uses a fine-grained, dynamic striping policy to fully exploit the rich internal parallelism of multichip SSDs. The experimental results indicated that our LSM-SSD integrated design reduced the write amplification by 86% and improved the throughput by 383% compared with a conventional LSM-over-SSD design.

Keywords

  • Compaction
  • flash memory
  • Integrated design
  • Key-value store
  • LSM tree
  • Parallel processing
  • Resource management
  • Software
  • SSD.
  • Throughput
  • Writing

Fingerprint Dive into the research topics of 'Integrating LSM Trees with Multichip Flash Translation Layer for Write-Efficient KVSSDs'. Together they form a unique fingerprint.

  • Cite this