An inverted file cache for fast information retrieval

Wann Yun Shieh*, Jyh-Jiun Shann, Chung-Ping Chung

*Corresponding author for this work

Research output: Contribution to journalArticle

1 Scopus citations

Abstract

The inverted file is the most popular indexing mechanism used for document search in an information retrieval system (IRS). However, the disk I/O for accessing the inverted file becomes a bottleneck in an IRS. To avoid using the disk I/O, we propose a caching mechanism for accessing the inverted file, called the inverted file cache (IF cache). In this cache, a proposed hashing scheme using a linked list structure to handle collisions in the hash table speeds up entry indexing. Furthermore, the replacement and storage mechanisms of this cache are designed specifically for the inverted file structure. We experimentally verify our design, based on documents collected from the TREC (Text REtrieval Conference) and search requests generated by the Z;p/-like distribution. Simulation results show that the IF cache can improve the performance of a test IRS by about 60% in terms of the average searching response time.

Original languageEnglish
Pages (from-to)681-695
Number of pages15
JournalJournal of Information Science and Engineering
Volume19
Issue number4
DOIs
StatePublished - 1 Jul 2003

Keywords

  • Cache
  • Hashing
  • Information retrieval system
  • Inverted file
  • Memory management

Fingerprint Dive into the research topics of 'An inverted file cache for fast information retrieval'. Together they form a unique fingerprint.

  • Cite this