Multi-query image retrieval using CNN and SIFT features

Shiuan Huang, Hsueh-Ming Hang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

Due to the rapid growth of image number, the content-based image retrieval becomes an indispensable tool for huge databases. In this study, our focus is retrieving a specific building at different viewing angles stored in a database. In addition, if the user can provide additional images as the secondi and' or the third queries, how do we combine the information provided by these multiple queries? Thus, we develop a multi-query fus ion method to achieve a higher accuracy. Although Deep Neural Net (DNN) can provide an End-To-End image retrieval system, we like to see if the traditional image feature can offer additional performance improvement. That is, we test two different types of features designed for image retrieval purpose. We adopt the Scale-Invariant Feature Trans form (SIFT) features as the low-level feature and the Convolutional Neural Network (CNN) features as the high-level feature in the retrieval process. The AlexNet is used as our CNN model and also, its extension to the Siamese-Triplet Network is in use to match the image retried purpose. Several data fus ion structures have been proposed Our best sys tem exceeds mos t of the state-of-The-Art retrieval methods for a single query. The multi-query retrieval can further increase the retrieval accuracy, which is rarely studied by the other researchers.

Original languageEnglish
Title of host publicationProceedings - 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1026-1034
Number of pages9
ISBN (Electronic)9781538615423
DOIs
StatePublished - 5 Feb 2018
Event9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017 - Kuala Lumpur, Malaysia
Duration: 12 Dec 201715 Dec 2017

Publication series

NameProceedings - 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017
Volume2018-February

Conference

Conference9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017
CountryMalaysia
CityKuala Lumpur
Period12/12/1715/12/17

Fingerprint Dive into the research topics of 'Multi-query image retrieval using CNN and SIFT features'. Together they form a unique fingerprint.

Cite this