Large-scale instance-level image retrieval

作者:

Highlights:

• We propose a novel approach to tackle large-scale image retrieval on deep-learned image descriptors by transforming the vectorial descriptors into surrogate text encodings.

• This transformation is based on a scalar quantization approach that is specifically designed to generate text suitable for scalable indexing in secondary memory.

• Our approach allows us to conveniently reuse mature and scalable full-text search engine technology (e.g. Elasticsearch, Apache Lucene) for retrieving images on a large scale without the need for dedicated structures.

• We compare our proposal to other works in a unified framework for representing surrogate text representation transformations.

• We performed an extensive experimental evaluation to assess the effectiveness and efficiency of our proposal, and compare it to other state-of-the-art vector-tailored indexing approaches.

摘要

•We propose a novel approach to tackle large-scale image retrieval on deep-learned image descriptors by transforming the vectorial descriptors into surrogate text encodings.•This transformation is based on a scalar quantization approach that is specifically designed to generate text suitable for scalable indexing in secondary memory.•Our approach allows us to conveniently reuse mature and scalable full-text search engine technology (e.g. Elasticsearch, Apache Lucene) for retrieving images on a large scale without the need for dedicated structures.•We compare our proposal to other works in a unified framework for representing surrogate text representation transformations.•We performed an extensive experimental evaluation to assess the effectiveness and efficiency of our proposal, and compare it to other state-of-the-art vector-tailored indexing approaches.

论文关键词:Image retrieval,Deep features,Surrogate text representation,Inverted index

论文评审过程:Received 28 February 2019, Revised 20 July 2019, Accepted 13 August 2019, Available online 29 August 2019, Version of Record 20 October 2020.

论文官网地址:https://doi.org/10.1016/j.ipm.2019.102100