Tribhuvan University, Institute of Engineering, Thapathali Campus
UGC Nepal accreditation badge
Accredited by UGC NepalUniversity Grants CommissionQuality Education Since 1967 A.D.

Large-scale image search with text for information retrieval

Thumbnail Image

Files

Large-scale-image-search-with-text-for-information-retrieval.pdf (1.56 MB)Download

Date

2021-03-05

Authors

Journal Title

Journal ISSN

Volume Title

Publisher

Thapathali Campus, Institute of Engineering, Tribhuvan University

DOI

10.3126/jiee.v4i1.35390

Abstract

Searching images in a large database is a major requirement in Information Retrieval Systems. Expecting image search results based on a text query is a challenging task. In this paper, we leverage the power of Computer Vision and Natural Language Processing in Distributed Machines to lower the latency of search results. Image pixel features are computed based on contrastive loss function for image search. Text features are computed based on the Attention Mechanism for text search. These features are aligned together preserving the information in each text and image feature. Previously, the approach was tested only in multilingual models. However, we have tested it in image-text dataset and it enabled us to search in any form of text or images with high accuracy.

Description

Journal: Journal of Innovations in Engineering Education (JIEE), ISSN 2594-343X (print), 2773-823X (online) Volume/Issue: Vol. 4, Issue 1 (2021), pages 87-89 Article type: Research Article Published: 2021-03-05 DOI: https://doi.org/10.3126/jiee.v4i1.35390 Authors and affiliations: - Janardan Bhatta (Thapathali Campus, Institute of Engineering, Tribhuvan University, Kathmandu, Nepal) TCIOE department(s): Department of Electronics and Computer Engineering Publisher: Thapathali Campus, Institute of Engineering, Tribhuvan University License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0), https://creativecommons.org/licenses/by-nc-nd/4.0/ Journal website: https://journal.tcioe.edu.np/articles/ae0cc948-9006-4761-bbd8-e51969dfc2d7 NepJOL: https://www.nepjol.info/index.php/jiee/article/view/35390

Keywords

Computer vision , Attention mechanism , Contrastive loss function , Natural language processing , Information retrieval systems , JIEE , Journal of Innovations in Engineering Education , JIEE 2021 , JIEE Volume 4 , Research Article , Thapathali Campus , TCIOE , Institute of Engineering , IOE , Tribhuvan University , Nepal , engineering research Nepal , peer-reviewed journal article , open access , Department of Electronics and Computer Engineering

Citation

Bhatta, J. (2021). Large-scale image search with text for information retrieval. Journal of Innovations in Engineering Education, 4(1), 87-89. https://doi.org/10.3126/jiee.v4i1.35390

URI

https://elibrary.tcioe.edu.np/handle/123456789/281

Collections

Journal of Thapathali Campus
Faculty Publications

Endorsement

Review

Supplemented By

Referenced By

Creative Commons license

Copyright (c) 2021 JIEE and the authors. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0).
Except where otherwise noted, this item's license is described as Copyright (c) 2021 JIEE and the authors. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0).