Improving document ranking with query expansion based on bert word embeddings

Date

2020

Author

Yeke, Doğuhan

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

33
views

82
downloads

Cite This

In this thesis, we present a query expansion approach based on contextualized word embeddings for improving document ranking performance. We employ Bidirectional Encoder Representations from Transformers(BERT) word embeddings to expand the original query with semantically similar terms. After deciding the best method for extracting word embeddings from BERT, we extend our query with the best candidate terms. As our primary goal, we show how BERT performs over the Word2Vec model, known as the most common procedure for representing terms in the vector space. After that, by leveraging the relevance judgment list, we show positive contributions of integrating tf-idf and term co-occurrence properties of terms to our query expansion system. Our experiments demonstrate that BERT outperforms Word2Vec in well-known evaluation metrics. In addition, we also conduct several experiments that address the most popular issues in information retrieval systems.

Subject Keywords

Querying (Computer science)., Keywords: Query Expansion, BERT, Document Ranking, Relevance Feedback.

URI

http://etd.lib.metu.edu.tr/upload/12625500/index.pdf
https://hdl.handle.net/11511/45743

Collections

Graduate School of Natural and Applied Sciences, Thesis