On the Additivity and Weak Baselines for Search Result Diversification Research

Download

index.pdf

Date

2017-10-04

Author

Akcay, Mehmet
Altıngövde, İsmail Sengör
Macdonald, Craig
Ounis, Iadh

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

100
views

0
downloads

A recent study on the topic of additivity addresses the task of search result diversi cation and concludes that while weaker baselines are almost always signi cantly improved by the evaluated diversi cation methods, for stronger baselines, just the opposite happens, i.e., no signi cant improvement can be observed. Due to the importance of the issue in shaping future research directions and evaluation strategies in search results diversi cation, in this work, we rst aim to reproduce the ndings reported in the previous study, and then investigate its possible limitations. Our extensive experiments rst reveal that under the same experimental se ing with that previous study, we can reach similar results. Next, we hypothesize that for stronger baselines, tuning the parameters of some methods (i.e., the trade-o parameter between the relevance and diversity of the results in this particular scenario) should be done in a more negrained manner. With trade-o parameters that are speci cally determined for each baseline run, we show that the percentage of signi cant improvements even over the strong baselines can be doubled. As a further issue, we discuss the possible impact of using the same strong baseline retrieval function for the diversity computations of the methods. Our takeaway message is that in the case of a strong baseline, it is more crucial to tune the parameters of the diversi cation methods to be evaluated; but once this is done, additivity is achievable.

Subject Keywords

Additivity, Result diversi cation, Statistical signi cance

URI

https://hdl.handle.net/11511/37642

DOI

https://doi.org/10.1145/3121050.3121059

Collections

Department of Computer Engineering, Conference / Seminar

Suggestions

OpenMETU
Core

Analyzing and boosting the performance of explicit result diversification methods for web search Akçay, Mehmet; Altıngövde, İsmail Sengör; Department of Computer Engineering (2016) A recent study on the topic of additivity addresses the task of search result diversification and concludes that while weaker baselines are usually significantly improved by the evaluated diversification methods, for stronger baselines, no significant improvement can be observed. Due to the importance of the issue in shaping future research evaluation strategies in search results diversification, in this thesis, we first aim to reproduce the findings reported in the previous study, and then investigate its ...
Experimental investigation of residual stresses introduced via shot peening and their effect on fatigue life of ball bearings Küçükyılmaz, Ali; Gür, Cemil Hakan; Department of Metallurgical and Materials Engineering (2010) In this study, residual stresses introduced via application of shot peening on the raceways of bearing rings and their effect on the fatigue life was investigated experimentally. For improvement of residual compressive stress state, shot peening operation with different parameters was utilized. Residual stress measurements were conducted via X-ray diffraction technique. Optimization of residual stress state during the production of ball bearings is the main target of this study. Process parameters for shot ...
Comparison of Kalman filter and Bayesian-MAP approaches in the spatio-temporal solution of the inverse electrocardiography Ters elektrokardiyografinin zaman-uzamsal çözümünde Kalman filtre ve Bayes-MAP yöntemlerinin karşilaştirilmasi Aydin, Ümit; Serinağaoğlu Doğrusöz, Yeşim (2010-07-15) In this study some of the spatial and spatio-temporal methods for the solution of the inverse problem of electrocardiography (ECG) are compared with each other. Comparisons are also made for the cases with geometric errors, where the location of the heart is shifted for 10mm and the size of the heart is reduced by 5%. The compared methods are the Kalman filter and Bayesian maximum a posteriori estimation (MAP). Two different Bayesian-MAP algorithms are used. While one uses only spatial information the other...
Theoretical limits to sensitivity and resolution in magneto-acousto-electrical tomography GHALICHI, Elyar; Gençer, Nevzat Güneri (2017-10-21) In this study, the performance of magneto-acousto-electrical tomography (MAET) is investigated quantitatively by considering interrelations between its sensitivity, resolution and conductivity contrast. An analytical solution for the forward problem of MAET is derived for two-dimensional (2D) concentric bodies by the separation of variables method. The electric potential and the acoustic pressure are separated into their angular and radial components. The series coefficients for these solutions are obtained...
ON THE THERMODYNAMICS OF MICROBIAL-GROWTH PROCESSES SANDLER, SI; ORBEY, H (Wiley, 1991-10-05) In this article, we provide a rigorous thermodynamic analysis of microbial growth processes, clarify the role of the generalized degree of reduction concept as it is used in both stoichiometric equations and as a characterizing factor for thermophysical properties, and introduce a classification method to account for errors when using the generalized degree of reduction to estimate the energy and free energy contents of molecules. We maintain the advantages of using the generalized degree of reduction whil...

Citation Formats

M. Akcay, İ. S. Altıngövde, C. Macdonald, and I. Ounis, “On the Additivity and Weak Baselines for Search Result Diversification Research,” 2017, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/37642.