A performance evaluation of similarity measures, document term weighting schemes and representations in a Boolean environment Terry Noreault, Michael McGill and Matthew B. Koli
Posted by nonasahla pada Juni 28, 2009
5.1 Introduction
This chapter reports on the results of a study of the effectiveness of ranking
algorithms. Also reported here will be some unexpected findings relating to the
performance of document representations and searcher differences. These
findings are a by-product of the evaluation of the ranking algorithm.
The goal of the study was to evaluate ranking algorithms so that
generalisations about their effectiveness could be made. Many different
ranking algorithms have been suggested (Sager and Lockemann, 1976).
Evaluation of the effectiveness of these algorithms has been conducted under
differing experimental conditions. These differences in the evaluation conditions
have made comparisons of ranking algorithms uncertain. This study
evaluated the effectiveness of the ranking algorithms using a single database,
common user population, and common sets of queries and relevance
judgements. This approach allowed the relative effectiveness of the ranking
algorithms to be determined. It is felt, but does need further examination, that
while the absolute effectiveness of any ranking algorithms may vary with the
environment, the relative effectiveness of the ranking algorithms will be
invariant.
sama kalo mau paper ini langsung leave komen, then kirim pesan ke email saya