TY - GEN
T1 - Optimization strategies for complex queries
AU - Strohman, Trevor
AU - Turtle, Howard
AU - Croft, W. Bruce
PY - 2005
Y1 - 2005
N2 - Previous research into the efficiency of text retrieval systems has dealt primarily with methods that consider inverted lists in sequence; these methods are known as term-at-a-time methods. However, the literature for optimizing document-at-a-time systems remains sparse.We present an improvement to the max-score optimization, which is the most efficient known document-at-a-time scoring method. Like max-score, our technique, called term bounded max-score, is guaranteed to return exactly the same scores and documents as an unoptimized evaluation, which is particularly useful for query model research. We simulated our technique to explore the problem space, then implemented it in Indri, our large scale language modeling search engine. Tests with the GOV2 corpus on title queries show our method to be 23% faster than max-score alone, and 61% faster than our document-at-a-time baseline. Our optimized query times are competitive with conventional term-at-a-time systems on this year's TREC Terabyte task.
AB - Previous research into the efficiency of text retrieval systems has dealt primarily with methods that consider inverted lists in sequence; these methods are known as term-at-a-time methods. However, the literature for optimizing document-at-a-time systems remains sparse.We present an improvement to the max-score optimization, which is the most efficient known document-at-a-time scoring method. Like max-score, our technique, called term bounded max-score, is guaranteed to return exactly the same scores and documents as an unoptimized evaluation, which is particularly useful for query model research. We simulated our technique to explore the problem space, then implemented it in Indri, our large scale language modeling search engine. Tests with the GOV2 corpus on title queries show our method to be 23% faster than max-score alone, and 61% faster than our document-at-a-time baseline. Our optimized query times are competitive with conventional term-at-a-time systems on this year's TREC Terabyte task.
KW - efficiency
KW - indexing
KW - query processing
UR - http://www.scopus.com/inward/record.url?scp=84885594442&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84885594442&partnerID=8YFLogxK
U2 - 10.1145/1076034.1076074
DO - 10.1145/1076034.1076074
M3 - Conference contribution
AN - SCOPUS:84885594442
SN - 1595930345
SN - 9781595930347
T3 - SIGIR 2005 - Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
SP - 219
EP - 225
BT - SIGIR 2005 - Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
T2 - 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2005
Y2 - 15 August 2005 through 19 August 2005
ER -