caa a22 4500 463251490 CHVBK 20180405153341.0 cr unu---uuuuu 170326e20070601xx s 000 0 eng 10.1007/s10791-006-9014-4 doi (NATIONALLICENCE)springer-10.1007/s10791-006-9014-4 A pipelined architecture for distributed text query evaluation [Elektronische Daten] [Alistair Moffat, William Webber, Justin Zobel, Ricardo Baeza-Yates] Two principal query-evaluation methodologies have been described for cluster-based implementation of distributed information retrieval systems: document partitioning and term partitioning. In a document-partitioned system, each of the processors hosts a subset of the documents in the collection, and executes every query against its local sub-collection. In a term-partitioned system, each of the processors hosts a subset of the inverted lists that make up the index of the collection, and serves them to a central machine as they are required for query evaluation. In this paper we introduce a pipelined query-evaluation methodology, based on a term-partitioned index, in which partially evaluated queries are passed amongst the set of processors that host the query terms. This arrangement retains the disk read benefits of term partitioning, but more effectively shares the computational load. We compare the three methodologies experimentally, and show that term distribution is inefficient and scales poorly. The new pipelined approach offers efficient memory utilization and efficient use of disk accesses, but suffers from problems with load balancing between nodes. Until these problems are resolved, document partitioning remains the preferred method. Springer Science+Business Media, LLC, 2006 Distributed retrieval nationallicence Text searching nationallicence Index representations nationallicence Moffat Alistair Department of Computer Science and Software Engineering, The University of Melbourne, 3010, Melbourne, Australia aut Webber William Department of Computer Science and Software Engineering, The University of Melbourne, 3010, Melbourne, Australia aut Zobel Justin School of Computer Science and Information Technology, RMIT University, 3001, Melbourne, Australia aut Baeza-Yates Ricardo Center for Web Research, Department of Computer Science, University of Chile, Santiago, Chile aut Information Retrieval Kluwer Academic Publishers 10/3(2007-06-01), 205-231 1386-4564 10:3<205 2007 10 10791 https://doi.org/10.1007/s10791-006-9014-4 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/s10791-006-9014-4 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Moffat Alistair Department of Computer Science and Software Engineering, The University of Melbourne, 3010, Melbourne, Australia aut NATIONALLICENCE 700 1- Webber William Department of Computer Science and Software Engineering, The University of Melbourne, 3010, Melbourne, Australia aut NATIONALLICENCE 700 1- Zobel Justin School of Computer Science and Information Technology, RMIT University, 3001, Melbourne, Australia aut NATIONALLICENCE 700 1- Baeza-Yates Ricardo Center for Web Research, Department of Computer Science, University of Chile, Santiago, Chile aut NATIONALLICENCE 773 0- Information Retrieval Kluwer Academic Publishers 10/3(2007-06-01), 205-231 1386-4564 10:3<205 2007 10 10791 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer