23,301 Hits in 2.5 sec

Load balancing distributed inverted files

Mauricio Marin, Carlos Gomez
2007 Proceedings of the 9th annual ACM international workshop on Web information and data management - WIDM '07  
This paper present a comparison of scheduling algorithms applied to the context of load balancing the query traffic on distributed inverted files.  ...  We avoid measuring load balance at the search engine side because this can lead to imprecise evaluation.  ...  In this sense, this paper proposes a new and low cost strategy for load balancing distributed inverted files.  ... 
doi:10.1145/1316902.1316912 dblp:conf/widm/MarenG07 fatcat:tg763relkfapzo7xlgesinn5ey

Load Balancing Distributed Inverted Files: Query Ranking

Carlos Gomez-Pantoja, Mauricio Marin
2008 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008)  
Search engines use inverted files as index data structures to speed up the solution of user queries.  ...  The index is distributed on a set of processors forming a cluster of computers and queries are received by a broker machine and scheduled for solution in the cluster.  ...  The following figures show running times for the bulksynchronous realizations of distributed inverted files.  ... 
doi:10.1109/pdp.2008.93 dblp:conf/pdp/Gomez-PantojaM08 fatcat:h3omfbcgpvffhijyubziz6zxq4

Analyzing the Load Balance of Term-based Partitioning

Ahmad Abusukhon, Mohammad Talib
2011 International Journal of Advanced Computer Science and Applications  
This provides high query throughput and concurrency but poor parallelism and load balance.  ...  Thus distributing the load equally across the nodes is very important issue. Mainly there are two methods for collection indexing, namely document-based and term-based indexing.  ...  better load balance.  ... 
doi:10.14569/ijacsa.2011.020103 fatcat:kmyeqgo45vhltgzwkvtddxzkbq

A Two-Tier Distributed Full-Text Indexing System

Wei-Zhe Zhang, Hui-Xiang Chen, Hui He, Gui Chen
2014 Applied Mathematics & Information Sciences  
Our experiments show that the system performs well in search efficiency, resource consuming and load balance.  ...  Two current inverted file partitioning schemes: document partitioning and term partitioning, have their merits individually.  ...  consuming and load balance.  ... 
doi:10.12785/amis/080139 fatcat:be2furoypjbu7lvzhtc2mo2npu

Load and storage balanced posting file partitioning for parallel information retrieval

Yung-Cheng Ma, Chung-Ping Chung, Tien-Fu Chen
2011 Journal of Systems and Software  
This primary work is load and storage balanced posting file partitioning.  ...  Issues to be dealt with are (1) load and storage balanced data allocation, and (2) popularity-based posting file partitioning model.  ...  Inverted lists are assigned to workstations according to term popularities for load balancing.  ... 
doi:10.1016/j.jss.2011.01.028 fatcat:matvtq4bazfurb654znkcogfvu

Parallel methods for the generation of partitioned inverted files

A. MacFarlane, J.A. McCann, S.E. Robertson
2005 ASLIB Proceedings  
We examine the generation of partitioned inverted files in order to speed up the process of indexing.  ...  Two types of build are investigated: local and distributed.  ...  The LI figures demonstrate that the implemented process farm method provides good load balance for indexing jobs when whole files are distributed to workers.  ... 
doi:10.1108/00012530510621888 fatcat:qxb3kjib5rd3rjgkvstd7wrr4u

Basic issues on the processing of web queries

Claudine Badue, Ramurti Barbosa, Paulo Golgher, Berthier Ribeiro-Neto, Nivio Ziviani
2005 Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '05  
Using real data and a small cluster of index servers, we study four basic and key issues related to this first phase of query processing: load balance, broker behavior, performance by individual index  ...  Our study, while preliminary, does reveal interesting tradeoffs: (1) that load unbalance at low query arrival rates can be controlled with a simple measure of randomizing the distribution of documents  ...  LOAD BALANCE To reduce load unbalance among index servers we opt for balancing the distributions of the sizes of the inverted lists that compose the local inverted files (stored locally at the index servers  ... 
doi:10.1145/1076034.1076136 dblp:conf/sigir/BadueBGRZ05 fatcat:wpgpejypm5gfbckdw52k2s5fz4

High-performance distributed inverted files

Mauricio Marin, Veronica Gil-Costa
2007 Proceedings of the sixteenth ACM conference on Conference on information and knowledge management - CIKM '07  
performance on distributed inverted files.  ...  Ne- vertheless, the load balance is sensitive to queries referring Inverted Files, Parallel and Distributed Computing  ... 
doi:10.1145/1321440.1321579 dblp:conf/cikm/MarinC07 fatcat:i4cfhsi6pjeibeue74mfur6pnq

Text-Based P2P Content Search Using a Hierarchical Architecture [chapter]

Junjie Jiang, Weinong Wang
2004 Lecture Notes in Computer Science  
As a scalable alternative to traditional server-based architecture, peer-to-peer (P2P) computing has become a popular distributed computing paradigm.  ...  Structured peer-to-peer networks achieve good scalability and high reliability, and yet they can only support a single-key based lookup instead of content search by means of DHTs (Distributed Hash Tables  ...  We use a distributed combined indexing strategy, which combines the global inverted files and the local inverted files.  ... 
doi:10.1007/978-3-540-30544-6_46 fatcat:4az373pdsbcifbcoi4ozmforxq

Balancing reducer skew in MapReduce workloads using progressive sampling

Smriti R. Ramakrishnan, Garret Swart, Aleksey Urmanov
2012 Proceedings of the Third ACM Symposium on Cloud Computing - SoCC '12  
We present a static load balancing algorithm that distributes work evenly across the reducers in a MapReduce job resulting in significant elapsed time reductions.  ...  It balances the workload using Key Chopping, to split keys with large loads into sub-keys that can be assigned to different distributive reducers, and Key Packing, to assign keys with medium loads to reducers  ...  Datapump-format files to HDFS on cluster #3; 128 reducers; 128 reduce-keys (i.e. database partitions) with Zipf(Building an inverted index on skewed data ran 2x-4x faster with load balancing.  ... 
doi:10.1145/2391229.2391245 dblp:conf/cloud/RamakrishnanSU12 fatcat:nercn4zkhzh5pfw4vbg6z6py6y

Efficient search in file-sharing networks

P. Burstein, A.J. Smith
2007 2007 International Conference on Parallel and Distributed Systems  
Skewed workloads are load balanced with the use of a layer of indirection for placing and locating data, such that data is partitioned and distributed based on the frequency of use.  ...  In this paper, we present a new and improved implementation of a distributed file-sharing system yielding (1) query result quality better than flooding and close to a centralized index, and (2) low-maintenance  ...  Section 4 addresses the issue of load balancing due to the typical non-uniformity of file sharing query and keyword distributions.  ... 
doi:10.1109/icpads.2007.4447742 dblp:conf/icpads/BursteinS07 fatcat:dl4sliyp2vdm5dsnsgjlp6bq4y

Posting file partitioning and parallel information retrieval

Yung-Cheng Ma, Tien-Fu Chen, Chung-Ping Chung
2002 Journal of Systems and Software  
The partitioning schemes are designed to balance work-load of workstations in parallel query processing without increasing the average disk access time per posting.  ...  The key issue is to partition the inverted file such that, during parallel query processing, each workstation consults only its own locally resident data to complete its task.  ...  The major concern in deriving partitioning schemes is load balancing in parallel query processing. Document ID assignment plays an important role on load balancing.  ... 
doi:10.1016/s0164-1212(01)00119-4 fatcat:yrxhl7lzjjhopejsm5nlpmuwky

A Reconfigurable Load Balancing Architecture for Molecular Dynamics

Jonathan Phillips, Matthew Areno, Chris Rogers, Aravind Dasu, Brandon Eames
2007 2007 IEEE International Parallel and Distributed Processing Symposium  
Load balancing is primarily achieved through the use of specialized processing units, referred to as FLEX units.  ...  This paper proposes a novel architecture supporting dynamic load balancing on an FPGA for a Molecular Dynamics algorithm.  ...  This completely eliminates the need for register files and register file addressing of any sort whatsoever.  ... 
doi:10.1109/ipdps.2007.370377 dblp:conf/ipps/PhillipsARDE07 fatcat:u72pfkpoobehjem4nktbmsjl4i

Load balancing for term-distributed parallel retrieval

Alistair Moffat, William Webber, Justin Zobel
2006 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '06  
In this paper we examine methods for load balancing in term-distributed parallel architectures, and propose a suite of techniques for reducing net querying costs.  ...  The index data can be distributed either by document or by term.  ...  There are several possible approaches to an even-balance distribution of inverted lists.  ... 
doi:10.1145/1148170.1148232 dblp:conf/sigir/MoffatWZ06 fatcat:42orhhlu3jazthcc76m55tx3li

A Novel control of a Grid-Interfacing Inverter to Improve the Quality of Power at PCC for a 3-Phase 4-wire DG System

V. Vijaya Lakshmi, N.V. Vinay Kumar, G.N.S. Vaibhav
2017 International Journal of Engineering Research and Applications  
With such a control, the combination of grid-interfacing inverter and the 3-phase 4-wire linear/non-linear unbalanced load at point of common coupling appears as balanced linear load to the grid.  ...  This paper presents a novel control strategy for achieving maximum benefits from these grid-interfacing inverters when installed in 3-phase 4-wire distribution systems.  ...  Fig. 6(a) shows the profile of the unbalance non-linear load currents. The grid current pro-file, when grid-interfacing inverter controlled as shunt APF, is shown in Fig. 6(b) .  ... 
doi:10.9790/9622-0705044959 fatcat:tudvzv4yxvefnm2noyq27s63uu
« Previous Showing results 1 — 15 out of 23,301 results