Filters








864 Hits in 2.5 sec

An Elastic Middleware Platform for Concurrent and Distributed Cloud and MapReduce Simulations [article]

Pradeeban Kathiravelu
2016 arXiv   pre-print
The dynamic scaler solution scales out the cloud and MapReduce simulations to multiple nodes running Hazelcast and Infinispan, based on load.  ...  While computing has been evolving with multi-core programming, MapReduce paradigms, and middleware platforms, cloud and MapReduce simulations still fail to exploit these developments themselves.  ...  Multi-Agent Situated System (MMASS)-Based Simulations: Muli-agent systems consist of multiple agents, which are virtual or physical entities that can perceive their environment and act according to the  ... 
arXiv:1601.03980v1 fatcat:zvwhhhha4fbv3akgqru4wmjdfy

Handling big data on agent-based modeling of Online Social Networks with MapReduce

Maira A. de C. Gatti, Marcos R. Vieira, Joao Paulo F. de Melo, Paulo Rodrigo Cavalin, Claudio Santos Pinhanez
2014 Proceedings of the Winter Simulation Conference 2014  
In this context, stochastic multi-agent based simulation can be employed to reproduce the behavior observed in OSNs.  ...  To tackle the above challenges, this paper proposes a MapReduce-based method to build a modeler to handle big data.  ...  In this case, the data is used as an input for the multi-agent-based simulator on which what-if analysis can be performed. The User Behavior Modeler encapsulates the MapReduce solution.  ... 
doi:10.1109/wsc.2014.7019946 dblp:conf/wsc/GattiVMCP14 fatcat:y7ipbzcwinaahfb7kai2cep4dq

Behavioral simulations in MapReduce

Guozhang Wang, Marcos Vaz Salles, Benjamin Sowell, Xun Wang, Tuan Cao, Alan Demers, Johannes Gehrke, Walker White
2010 Proceedings of the VLDB Endowment  
In this paper we present BRACE (Big Red Agent-based Computation Engine), which extends the MapReduce framework to process these simulations efficiently across a cluster.  ...  In our experiments we achieve nearly linear scale-up on several realistic simulations.  ...  This paper proposes to close this gap by bringing database-style programmability and scalability to agent-based simulations.  ... 
doi:10.14778/1920841.1920962 fatcat:rudngn4rl5bznlhenqvhmoe42q

Behavioral Simulations in MapReduce [article]

Guozhang Wang, Marcos Vaz Salles, Benjamin Sowell, Xun Wang, Tuan Cao, Alan Demers, Johannes Gehrke, Walker White
2010 arXiv   pre-print
In this paper we present BRACE (Big Red Agent-based Computation Engine), which extends the MapReduce framework to process these simulations efficiently across a cluster.  ...  In our experiments we achieve nearly linear scale-up on several realistic simulations.  ...  This material is based upon work supported by the New York State Foundation for Science, Technology, and Innovation under Agreement C050061, by the National Science Foundation under Grants 0725260 and  ... 
arXiv:1005.3773v1 fatcat:ejqyfmuvmjbb5hcj4pcvy7hhoe

Cloud Implementation Of Agent-Based Simulation Model In Evacuation Scenarios

Andrzej Wilczynski, Joanna Kolodziej
2016 ECMS 2016 Proceedings edited by Thorsten Claus, Frank Herrmann, Michael Manitz, Oliver Rose  
The simulation is executed as a stream-based dataprocessing operation to enable environmental universality while taking advantage of the MapReduce model.  ...  is modelled. by cell automata and interpreted as a potential field, in which technologies the generated agents are located with using multi-agent.  ...  The multi-agent simulation module is used for simulations of the crowd behavior and decisions in emergency situations. It is based on the MapReduce architecture and runs on a Hadoop cluster.  ... 
doi:10.7148/2016-0641 dblp:conf/ecms/WilczynskiK16 fatcat:yxjdb2ksr5hyhira6lfxpq7uly

D3-MapReduce: Towards MapReduce for Distributed and Dynamic Data Sets

Haiwu He, Anthony Simonet, Julio Anjos Jose-Francisco Saray, Gilles Fedak, Bing Tang, Lu Lu, Xuanhua Shi, Hai Jin, Mircea Moca, Gheorghe Cosmin Silaghi, Asma Ben Cheikh, Heithem Abbes
2015 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity)  
Second, we outline the challenges in term of methodology and present our approaches based on simulation and emulation on the Grid'5000 experimental testbed.  ...  We present the architecture of the prototype based on BitDew, a middleware for large scale data management, and Active Data, a programming model for data life cycle management.  ...  We developed a dedicated simulator for hybrid MapReduce environment based on the SimGrid framework.  ... 
doi:10.1109/smartcity.2015.141 dblp:conf/smartcity/HeSSFTLSJMSCA15 fatcat:er5vyaxk7vgqpmqqiofqovajzq

MapReduce: A Technical Review

T. Y. J. Naga Malleswari, G. Vadivu
2016 Indian Journal of Science and Technology  
MapReduce based Pre-Post (MRPre-Post) a parallel data mining algorithm is adapted in Hadoop platform to achieve scalability.  ...  MapReduce is implemented in vHadoop (Virtual Hadoop), a scalable hadoop virtual cluster to process machine learning algorithms.  ...  Phoenix++ 19 , a single host, multi-core MapReduce framework is used in the implementation. Pilot-MapReduce PMR 20 is an independent runtime environment on flexible infrastructure for MapReduce.  ... 
doi:10.17485/ijst/2016/v9i1/78964 fatcat:ewly2owceraszhv6qx32jootma

Pilot-Abstraction: A Valid Abstraction for Data-Intensive Applications on HPC, Hadoop and Cloud Infrastructures? [article]

Andre Luckow, Pradeep Mantha, Shantenu Jha
2015 arXiv   pre-print
While there are many powerful computational and analytical libraries available on HPC (e.g. for scalable linear algebra), they generally lack the usability and variety of analytical libraries found in  ...  With science moving toward data-driven discoveries relying more on correlations in data to form scientific hypotheses, the limitations of HPC approaches become apparent: Architectural paradigms such as  ...  The term "fourth paradigm" [2] refers to scientific discovery based on data in addition to theory, experimentation and simulation based discovery.  ... 
arXiv:1501.05041v1 fatcat:eiu3inxk7bblrcoh7orjkrimjq

Obtaining Good Heuristics for Big Data Broadcasting Problem Using Novel Pipeline Approach

Prof. Priyadarshani Kalokhe
2016 International Journal Of Engineering And Computer Science  
An Agent-Based Approach for Modeling Peer to Peer Networks This article has demonstrated how the use of ABM tools such as Net Logo can indeed provide many advantages over classical Peer-to-Peer simulation  ...  These agents can be either individual or collective entities such as organizations or groups. In this section, an introduction to Agent-Based Modeling will be provided.  ... 
doi:10.18535/ijecs/v5i12.20 fatcat:okrw4enjzvhb7e4hudyqtzswha

ICDE conference 2015 detailed author index

2015 2015 IEEE 31st International Conference on Data Engineering  
: A MapReduce-Based System for Querying and Visualizing Satellite Data 1585 SHAHED: A MapReduce-Based System for Querying and Visualizing Spatio-Temporal Satellite Data Eleftheriou, Evangelos 1328  ...  of Shahed: A MapReduce-Based System for Querying and Visualizing Satellite Data 1585 SHAHED: A MapReduce-Based System for Querying and Visualizing Spatio-Temporal Satellite Data [Search] A B C  ... 
doi:10.1109/icde.2015.7113260 fatcat:ep7pomkm55f45j33tkpoc5asim

Hadoop on HPC: Integrating Hadoop and Pilot-based Dynamic Resource Management [article]

Andre Luckow and Ioannis Paraskevakos and George Chantzialexiou and Shantenu Jha
2016 arXiv   pre-print
This is an important step that allows applications to integrate HPC stages (e.g. simulations) to data analytics.  ...  Whereas this questions needs answers at multiple levels, we focus on the design of resource management middleware that might support the needs of both.  ...  Fig. 6 : 6 RADICAL-Pilot and YARN-based K-Means on Stampede and Wrangler RADICAL-Pilot speedup of 2.4 (both on Wrangler and compared to base case of 8 tasks).  ... 
arXiv:1602.00345v1 fatcat:iyrqqxv4xjdwbdcwil2v23rfom

Towards an Understanding of Facets and Exemplars of Big Data Applications

Geoffrey C. Fox, Shantenu Jha, Judy Qiu, Andre Luckow
2015 Proceedings of the 20 Years of Beowulf Workshop on Honor of Thomas Sterling's 65th Birthday - Beowulf '14  
HPC 5 Classic large-scale simulation of cosmos, materials, etc. generating (visualization) data Agent 2 Simulations of models of data-defined macroscopic entities represented as agents Abbreviation #  ...  However the Classic MapReduce architecture (10.2) is a major big data paradigm but much less common in simulations with one example between the execution of multiple simulations (as in Quantum Monte Carlo  ...  Multiple users performing interactive queries and updates on a database with basic availability and eventual consistency (BASE); Perform real time analytics on data source streams and notify users when  ... 
doi:10.1145/2737909.2737912 fatcat:ysa23hgfwna6nfuhyej4rebu2a

A Survey of Big Data Machine Learning Applications Optimization in Cloud Data Centers and Networks [article]

Sanaa Hamid Mohamed, Taisir E.H. El-Gorashi, Jaafar M.H. Elmirghani
2019 arXiv   pre-print
The MapReduce programming model and its widely-used open-source platform; Hadoop, are enabling the development of a large number of cloud-based services and big data applications.  ...  MapReduce and Hadoop thus introduce innovative, efficient, and accelerated intensive computations and analytics.  ...  data centers and efficient system upgrade Multi-tier web applications Meta-heuristic based on Simulated annealing Synthesized traces Simulations for data center networks with heterogeneous  ... 
arXiv:1910.00731v1 fatcat:kvi3br4iwzg3bi7fifpgyly7m4

Scientific Big Data Visualization: a coupled tools approach

2014 Supercomputing Frontiers and Innovations  
We find good scalability and response times.  ...  This makes our system most useful when permanently installed on a dedicated cluster.  ...  The Alya system Alya is the BSC in-house HPC-based multi-physics simulation code.  ... 
doi:10.14529/jsfi140301 fatcat:tiutnnjbgfe4pawbplw4fqkovi

A cloud-based approach for Gene Regulatory Networks dynamics simulations

Alessandro Vasciaveo, Alfredo Benso, Stefano Di Carlo, Gianfranco Politano, Alessandro Savino, Fabrizio Bertone, Giuseppe Caragnano, Olivier Terzo
2015 2015 4th Mediterranean Conference on Embedded Computing (MECO)  
Thus, we exploit the MapReduce algorithm in order to cope this complexity on a cloud architecture built for the purpose.  ...  We found that scaling-out the problem is a better solution rather than increasing resources on single machine, thus allowing simulations of large networks.  ...  This goal is reached through a cloud architecture based upon the well-know MapReduce algorithm.  ... 
doi:10.1109/meco.2015.7181869 dblp:conf/meco/VasciaveoBCPSBC15 fatcat:gwed4z5sjbgkdly5ryr7lnnh54
« Previous Showing results 1 — 15 out of 864 results