11,551 Hits in 6.7 sec

A distributed big data library extending Java 8

MD. A R Quadri, B. Sruthi, A. D. SriRam, B. Lavanya
2017 International Journal of Engineering & Technology  
Java is one of the finest language for big data because of its write once and run anywhere nature.  ...  Now, this paper cope with java 8 behalf of massive data and deed in distributed environment by providing extensions to the Programming model with distributed streams.  ...  Therefore, the execution time for distributed streams is also less and maximum of the time depends on the range of the input.  ... 
doi:10.14419/ijet.v7i1.1.9476 fatcat:o6i6b3xbfjathhmdqfajlyjyxy

Big data stream analysis: a systematic literature review

Taiwo Kolajo, Olawande Daramola, Ayodele Adebiyi
2019 Journal of Big Data  
We also found that although, significant research efforts have been directed to real-time analysis of big data stream not much attention has been given to the preprocessing stage of big data streams.  ...  Big data computing can be generally categorized into two types based on the processing requirements, which are big data batch computing and big data stream computing Abstract Recently, big data streams  ...  Acknowledgements The research was supported by Covenant University Centre for Research, Innovation, and Discovery (CUCRID); Landmark University, Omu-Aran, Osun State, Nigeria; The World Academy of Sciences  ... 
doi:10.1186/s40537-019-0210-7 fatcat:6llv2yxdwrdl5chehm7lxm2yru

Handling Big Data Stream Analytics using SAMOA Framework - A Practical Experience

Bakshi Rohit Prasad, Sonali Agarwal
2014 International Journal of Database Theory and Application  
We need tools to perform online data analysis on streaming data for achieving faster learning and faster response in data analytics as well as maintaining scalability in terms of huge volume of data.  ...  The daily exponential growth of data today has shifted the normal data analytics to new paradigm of Big Data Analytics and Big Data Machine Learning.  ...  Arinto Murdopo and team to illustrate the concepts of SAMOA framework that enabled us to have a practical experience in executing the sample task of SAMOA.  ... 
doi:10.14257/ijdta.2014.7.4.15 fatcat:hzxjjsi6bjbelipfo2sp7c5e6i

Parallel processing on Big Data in the context of Machine Learning and Hadoop Ecosystem: A Survey

Anilkumar Vishwanath Brahmane1, R Murugan
2018 International Journal of Engineering & Technology  
On the other hand, in Big Data perspective, customary information methods and policies are not as much of capable.  ...  Emergent Big Data applications have become gradually more essential.  ...  Useful in real time analytics. 8. Online machine learning. In comparison to flume, Storm shows better efficiency in implementing complex processing requirements by relying on the Trident API.  ... 
doi:10.14419/ijet.v7i2.7.10885 fatcat:goyvvzlwsbeifi62nrldkgp3yy

A Processing Pipeline for Cassandra Datasets Based on Hadoop Streaming

E. Dede, B. Sendir, P. Kuzlu, J. Weachock, M. Govindaraju, L. Ramakrishnan
2014 2014 IEEE International Congress on Big Data  
In this paper, we present approaches in solving the challenge of integrating NoSQL data stores with MapReduce for non-Java application scenarios, along with advantages and disadvantages of each approach  ...  Similarly, for legacy C/C++ applications and other non-Java executables, there is a need to allow NoSQL data stores access to the features of Hadoop Streaming.  ...  This is especially beneficial when real time answers are needed on only slices of the stored data.  ... 
doi:10.1109/bigdata.congress.2014.32 dblp:conf/bigdata/DedeSKWGR14 fatcat:ibv6lxm7e5awtpx67lipkft2vm

Big Data Analysis Using Apache Spark MLlib and Hadoop HDFS with Scala and Java

Hoger Khayrolla Omar, Alaa Khalil Jumaa
2019 Kurdistan Journal of Applied Research  
In this paper, some comparisons are presented about the time performance evaluation among Scala and Java in apache spark MLlib.  ...  Nowadays with the technology revolution the term of big data is a phenomenon of the decade moreover, it has a significant impact on our applied science trends.  ...  Two tests with Java have been done, one of them the data was loaded from local disk and the other the data was loaded from the HDFS.  ... 
doi:10.24017/science.2019.1.2 fatcat:hwsyu6ho5bge5hdrkfwazppuk4

Real-Time Analysis of Students' Activities on an E-Learning Platform based on Apache Spark

Abdelmajid Chaffai, Larbi Hassouni, Houda Anoun
2017 International Journal of Advanced Computer Science and Applications  
Real time analytics is the capacity to extract valuables insights from data that comes continuously from activities on the web or network sensors.  ...  They use data-mining techniques to better understand students' behavior, and most of the tools developed are based on historical and stored data, and do not allow real time reactivity.  ...  [8] lead a study where they discuss the benefits of the use of big data technologies, in order to resolve the problem of managing the massive increase in the produced data volume in educational setting  ... 
doi:10.14569/ijacsa.2017.080715 fatcat:xqi4fxf6ebc2ta7belpgp5kyti

Survey of Apache spark optimized job scheduling in big data

Walaa Khalil, Hanaa Torkey, Gamal Attiya
2020 International Journal of Industry and Sustainable Development  
Different scheduling algorithms vary with its behavior, design and also the goal required solving a problem like data locality, energy and time.  ...  The main goal in this research is to represent a comprehensive survey on job scheduling modes using in spark, the types of different scheduler, and existing algorithms with advantages and issues.  ...  Another issue of big data scheduling is data locality. Finally cost reduction in processing time in scheduling jobs in big data analysis must be taken as a goal.  ... 
doi:10.21608/ijisd.2020.73486 fatcat:q6wpxyvujrcqvongqykiunroo4

Increasing the accessibility to Big Data systems via a common services API

Rohan Malcolm, Cherrelle Morrison, Tyrone Grandison, Sean Thorpe, Kimron Christie, Akim Wallace, Damian Green, Julian Jarrett, Arnett Campbell
2014 2014 IEEE International Conference on Big Data (Big Data)  
One of the primary reasons for this is that companies have significant investments in legacy languages and systems and the process of migrating to newer (Big Data) technologies would represent a substantial  ...  Despite the plethora of polls, surveys, and reports stating that most companies are embracing Big Data, there is slow adoption of Big Data technologies, like Hadoop, in enterprises.  ...  Velocity -this considers real-time processing and analysis of large columns of data streaming in and out of an organization. 3.  ... 
doi:10.1109/bigdata.2014.7004319 dblp:conf/bigdataconf/MalcolmMGTCWGJC14 fatcat:xg6xqlzf2reczal3wgfhxgvgs4

Patterns for Distributed Real-Time Stream Processing

Pablo Basanta-Val, Norberto Fernandez-Garcia, Luis Sanchez-Fernandez, Jesus Arias-Fisteus
2017 IEEE Transactions on Parallel and Distributed Systems  
Stream processing is one of the potential application scenarios of big data systems where the goal is to process aconlinoous, high velochyflow of information items.  ...  Taking this into account, the present articl e analyzes, from the point� view of real-time systems, a set of patterns that can be used when implementing a stream processing application.  ...  ACKNOWLEDGMENTS This work been partially supported by Distributed Java Infrastructure for Real-Time Big Data (CAS14/00118).  ... 
doi:10.1109/tpds.2017.2716929 fatcat:yvlowa7icrhonbls77vlh3gj4q

Visualizing real-time GPS data with Internet's VRML Worlds

Ismo Rakkolainen, Simo Pulkkinen, Arttu Heinonen
1998 Proceedings of the sixth ACM international symposium on Advances in geographic information systems - GIS '98  
A system is presented to visualize real-time multi-user GPS position data over the Internet in a three-dimensional VRML model of a real worId place The system is the first of its kind.  ...  GPS data tells the position of a GPS user anywhere on the Earth. The position is usually shown on a 2D map. For many applications a 3D representation wouId improve the usabiIity of the data.  ...  A demo (without real-time persons walking and the server software) can be found on htt@/wwfw.dmi.tut-fi/netve/GPSdemo. The present version of VRML can't handle very big worlds smoothly.  ... 
doi:10.1145/288692.288703 dblp:conf/gis/RakkolainenPH98 fatcat:k62do56peferfaauyntzajupqy

An Improved Stream Processing Access

Utilization of the real-time data of IoT/Cloud applications are possible with collective streaming techniques of network, data processing.  ...  In this paper we are focusing on improving stream processing techniques, limitations and future research directions for real-time stream processing  ...  real-time streams of Cloud and IoT based applications.  ... 
doi:10.35940/ijitee.k1147.09811s19 fatcat:hxbafhbeabbxpigf3mystx4h6m

GridFTP based real-time data movement architecture for x-ray photon correlation spectroscopy at the Advanced Photon Source

S. Narayanan, T. J. Madden, A. R. Sandy, Raj Kettimuthu, Michael Link
2012 2012 IEEE 8th International Conference on E-Science  
The technique rides on "Big Data" and relies heavily on high performance computing (HPC) techniques.  ...  The implementation of GridFTP plugin as part of the data acquisition system at the Advanced Photon Source for real time data transfer to the HPC system for data analysis is discussed.  ...  ACKNOWLEDGMENT The authors thank Brian Tieman for the initial implementation of GridFTP data transfer at the APS and Roger Sersted for the installation and reliable maintenance of GridFTP for regular operations  ... 
doi:10.1109/escience.2012.6404466 dblp:conf/eScience/NarayananMSKL12 fatcat:jdmz3uqezndrtkedcqjkivkxc4

Lightweight Coordination Patterns for Applications of the Internet of Things

Waseem Akhtar Mufti
2020 Applied Computer Systems  
This paper applies the programming pattern for Big Data in IoT systems that makes use of lightweight Java methods, introduced in the recently published work on ClientNet Distributed Cluster.  ...  As described in earlier papers, the introduced ClientNet techniques prevent from big data transfers and streaming that occupy more resources (hardware and bandwidth) and time.  ...  If these data sets are directly transmitted to fog in real-time, then no matter how fast the network is there are chances of bottle-necks.  ... 
doi:10.2478/acss-2020-0013 fatcat:rhcrrioiwza6xkknbabyljzvju

Study of Various Internet of Things Platforms

Bhumi Nakhuva, Tushar Champaneria
2015 International Journal of Computer Science & Engineering Survey  
Devices, people and systems are connected with one another in such a way that they can communicate with each other over Internet.  ...  Variety of platforms are now a days available that can support entire development to deployment of IoT applications and systems.  ...  ACKNOWLEDGEMENTS The author would like to thank Prof. T.A.Champaneria for his continuous guidance and encouragement through the work. Figure 10 . Axeda IoT stack [28]  ... 
doi:10.5121/ijcses.2015.6605 fatcat:pr2d7d7atrfvbgfnsxwjxlfpm4
« Previous Showing results 1 — 15 out of 11,551 results