20,308 Hits in 6.8 sec

An Efficient Distributed Data Processing Method for Smart Environment

C. Hemanth Kumar, A. Siva Sangari
2016 Indian Journal of Science and Technology  
This study illuminates the high velocity streaming data set on a database without losing any data from the streaming domain, to support Adhoc Querying from the data set and to provide a mechanism for fast  ...  data processing and analytics using Large Scale Machine Learning.  ...  domains and does not provide any feature for storage of large amount of data and real time analytics which is called as Big Data Problem.  ... 
doi:10.17485/ijst/2016/v9i31/95172 fatcat:jbni722vabhqliq2edcv37mi7m

Design Approach to Big data Systems in Developing and Maintaining the Information Security Systems

Dr.Mani Sarma Vittapu
2016 IOSR Journal of Computer Engineering  
Proposed design generic systems that can provide near real-time analytic services for many netease applications, such as spam detection, game log analysis and social community mining.  ...  In this paper, developing and maintaining the information security system to illustrate how those big data systems evolve and also describes some key design factors and challenges for future big data systems  ...  , and real-time query processing for online analytics, and in-stream processing for continuous querying.  ... 
doi:10.9790/0661-1805036870 fatcat:iixpvp7yr5bs7fea34ejyusnei

A Survey on Data Analytics Framework

Sharmila Begum M, George A
2017 International Journal of Engineering and Technology  
In recent years, much interest in developing Data analytics tools has been mainly intense on exploring and understanding massive data formats in social media and growing internet.  ...  In this survey work, we present a comprehensive overview of the Data analytics tools, their merits and challenges.  ...  Real time insertion and deletion is not available in Citus DB and also it does not support real time analytics. B.  ... 
doi:10.21817/ijet/2017/v9i3/170903010 fatcat:42sbcexk6nhb3kow26rfxvb6pu

Parallel processing on Big Data in the context of Machine Learning and Hadoop Ecosystem: A Survey

Anilkumar Vishwanath Brahmane1, R Murugan
2018 International Journal of Engineering & Technology  
On the other hand, in Big Data perspective, customary information methods and policies are not as much of capable.  ...  As an effect, different categories of packages, distributions and technologies have been developed. In this paper an evaluation is done, this studies recent technologies developed for Big Data.  ...  Thus researchers need to find new ways to optimize analytical techniques, to process data instances in very limited amount of time with lim-ited resources (i.e., memory) and to produce in real-time accurate  ... 
doi:10.14419/ijet.v7i2.7.10885 fatcat:goyvvzlwsbeifi62nrldkgp3yy

Implementing a Volunteer Notification System into a Scalable, Analytical Realtime Data Processing Environment [chapter]

Jesko Elsner, Tomas Sivicki, Philipp Meisen, Tobias Meisen, Sabina Jeschke
2016 Automation, Communication and Cybernetics in Science and Engineering 2015/2016  
This paper will focus on a basic concept for implementing a VNS approach into a scalable, fault-tolerant environment that uses state-of-the-art analytical tools to process information streams in real-time  ...  In emergency scenarios, the velocity, low latency and reaction times of the system are essential, which results in the need of online stream-processing and real-time computational solutions.  ...  ACKNOWLEDGMENT This paper is based on work done in the INTERREG IVa project EMuRgency (  ... 
doi:10.1007/978-3-319-42620-4_64 fatcat:pd2nu6qe5ffb3m76hoctaimfse

Big Data Analytics: A Perspective View

Suman Pandey
2017 International Journal of Advanced Research in Computer Science and Software Engineering  
The process of diving into large amounts of data to discover patterns and disguised correlations is named as big data analytics.  ...  Big data analytics challenges the situation of the present infrastructure of data storage management and also statistical data estimation.  ...  The new release of SQLstream s-Server 3.0 performs better in real-time data collection, transformation, sharing and supporting real-time Big data management and analytics.  ... 
doi:10.23956/ijarcsse/sv7i5/0237 fatcat:mq75vo3n4rbihnc43mtpktzrru

Engineering Scalable Distributed Services for Real-Time Big Data Analytics

Sahar Jambi, Kenneth M. Anderson
2017 2017 IEEE Third International Conference on Big Data Computing Service and Applications (BigDataService)  
In particular, I focus on providing analysts flexibility with respect to the types of queries they can make on large data sets, in real time as well as over historical data.  ...  This thesis would not have been possible without his big support, kindness, and patience.  ...  I identify a set of concepts to make real-time and batch queries easy to create and deploy in a big data analytics environment.  ... 
doi:10.1109/bigdataservice.2017.22 dblp:conf/bigdataservice/JambiA17 fatcat:ffx657klkbbqvnv7v6yztb6tfi

I-BiDaaS Final Event

Sotiris Ioannidis, Nuria De Lama, Dusan Jakovetic, Ramon Martin De Pozuelo, Ioannis Arapakis, Giuseppe Danilo Spennacchio, Vassilis Chatzigiannakis, Hernan Ruiz Ocampo, Despina Kopanaki
2020 Zenodo  
Watch the I-BiDaaS Final Event recording: Welcome and Introduction - Despina Kopanaki (FORTH) Keynote: A 5-years journey through the European Big Data Landscape - Nuria de Lama (Atos Research & Innovation  ...  After three years of research and innovation, the I-BiDaaS project partners were delighted to share the main results in a free online event that was held on the 21st of December 2020.  ...  business opportunities (support data sharing, exchange, and interoperability) Construct a safe environment for methodological big data experimentation, for the development of new products, services, and  ... 
doi:10.5281/zenodo.4384639 fatcat:iobhc3e7breprdornnetsrg4fm

Development of real-time big data analysis system for RHIPE-based marketing in the automobile industry

Young-Woon Kim, Hyeopgeon Lee
2018 International Journal of Engineering & Technology  
Among the methods that interconnect Hadoop and R, the R and Hadoop integrated programming environment (RHIPE) was developed in this study as a real-time big data analysis system for marketing in the automobile  ...  In this study, we developed a real-time big data analysis system that can analyze the orders, reservations, and maintenance history contained in big data using the RHIPE method.  ...  Furthermore, the big data stored in MongoDB must be extracted and aggregated for real-time big data analysis.  ... 
doi:10.14419/ijet.v7i3.33.21022 fatcat:gzcj74ijjveovkm6pyhlf5enuy

Hybrid Transactional/Analytical Processing

Fatma Özcan, Yuanyuan Tian, Pinar Tözün
2017 Proceedings of the 2017 ACM International Conference on Management of Data - SIGMOD '17  
These applications require distributed data management systems that can handle fast concurrent transactions (OLTP) and analytics on the recent data.  ...  The popularity of large-scale real-time analytics applications (real-time inventory/pricing, recommendations from mobile apps, fraud detection, risk analysis, IoT, etc.) keeps rising.  ...  Recent years have seen the need for more real-time analytics.  ... 
doi:10.1145/3035918.3054784 dblp:conf/sigmod/OzcanTT17 fatcat:pvhwsr327jaunfdnhwotywguuu

Big Data Pilot Demo Days: I-BiDaaS Application to the Manufacturing Sector Webinar

Dusan Jakovetic, Giuseppe Danilo Spennacchio
2020 Zenodo  
The main goal of this big data pilot webinar was to demonstrate in a step by step fashion the I-BiDaaS self-service solution and its application to the manufacturing sector.  ...  Hosted by BDV PPP, BigDataStack, I-BiDaaS, Track & Know and Policy Cloud joined forces in a series of online demonstrations of innovative Big Data Technologies unlocking the potential of various applications  ...  We can choose how many items per page to visualise Production Process of Aluminium Die Casting -demo We can visualise in real time and quickly the sequence of engine block with their level of classification  ... 
doi:10.5281/zenodo.3944664 fatcat:hi6bjyrvwfazxfnqtrrjykze54

Complex Power System Status Monitoring and Evaluation Using Big Data Platform and Machine Learning Algorithms: A Review and a Case Study

Yuanjun Guo, Zhile Yang, Shengzhong Feng, Jinxing Hu
2018 Complexity  
Based on a comprehensive study of power system and Big Data, several challenges are summarized to unlock the potential of Big Data technology in the application of smart grid.  ...  Numerous open-sourced Big Data analytical tools and software are integrated as modules of the analytic engine, and self-developed advanced algorithms are also designed.  ...  Acknowledgments This work is supported by the National Natural Science Foundation of China (51607177, 61433012, and U1435215), Shenzhen Science and Technology Innovation Commission application demonstration  ... 
doi:10.1155/2018/8496187 fatcat:2esxs54ixjbx7ijvct7hbffyji

Data centric computing for internet scale enterprises

Yuqing Gao
2013 Proceedings of the ACM/SPEC international conference on International conference on performance engineering - ICPE '13  
of analytics ■ Intelligent decision-making using: "Mobile+Cloud+Analytics+Big Data" in context of transactions -Analytics become embedded and pervasive ■ Desire to have a large, low latency, "In  ...  • Real-time Fleet Optimization System • Real-time Consumer Engagements • Low-latency B2B Interaction • Perfect scalability entails linear throughput increase and constant latency up to hardware limits  ...  Peers directly read and write the data at the end of the pointers using RDMA Remote pointers & one-sided RDMA  A server can export a remote pointer that refers to a data record in a pinned & registered  ... 
doi:10.1145/2479871.2479924 dblp:conf/wosp/Gao13 fatcat:74ooahyt5rannjuywj3nv3zwoq

Construing the big data based on taxonomy, analytics and approaches

Ajeet Ram Pathak, Manjusha Pandey, Siddharth Rautaray
2018 Iran Journal of Computer Science  
Big data have become an important asset due to its immense power hidden in analytics.  ...  Every organization is inundated with colossal amount of data generated with high speed, requiring high-performance resources for storage and processing, special skills and technologies to get value out  ...  By and large, deep learning has been applied to address significant problems in big data analytics such as semantic analysis, topic modeling, classification tasks, fast querying, real time analysis, and  ... 
doi:10.1007/s42044-018-0024-3 fatcat:teiovluolngepjyebzz2wnwjxu

FAST: Near Real-Time Searchable Data Analytics for the Cloud

Yu Hua, Hong Jiang, Dan Feng
2014 SC14: International Conference for High Performance Computing, Networking, Storage and Analysis  
for real-time data analytics.  ...  FAST supports several types of data analytics, which can be implemented in existing searchable storage systems.  ...  Architecture of Use Case FAST supports a fast and cost-effective scheme for near real-time data analytics.  ... 
doi:10.1109/sc.2014.67 dblp:conf/sc/HuaJF14 fatcat:fphoqrga7bekvfit3d7f5pr75a
« Previous Showing results 1 — 15 out of 20,308 results