Filters








455 Hits in 3.3 sec

Characterization of Hadoop Jobs Using Unsupervised Learning

Sonali Aggarwal, Shashank Phadke, Milind Bhandarkar
<span title="">2010</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/vf7glygozrdhdkhluhlxpb7j4q" style="color: black;">2010 IEEE Second International Conference on Cloud Computing Technology and Science</a> </i> &nbsp;
• Extract "features" • Determine number of job clusters • Find centroids of job clusters • Fetch Job metrics, and Job configurations (job.xml) • Micro benchmarks • Sort • TestDFSIO • SmallJobs • NNBench  ...  Benchmarking Hadoop - Part 2 • Application Kernels -GridMix -1 • Most common "real" applications • Machine Learning, ETL, Graph Algorithms • Synthetic data GridMix • GridMix Version 2 • GridMix  ...  Task Counters Job Metrics  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/cloudcom.2010.20">doi:10.1109/cloudcom.2010.20</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/cloudcom/AggarwalPB10.html">dblp:conf/cloudcom/AggarwalPB10</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/47qvce5tifflrg4yxo3lqi3imq">fatcat:47qvce5tifflrg4yxo3lqi3imq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170829141024/http://salsahpc.indiana.edu/CloudCom2010/slides/PDF/Characterization%20of%20Hadoop%20Jobs%20using%20Unsupervised%20Learning.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/64/84/648474013f5db2ba71653abbd8d1c0b4ca667f3c.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/cloudcom.2010.20"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

Scaling the iHMM: Parallelization versus Hadoop

Sébastien Bratières, Jurgen van Gael, Andreas Vlachos, Zoubin Ghahramani
<span title="">2010</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/eksz6udvbjavvlbt4ho3tdsi6q" style="color: black;">2010 10th IEEE International Conference on Computer and Information Technology</a> </i> &nbsp;
We apply this model to learn part-of-speech tags from newswire text in an unsupervised fashion.  ...  This paper compares parallel and distributed implementations of an iterative, Gibbs sampling, machine learning algorithm. Distributed implementations run under Hadoop on facility computing clouds.  ...  ACKNOWLEDGMENT The authors would like to thank Amazon Education Services for a generous grant to use the Amazon Web Services. Jurgen Van Gael is supported by a Microsoft Research Scholarhsip.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/cit.2010.223">doi:10.1109/cit.2010.223</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/IEEEcit/BratieresGVG10.html">dblp:conf/IEEEcit/BratieresGVG10</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/emnqkwbxhzhd7dgpmq5e46lrwa">fatcat:emnqkwbxhzhd7dgpmq5e46lrwa</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20121114224159/http://www.cl.cam.ac.uk/~av308/smla10.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/37/ef/37ef7941909527aaf123d7b8f90adbf4606f4917.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/cit.2010.223"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

A Review: Predictive Analytics with Big Data

Mr. Rizwanahmed B. Mujawar, Dr. Dinesh B. Kulkarni
<span title="2017-03-30">2017</span> <i title="Tejass Publisheers"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ezm4lr6uezhi5pfgr6xkdexmgy" style="color: black;">IJARCCE</a> </i> &nbsp;
This paper also gives an insight how big data can be analyzed using predictive analytics method by exploiting the potential of Hadoop/Map-Reduce tool.  ...  Businesses and researchers alike take great interests in furthering the use of Predictive Analytics in enhancing Business Intelligence and forecasting ability across a wide range of applications.  ...  ACKNOWLEDGMENT We sincerely thank all the authors, whose papers are in the area of Predictive Analytics and Big Data Analytics. Also, we would like to thank, Mr.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.17148/ijarcce.2017.63124">doi:10.17148/ijarcce.2017.63124</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/e2oyzsp2r5g6rj6r7k7trdgc5u">fatcat:e2oyzsp2r5g6rj6r7k7trdgc5u</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180602162016/https://ijarcce.com/upload/2017/march-17/IJARCCE%20124.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/74/ce/74ce327741d2397526a997b4dbf41f0c677abb21.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.17148/ijarcce.2017.63124"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a>

Discussion on Big Data: TDFS Vs HDFS

<span title="2019-11-30">2019</span> <i title="Blue Eyes Intelligence Engineering and Sciences Engineering and Sciences Publication - BEIESP"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/3sfifsouvjgadp4gfj54u3z2ku" style="color: black;">International journal of recent technology and engineering</a> </i> &nbsp;
Because cost reduction, faster, and better decision making using Hadoop.  ...  Benefits of HDFS has support for flume tool in Hadoop comparing with TDFS. Memory block size data retrieving time and security are used as metrics in evaluating the performance of TDFS and HDFS.  ...  Machine learning techniques are supervised learning, unsupervised learning and semi-supervised learning.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.35940/ijrte.d9497.118419">doi:10.35940/ijrte.d9497.118419</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/kvovbqhhtvdfbiow7rzoxotewe">fatcat:kvovbqhhtvdfbiow7rzoxotewe</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20191224013509/https://www.ijrte.org/wp-content/uploads/papers/v8i4/D9497118419.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/14/8e/148e9e1208a9ca7c58804f844cd553780127defb.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.35940/ijrte.d9497.118419"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> Publisher / doi.org </button> </a>

Automatic Generation of Workload Profiles Using Unsupervised Learning Pipelines

David Buchaca Prats, Josep Lluis Berral, David Carrera
<span title="">2018</span> <i title="Institute of Electrical and Electronics Engineers (IEEE)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/iouxmlaqyjgpnp3dp5ddv4d2um" style="color: black;">IEEE Transactions on Network and Service Management</a> </i> &nbsp;
We use these methods to find phases of similar behaviour in the workloads.  ...  CRBMs can be used to map a given given historic window of trace behaviour into a single vector.  ...  Their unsupervised learning methodology uses the minimum phase length as hyper-parameters, rather than determining the number of expected phases to be found.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/tnsm.2017.2786047">doi:10.1109/tnsm.2017.2786047</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/idlfldnoxnbufjnu2si4dljj4q">fatcat:idlfldnoxnbufjnu2si4dljj4q</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180724013824/https://upcommons.upc.edu/bitstream/handle/2117/113596/08240924-1.pdf;jsessionid=4BFEF407552FB554D9319EEF5ADD717F?sequence=4" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/e0/0f/e00f958d62b5d334ceea84ceae43b13fdfe12c19.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/tnsm.2017.2786047"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

An Efficient Clustering Algorithm with Enhanced MapReduce Design based Modified K Means for Outlier Detection

Arjun Singh Thakur
<span title="2020-09-30">2020</span> <i title="International Journal for Research in Applied Science and Engineering Technology (IJRASET)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/hsp44774azcezeyiq4kuzpfh5a" style="color: black;">International Journal for Research in Applied Science and Engineering Technology</a> </i> &nbsp;
With an increase in amount of data also the speed of access to information has increased.  ...  The results are offered in tables and graphs using sample dataset.  ...  Slave node of job tracker also has task trackers. 3) Kmeans Clustering: K means clustering is an unsupervised learning algorithm of data mining which is used to categorize semi structured or unstructured  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.22214/ijraset.2020.31679">doi:10.22214/ijraset.2020.31679</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/xji3d4w5hrcijni3h5goflalui">fatcat:xji3d4w5hrcijni3h5goflalui</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20201005103112/http://ijraset.com/fileserve.php?FID=31679" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.22214/ijraset.2020.31679"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> Publisher / doi.org </button> </a>

LogM: Log Analysis for Multiple Components of Hadoop Platform

Yuxia Xie, Kai Yang, Pan Luo
<span title="">2021</span> <i title="Institute of Electrical and Electronics Engineers (IEEE)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/q7qi7j4ckfac7ehf3mjbso4hne" style="color: black;">IEEE Access</a> </i> &nbsp;
As a newly added framework in Hadoop 2.0, YARN is responsible for the management of cluster resources and job scheduling.  ...  By using the end-to-end model, LogM can automatically learn from the historic system logs and forecast whether a failure will occur afterwards. 4) LogM adopts the knowledge graph to characterize the relationships  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/access.2021.3076897">doi:10.1109/access.2021.3076897</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/g3xen2dhejb5niyxwepmuob3r4">fatcat:g3xen2dhejb5niyxwepmuob3r4</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210718025850/https://ieeexplore.ieee.org/ielx7/6287639/6514899/09420108.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/f0/e5/f0e52b448716d966a9165d8dc47a4c074f1269e9.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/access.2021.3076897"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> ieee.com </button> </a>

Online Credit Card Fraud Detection: A Hybrid Framework with Big Data Technologies

You Dai, Jin Yan, Xiaoxin Tang, Han Zhao, Minyi Guo
<span title="">2016</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/yaqmt4o5gzav5ivi6pnbkjqdui" style="color: black;">2016 IEEE Trustcom/BigDataSE/ISPA</a> </i> &nbsp;
We implement it with latest big data technologies like Hadoop, Spark, Storm, HBase, etc.  ...  A prototype is implemented and tested with a synthetic dataset, which shows great potentials of achieving the above goals.  ...  This work is partially sponsored by the National Basic Research 973 Program of China (No.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/trustcom.2016.0253">doi:10.1109/trustcom.2016.0253</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/trustcom/DaiYTZG16.html">dblp:conf/trustcom/DaiYTZG16</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/hv6kxgnperehblz4vlvx7dzfzq">fatcat:hv6kxgnperehblz4vlvx7dzfzq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180920144413/http://www.cs.sjtu.edu.cn:80/~guo-my/PDF/Conferences/C1610.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/be/b1/beb1915b2e7cea34dfe47945bdf52e2472f3694f.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/trustcom.2016.0253"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

A Hadoop based Maching Learning Technique for Semantic Indexing of Learning Objects in Big Data Environment

Kamal EL GUEMMAT, Hassan II University, Casablanca, Morocco
<span title="2019-10-15">2019</span> <i title="The World Academy of Research in Science and Engineering"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/naqzxq5hurh2bp2pnvwitnnx44" style="color: black;">International Journal of Advanced Trends in Computer Science and Engineering</a> </i> &nbsp;
Our solution is used to answer this problem through various techniques of HADOOP for BIG DATA and MACHINE LEARNING.  ...  This set of treatment is possible via different machine learning techniques which is interested in automatically learning the treatments so take into account the old experiences.  ...  Learning can be characterized in several dimensions: nature of learning feedback supervised learning, unsupervised learning, and reinforcement learning, target of learning tasks (representation, task)  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.30534/ijatcse/2019/63852019">doi:10.30534/ijatcse/2019/63852019</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/mfddamza7fhddbnjwwx6oorpoy">fatcat:mfddamza7fhddbnjwwx6oorpoy</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20220303003440/http://www.warse.org/IJATCSE/static/pdf/file/ijatcse63852019.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/5e/41/5e41c02d45b821530127c38365d7f22418ec9573.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.30534/ijatcse/2019/63852019"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a>

Big Data Mining: Tools & Algorithms

Adeel Shiraz Hashmi, Tanvir Ahmad
<span title="2016-03-29">2016</span> <i title="International Association of Online Engineering (IAOE)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/foztoplv6nfbzl5yokd2iqt7ce" style="color: black;">International Journal of Recent Contributions from Engineering, Science &amp; IT</a> </i> &nbsp;
The data mining tools and algorithms which can handle big data have also been summarized, and one of the tools has been used for mining of large datasets using distributed algorithms.  ...  This paper surveys the available tools which can handle large volumes of data as well as evolving data streams.  ...  Hive converts the HiveQL queries into a series of Map-Reduce jobs. But HiveQL has limited capability and can't be used to perform complex operations.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.3991/ijes.v4i1.5350">doi:10.3991/ijes.v4i1.5350</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/ezumvjhrhnbfbamy6xlgz7dztm">fatcat:ezumvjhrhnbfbamy6xlgz7dztm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180719033850/http://online-journals.org/index.php/i-jes/article/download/5350/3831" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/92/4f/924f9e70a4a1e7c54aa27e1fad548fc58c85d318.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.3991/ijes.v4i1.5350"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> Publisher / doi.org </button> </a>

Big Data Analytics: Importance, Challenges, Categories, Techniques, and Tools

Sarah Alswedani
<span title="2020-08-25">2020</span> <i title="The World Academy of Research in Science and Engineering"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/naqzxq5hurh2bp2pnvwitnnx44" style="color: black;">International Journal of Advanced Trends in Computer Science and Engineering</a> </i> &nbsp;
used for handling this complexity such as Hadoop, Spark, and Storm.  ...  This paper explores the importance of big data analytics for different domains, the challenges of utilizing big data analytics due to the complex nature of big data, and the technical approaches that are  ...  It is using unsupervised learning for generating representations that can then be used for training a classifier using supervised training.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.30534/ijatcse/2020/17">doi:10.30534/ijatcse/2020/17</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/wnd4pn5b6fazbfwzhajtlm6qvy">fatcat:wnd4pn5b6fazbfwzhajtlm6qvy</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200919011026/http://www.warse.org/IJATCSE/static/pdf/file/ijatcse174942020.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.30534/ijatcse/2020/17"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a>

Performance characterization and analysis for Hadoop K-means iteration

Joseph Issa
<span title="2016-03-17">2016</span> <i title="Springer Nature"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/t5xopidd6nfk7cgyceba77n2xe" style="color: black;">Journal of Cloud Computing: Advances, Systems and Applications</a> </i> &nbsp;
In this paper, we implement a detailed performance analysis and characterization for Hadoop K-means iterations by scaling different processor micro-architecture parameters and comparing performance using  ...  This leads to the analysis of the underlying hardware in a cloud cluster servers to enable optimization of software and hardware to achieve maximum performance possible.  ...  In "Performance Characterization using Intel Xeon Based Platform" section we present a detailed performance characterization of Hadoop K-means for different key processor architecture parameters using  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1186/s13677-016-0053-0">doi:10.1186/s13677-016-0053-0</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/h7y4zeq7qrdnppl7xtirppfkea">fatcat:h7y4zeq7qrdnppl7xtirppfkea</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20171015062519/http://publisher-connector.core.ac.uk/resourcesync/data/Springer-OA/pdf/81d/aHR0cDovL2xpbmsuc3ByaW5nZXIuY29tLzEwLjExODYvczEzNjc3LTAxNi0wMDUzLTAucGRm.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/aa/61/aa611707c5ea9d30eba199570e15a27fa422406c.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1186/s13677-016-0053-0"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> springer.com </button> </a>

Big Data Analytics for Detecting Host Misbehavior in Large Logs

Daniel Goncalves, Joao Bota, Miguel Correia
<span title="">2015</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/yaqmt4o5gzav5ivi6pnbkjqdui" style="color: black;">2015 IEEE Trustcom/BigDataSE/ISPA</a> </i> &nbsp;
We use machine learning and data mining techniques to analyze the data and semi-automatically discover misbehaving hosts, without having to instruct the system about how hosts misbehave.  ...  The paper presents a novel approach to assess the security of such an infrastructure using its logs, inspired on data from a real telecommunications network.  ...  We use an unsupervised machine learning technique denominated clustering. The idea of clustering is to group related entities based on a set of features.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/trustcom.2015.380">doi:10.1109/trustcom.2015.380</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/trustcom/GoncalvesBC15.html">dblp:conf/trustcom/GoncalvesBC15</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/vk6o3s75rvd6zmuxwrnbz2kwri">fatcat:vk6o3s75rvd6zmuxwrnbz2kwri</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170829092338/http://www.gsd.inesc-id.pt/~mpc/pubs/goncalves-Big%20Data%20Analytics%20for%20Detecting%20Host%20Misbehavior%20in%20Large%20Logs-Trustcom15.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/5c/6c/5c6c3a86d5218aefa20d7ea64444a5e186b769f1.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/trustcom.2015.380"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

Big biomedical image processing hardware acceleration: A case study for K-means and image filtering

Katayoun Neshatpour, Arezou Koohi, Farnoud Farahmand, Rajiv Joshi, Setareh Rafatirad, Avesta Sasan, Houman Homayoun
<span title="">2016</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/kucxvipvevedfgtsl3pnvxorse" style="color: black;">2016 IEEE International Symposium on Circuits and Systems (ISCAS)</a> </i> &nbsp;
of data including Apache Hadoop and Apache Spark.  ...  However, efficient processing of such large amount of imaging data running computational intensive learning methods is becoming a challenging problem using state-ofthe-art high performance computing server  ...  Fig. 2 shows the timing diagram of a MapReduce application with 15 map jobs, 4 mapper slots and one reduce job.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/iscas.2016.7527445">doi:10.1109/iscas.2016.7527445</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/iscas/NeshatpourKFJRS16.html">dblp:conf/iscas/NeshatpourKFJRS16</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/ngueu6tyivhdviizxa7mcasx4a">fatcat:ngueu6tyivhdviizxa7mcasx4a</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170428063901/http://ece.gmu.edu:80/~hhomayou/files/ISCAS2016-2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/91/e7/91e77c453f1a071c97a42b2a53f087bd520f54a6.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/iscas.2016.7527445"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

ATLAS: An Adaptive Failure-aware Scheduler for Hadoop [article]

Mbarka Soualhia, Foutse Khomh, Sofiene Tahar
<span title="2015-11-05">2015</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
However, because of the scale, complexity and dynamic nature of the cloud, failures are common and these failures often impact the performance of jobs running in Hadoop.  ...  A single task failure can cause the failure of the whole job and unpredictable job running times.  ...  In the future, we plan to extend ATLAS using unsupervised learning algorithms and assess the performance of ATLAS when the prediction model is retrained at fixed time intervals.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1511.01446v2">arXiv:1511.01446v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/l2gt2yaz3zcyfcamq3qlyu5lpa">fatcat:l2gt2yaz3zcyfcamq3qlyu5lpa</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200902144643/https://arxiv.org/pdf/1511.01446v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/7e/62/7e62b8d9cac80f7e1fe15fbd56e80d3a5d6de8ed.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1511.01446v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>
&laquo; Previous Showing results 1 &mdash; 15 out of 455 results