Filters








2,639 Hits in 6.6 sec

You Only Run Once: Spark Auto-tuning from a Single Run

David Buchaca, Felipe Portella, Carlos Costa, Josep LLuis Berral
2020 IEEE Transactions on Network and Service Management  
Tuning configurations of Spark jobs is not a trivial task. State-of-the-art auto-tuning systems are based on iteratively running workloads with different configurations.  ...  In this paper, we present a new method for tuning configurations that uses information from one run of a Spark workload.  ...  CONCLUSIONS This paper introduced a Spark feature descriptor that is built with metrics extracted from a single run of a Spark application.  ... 
doi:10.1109/tnsm.2020.3034824 fatcat:tw3x6tmoebcldlg42q532steg4

Intelligent system for auto-tuning of big data analytics deployment properties

Profeta Davide, Gaglio Salvatore, Finazzo Rosolino
2018 Zenodo  
A general deployment optimizer method has therefore been proposed, applicable not only to the Spark framework, but also to other frameworks such as Cassandra and Kafka.  ...  Once the solution proposed for the optimization of a single metric was implemented and tested, the method was extended and tested for the optimization of multiple metrics.  ...  About auto-tuning of deployment properties it's found a work of G. Wang et al. for the Spark framework, a unified analytics engine for big data processing.  ... 
doi:10.5281/zenodo.2019443 fatcat:wo5dq36hinbwlgpt5thscx2hhi

Improvements in the De Forest System of Wireless Telephony

Walter Kendall
1909 Scientific American  
Write at once (or our special offu· . NOT BUY a bicycle or a pall' ofHres from anyotf� at any price until you receive our catalogue and learn our low prices and liberal terms.  ...  T HIS work gives in minute detais full practical directions for making eight different sizes of coils. vary· ing from a small one giving a �-inch spark to a large one giving 12-inch sparks.  ... 
doi:10.1038/scientificamerican06191909-457 fatcat:xtgqxafowrflpk4ya5nvbh2kxi

A Survey on Automatic Parameter Tuning for Big Data Processing Systems

Herodotos Herodotou, Yuxing Chen, Jiaheng Lu
2020 ACM Computing Surveys  
., Hadoop, Spark, Storm) contain a vast number of configuration parameters controlling parallelism, I/O behavior, memory settings, and compression.  ...  The use of automated parameter tuning techniques is a promising, yet challenging approach for optimizing system performance.  ...  With conservative tuning, the goal is to boost job performance within a single execution.  ... 
doi:10.1145/3381027 fatcat:7aglimtuwze25boptuano4ufdy

The Aeronautic Society's First Curtiss Aeroplane

1909 Scientific American  
Write at once (or our special offu· . NOT BUY a bicycle or a pall' ofHres from anyotf� at any price until you receive our catalogue and learn our low prices and liberal terms.  ...  T HIS work gives in minute detais full practical directions for making eight different sizes of coils. vary· ing from a small one giving a �-inch spark to a large one giving 12-inch sparks.  ... 
doi:10.1038/scientificamerican06191909-460 fatcat:fj5lr3llefbwhprgobku7mvjgm

SparkScore: Leveraging Apache Spark for Distributed Genomic Inference

Amir Bahmani, Alexander B. Sibley, Mahmoud Parsian, Kouros Owzar, Frank Mueller
2016 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)  
Inference based on these statistics can readily incorporate a priori knowledge from a vast collection of bioinformatics databases to further refine the analyses.  ...  We propose SparkScore, a set of distributed computational algorithms implemented in Apache Spark, to leverage the embarrassingly parallel nature of genomic resampling inference on the basis of the efficient  ...  This research is partially supported by grants from the National Science Foundation, award numbers 0988311 (FM) and 1217748 (FM), and by a grant from the National Institutes of Health, award number P01CA142538  ... 
doi:10.1109/ipdpsw.2016.6 dblp:conf/ipps/BahmaniSPOM16 fatcat:ep6ghdo2q5dhnezkhl4lz77mtm

TonY: An Orchestrator for Distributed Machine Learning Jobs [article]

Anthony Hsu, Keqiu Hu, Jonathan Hung, Arun Suresh, Zhe Zhang
2019 arXiv   pre-print
Managing a distributed training job is complex and requires dealing with resource contention, distributed configurations, monitoring, and fault tolerance.  ...  Keras. https://github.com/ performance-tuning-hadoop-spark, 2016. fchollet/keras, 2015.  ...  (hence the name long to train on a single machine.  ... 
arXiv:1904.01631v1 fatcat:phazpymk4ra3vjs7utkwhuahp4

High-Powered American Touring Cars

1906 Scientific American  
If you can Save Only $1 a Month weCan show you where to invest it. with even better security than a bank affords, and where it will Earn 7 Per Cent. at Once aud likely much more later.  ...  Write for cataloe and prices. a "B. & S." Auto Wrench. Drop forged of the best steel throughout. VICTOR J. HUMBRECHT, President than once a year.  ... 
doi:10.1038/scientificamerican01131906-32 fatcat:ejevisvm2bfu5feiaz46ojoxpq

THE COST OF RUNNING A PHYSICIAN'S AUTOMOBILE

1912 Journal of the American Medical Association  
The headlights were eonverted into shape for the use of incandescent globes, and connected with a storage buttery carried for that purpose only.  ...  Good lighting would he obtained when the battery was freshly charged, but would last satisfactorily for only a few nights. Expense item as great as before.  ...  If you can't curry a tune, why try to sing?  ... 
doi:10.1001/jama.1912.04260040089051 fatcat:dfwqnsqoirc4zf7ku52rnsznsa

The Peerless 30-Horse-Power Touring Car

1906 Scientific American  
If you can Save Only $1 a Month weCan show you where to invest it. with even better security than a bank affords, and where it will Earn 7 Per Cent. at Once aud likely much more later.  ...  Are you satisfied to let a bank grow wealthy by paying you only 3 or 4 per cent. for your money? HAYNES AUTOMOBILE CO.  ... 
doi:10.1038/scientificamerican01131906-31a fatcat:jtjpqk5ih5gwziaylx26oowixm

The Physician's Automobile

1908 Journal of the American Medical Association  
If Your Wife Learns to Run the Auto, You Will Need Two Autos.  ...  If you are a married man and teach your wife how to run it you would better buy two, as you can get it only when she does not want it.  ... 
doi:10.1001/jama.1908.02530360073030 fatcat:s3t64pzobre7bfgi52mnnqnzqm

AUTOMOBILES FOR PHYSICIANS' USEARE THEY PRACTICAL? ARE THEY DESIRABLE? ARE THET ECONOMICAL? ARE THEY BETTER THAN HORSES?

1906 Journal of the American Medical Association (JAMA)  
It can easily cover twice the ground in a day that a horse can, and in the summer, when the warm weather is hard on a horse, the auto is a great advantage, as both machine and driver are cooler when going  ...  There should be seats for two and only two.  ...  During three seasons I have had to be towed in only twice, once on account of a broken chain and once a broken gas pipe.  ... 
doi:10.1001/jama.1906.02510430022004 fatcat:erpwng2tjverrdpq6co2yubtlq

Introduction to Big Data Technology [chapter]

Bilal Abu-Salih, Pornpit Wongthongtham, Dengya Zhu, Kit Yan Chan, Amit Rudra
2021 Social Big Data Analytics  
The chapter then introduces technology stacks for an or-ganization to build a big data application, from infrastruc-ture/platform/ecosystem to constructional units and components.  ...  Its influences are far beyond a simple technique innovation but involves all rears in the world.  ...  In particular various currently incorporated technologies, tools, APIs, and approaches are discussed that are used from infrastructure/platform/ecosystem to constructional units and components.  ... 
doi:10.1007/978-981-33-6652-7_2 fatcat:dog5ym666famdedniwyewwswiq

Increasing Reliability of a Two-Stroke Internal Combustion Engine for Dynamically Changing Altitudes

Steven C. Crosbie, Marc D. Polanka, Paul J. Litke, John L. Hoke
2014 Journal of Propulsion and Power  
Thank you Fred for having the confidence in me from the start and letting me work in your facility.  ...  These engines are designed to run at sea level, but these aircraft are often pressed into service at higher altitudes where the performance characteristics deteriorate.  ...  This facility was received configured to test a Brison 5.8 in 3 single cylinder twostroke spark ignition crankcase scavenged engine.  ... 
doi:10.2514/1.b34753 fatcat:ez3wrqqvjjbhrjhixd4a7gfu2a

A Cloud-Friendly Communication-Optimal Implementation for Strassen's Matrix Multiplication Algorithm

Jie ZHOU, Feng YU
2015 IEICE transactions on information and systems  
Further experimental results show that it achieves a speedup ranging from 1.03× to 2.50× over the classical Θ(n 3 ) algorithm.  ...  Due to its on-demand and pay-as-you-go properties, cloud computing has become an attractive alternative for HPC applications.  ...  Realize auto-tuning of parameter p, q for different matrices and cluster sizes. 3. Design more efficient addition codes.  ... 
doi:10.1587/transinf.2015edp7065 fatcat:njvwo2jpo5gvdemcmflixgtqum
« Previous Showing results 1 — 15 out of 2,639 results