21 Hits in 5.0 sec

Deep Learning for HEP on HPC at NERSC

Wahid Bhimji, Steven Farrell, Mustafa Mustafa
2019 Zenodo  
We also detail plans for accelerated hardware for deep learning in the future HPC machines at NERSC, 'Perlmutter' and beyond.  ...  We present recent work in supporting deep learning for particle physics and cosmology at NERSC, the US Dept. of Energy mission HPC center.  ...  • Cray Shasta System: 3-4x capability of Cori • GPU-accelerated and CPU-only nodes meet the needs of large scale simulation and data analysis from experimental facilities ○ >4,000 node CPU-only  ... 
doi:10.5281/zenodo.3599266 fatcat:p47f6jo3zvenhpdq4smzwncbka

Interactive Supercomputing With Jupyter

Rollin Thomas, Shreyas Cholia, Kathryn Mohror, John M. Shalf
2021 Computing in science & engineering (Print)  
of supercomputing to new science domains.  ...  This has enabled a rich scientific discovery platform, particularly for experimental facility data analysis and machine learning problems.  ...  Experimental and observational science facilities (microscopes, telescopes, genome sequencers, and particle accelerators) increasingly need leadership computing to make sense of all the data they generate  ... 
doi:10.1109/mcse.2021.3059037 fatcat:txtv4sjbwvhkpktrjma7j6cy6e

Towards Interactive, Reproducible Analytics at Scale on HPC Systems

Shreyas Cholia, Lindsey Heagy, Matthew Henderson, Drew Paine, Jon Hays, Ludovico Bianchi, Devarshi Ghoshal, Fernando Perez, Lavanya Ramakrishnan
2020 2020 IEEE/ACM HPC for Urgent Decision Making (UrgentHPC)  
We describe our implemention of a system, using Binder, Science Capsule, and Dask software.  ...  Our work is grounded in a real world science use case -applying geophysical simulations and inversions for imaging the subsurface.  ...  We thank Rollin Thomas for helping us with the Jupyter support at NERSC. This work and the resources at NERSC are supported by the U.S.  ... 
doi:10.1109/urgenthpc51945.2020.00011 fatcat:3riyidbo4nghdmtymzn5x5avum

The LBNL Superfacility Project Report [article]

Deborah Bard, Cory Snavely, Lisa Gerhardt, Jason Lee, Becci Totzke, Katie Antypas, William Arndt, Johannes Blaschke, Suren Byna, Ravi Cheema, Shreyas Cholia, Mark Day (+15 others)
2022 arXiv   pre-print
The Superfacility model is designed to leverage HPC for experimental science.  ...  API-driven automation, HPC-scale notebooks via Jupyter, authentication using Federated Identity and container-based edge services supported.  ...  Scientific Computing Center (NERSC), a U.S.  ... 
arXiv:2206.11992v2 fatcat:j7peffkrv5ebzexnkhiwmzynpe

Software and Computing for Small HEP Experiments [article]

Dave Casper, Maria Elena Monzani, Benjamin Nachman, Costas Andreopoulos, Stephen Bailey, Deborah Bard, Wahid Bhimji, Giuseppe Cerati, Grigorios Chachamis, Jacob Daughhetee, Miriam Diamond, V. Daniel Elvira (+13 others)
2022 arXiv   pre-print
This white paper briefly summarized key conclusions of the recent US Community Study on the Future of Particle Physics (Snowmass 2021) workshop on Software and Computing for Small High Energy Physics Experiments  ...  This work was supported by the US Department of Energy, Office of Science, under contract numbers DE-AC02-76SF00515 (SLAC) and DE-AC02-05CH11231 (LBNL), and by the Fermi National Accelerator Laboratory  ...  , managed and operated by Fermi Research Alliance, LLC under Contract DE-AC02-07CH11359 with the US Department of Energy.  ... 
arXiv:2203.07645v2 fatcat:bmbi4bw4rzalhne5zuy6atyviq

Jupyter meets the Earth: Enabling discovery in geoscience through interactive computing at scale

Fernando Pérez, Joseph Hamman, Laurel Larsen, Kevin Paul, Lindsey Heagy, Christopher Holdgraf, Yuvi Panda
2019 Zenodo  
The proposal narrative for NSF Award 1928406 which is a part of the "EarthCube: Developing a Community-Driven Data and Knowledge Environment for the Geosciences" program.  ...  It produced major new research and teaching infrastructure (the Ecogeomorphology Flume), used as a teaching resource in two of Larsen's undergraduate and graduate classes.  ...  applications in the domain sciences.  ... 
doi:10.5281/zenodo.3369938 fatcat:nzblhpru3vhmboxd4zq5hc74uu

Building a Vision for Reproducibility in the Cyberinfrastructure Ecosystem: Leveraging Community Efforts

2020 Supercomputing Frontiers and Innovations  
in the tradition of community driven approaches to reproducibility and the acceleration of science and discovery.  ...  We leverage an analysis of such workflows to (a) contextualize the 2019 National Academies of Science, Engineering, and Medicine report's recommendations in the HPC setting and (b) envision a path forward  ...  This paper is distributed under the terms of the Creative Commons Attribution-Non Commercial 3.0 License which permits non-commercial use, reproduction and distribution of the work without further permission  ... 
doi:10.14529/jsfi200106 fatcat:65ngkgmfqjacbb2llj3exmpkei

The LSST DESC DC2 Simulated Sky Survey [article]

LSST Dark Energy Science Collaboration: Bela Abolfathi, David Alonso, Robert Armstrong, Éric Aubourg, Humna Awan, Yadu N. Babuji, Franz Erik Bauer, Rachel Bean, George Beckett, Rahul Biswas, Joanne R. Bogart, Dominique Boutigny (+67 others)
2021 arXiv   pre-print
Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC).  ...  processing with Rubin's LSST Science Pipelines.  ...  We thank Lindsey Bleem for many discussions and contributions relevant to galaxy clusters.  ... 
arXiv:2010.05926v3 fatcat:cm4egmbecre57ewrowpifyv3zm

The DOE Systems Biology Knowledgebase (KBase) [article]

Adam P. Arkin, Rick L Stevens, Robert W Cottingham, Sergei Maslov, Christopher S Henry, Paramvir Dehal, Doreen Ware, Fernando Perez, Nomi L Harris, Shane Canon, Michael W Sneddon, Matthew L Henderson (+67 others)
2016 bioRxiv   pre-print
infrastructure; and combine experimental evidence and conclusions that lead to accurate models of plant and microbial physiology and community dynamics.  ...  KBase is available for anyone to use, and enables researchers to collaboratively generate, test, compare, and share hypotheses about biological functions; perform large-scale analyses on scalable computing  ...  Because Narratives are built upon the Jupyter Notebook framework, users can create and run scripts within a Narrative using a "code cell."  ... 
doi:10.1101/096354 fatcat:ojeek6qm4nca5c2wtapougjlm4

Cloud enabling educational platforms with corc

Rasmus Munk, David Marchant, Brian Vinter
2020 Workshop on Cloud Technologies in Education  
Through this combination, we are able to dynamically orchestrate, authenticate, configure, and access interactive Jupyter Notebooks in the OCI with user defined hardware capabilities.  ...  In addition, we lay out how this groundwork, will enable us to establish a Grid of Clouds between multiple trusted institutions.  ...  Acknowledgments This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 765604.  ... 
dblp:conf/cte/MunkMV20 fatcat:wo4iu353xzaahka2zm4omfxhjy

ScienceSearch: Enabling Search through Automatic Metadata Generation

Gonzalo P. Rodrigo, Matt Henderson, Gunther H. Weber, Colin Ophus, Katie Antypas, Lavanya Ramakrishnan
2018 2018 IEEE 14th International Conference on e-Science (e-Science)  
an HPC system.  ...  In this paper, we describe a) our search infrastructure and model, b) methods for generating metadata using machine learning techniques, and c) optimizations to improve search latency, and deployment on  ...  This engine provides dataset search across scientific fields and its algorithms are adapted to the keywords used in science.  ... 
doi:10.1109/escience.2018.00025 dblp:conf/eScience/RodrigoHWOAR18 fatcat:a24oeicznjb6pe577on4fxwogu

Monitoring Scientific Python Usage on a Supercomputer

Rollin Thomas, Laurie Stephey, Annette Greiner, Brandon Cook
2021 Proceedings of the 20th Python in Science Conference   unpublished
understanding of user behavior and affording us opportunity to make increasingly data-driven decisions regarding Python at NERSC.  ...  In 2021, more than 30% of users at the National Energy Research Scientific Computing Center (NERSC) used Python on the Cori supercomputer.  ...  Finally we thank our users who were kind enough to provide feedback to us and allow us to use their quotes about how they are using Python at NERSC.  ... 
doi:10.25080/majora-1b6fd038-010 fatcat:4r6cezvkerenhoygcbfzhurav4

Advancing Fusion with Machine Learning Research Needs Workshop Report

David Humphreys, A. Kupresanin, M. D. Boyer, J. Canik, C. S. Chang, E. C. Cyr, R. Granetz, J. Hittinger, E. Kolemen, E. Lawrence, V. Pascucci, A. Patra (+1 others)
2020 Journal of fusion energy  
experimental planning.  ...  The Department of Energy (DOE) Office of Science programs in Fusion Energy Sciences (FES) and Advanced Scientific Computing Research (ASCR) have organized several activities to identify best strategies  ...  Because the science acceleration made possible by ML/ AI mathematics depends on data-driven or derived algorithms, strong experimental programs that produce large quantities of specifically useful data  ... 
doi:10.1007/s10894-020-00258-1 fatcat:pzk3vza7v5eytbsrg2htkr5ujq


Eduard Reiter
The goal of the JU is to coordinate actions, resources and policies between the European Commission and EU member states, in order to pursue in a concerted manner, the development of HPC in Europe, making  ...  The goal of the Infrastructure pillar is the development of a world-class, state-of-the-art supercomputer ecosystem, able to satisfy the computational requirements of European HPC applications.  ...  The computational results presented have been achieved using the Vienna Scientific Cluster (VSC). References [1] Quell, M., Diamantopoulos, G., Hössinger, A., and Weinbub, J., J. Comput. Appl.  ... 
doi:10.25365/phaidra.337 fatcat:uq5s5jm3ifhypd4clbtdhrz6ji

Business Model With Alternative Scenarios (D4.1)

Jakob Luettgau, Julian Kunkel, Jens Jensen, Bryan Lawrence
2017 Zenodo  
The report begins with a description of how climate and weather applications make use of HPC systems, the arising challenges and data requirements, and some trends that are likely to impact future data  ...  (UREAD), and Science and Technology Facilities Council (STFC), Bryan Lawrence  ...  . • Are ready-made and maintained virtual machine images or clusters available (e.g. for data science, or with Jupyter notebooks, etc.) • What support is available?  ... 
doi:10.5281/zenodo.1228749 fatcat:fdwtwtfcwjhhbkiusam6njs26a
« Previous Showing results 1 — 15 out of 21 results