A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf
.
Filters
Deep Learning for HEP on HPC at NERSC
2019
Zenodo
We also detail plans for accelerated hardware for deep learning in the future HPC machines at NERSC, 'Perlmutter' and beyond. ...
We present recent work in supporting deep learning for particle physics and cosmology at NERSC, the US Dept. of Energy mission HPC center. ...
• Cray Shasta System: 3-4x capability of Cori
• GPU-accelerated and CPU-only nodes meet
the needs of large scale simulation and data
analysis from experimental facilities
○ >4,000 node CPU-only ...
doi:10.5281/zenodo.3599266
fatcat:p47f6jo3zvenhpdq4smzwncbka
Interactive Supercomputing With Jupyter
2021
Computing in science & engineering (Print)
of supercomputing to new science domains. ...
This has enabled a rich scientific discovery platform, particularly for experimental facility data analysis and machine learning problems. ...
Experimental and observational science facilities (microscopes, telescopes, genome sequencers, and particle accelerators) increasingly need leadership computing to make sense of all the data they generate ...
doi:10.1109/mcse.2021.3059037
fatcat:txtv4sjbwvhkpktrjma7j6cy6e
Towards Interactive, Reproducible Analytics at Scale on HPC Systems
2020
2020 IEEE/ACM HPC for Urgent Decision Making (UrgentHPC)
We describe our implemention of a system, using Binder, Science Capsule, and Dask software. ...
Our work is grounded in a real world science use case -applying geophysical simulations and inversions for imaging the subsurface. ...
We thank Rollin Thomas for helping us with the Jupyter support at NERSC. This work and the resources at NERSC are supported by the U.S. ...
doi:10.1109/urgenthpc51945.2020.00011
fatcat:3riyidbo4nghdmtymzn5x5avum
The LBNL Superfacility Project Report
[article]
2022
arXiv
pre-print
The Superfacility model is designed to leverage HPC for experimental science. ...
API-driven automation, HPC-scale notebooks via Jupyter, authentication using Federated Identity and container-based edge services supported. ...
Scientific Computing Center (NERSC), a U.S. ...
arXiv:2206.11992v2
fatcat:j7peffkrv5ebzexnkhiwmzynpe
Software and Computing for Small HEP Experiments
[article]
2022
arXiv
pre-print
This white paper briefly summarized key conclusions of the recent US Community Study on the Future of Particle Physics (Snowmass 2021) workshop on Software and Computing for Small High Energy Physics Experiments ...
This work was supported by the US Department of Energy, Office of Science, under contract numbers DE-AC02-76SF00515 (SLAC) and DE-AC02-05CH11231 (LBNL), and by the Fermi National Accelerator Laboratory ...
, managed and operated by Fermi Research Alliance, LLC under Contract DE-AC02-07CH11359 with the US Department of Energy. ...
arXiv:2203.07645v2
fatcat:bmbi4bw4rzalhne5zuy6atyviq
Jupyter meets the Earth: Enabling discovery in geoscience through interactive computing at scale
2019
Zenodo
The proposal narrative for NSF Award 1928406 which is a part of the "EarthCube: Developing a Community-Driven Data and Knowledge Environment for the Geosciences" program. ...
It produced major new research and teaching infrastructure (the Ecogeomorphology Flume), used as a teaching resource in two of Larsen's undergraduate and graduate classes. ...
applications in the domain sciences. ...
doi:10.5281/zenodo.3369938
fatcat:nzblhpru3vhmboxd4zq5hc74uu
Building a Vision for Reproducibility in the Cyberinfrastructure Ecosystem: Leveraging Community Efforts
2020
Supercomputing Frontiers and Innovations
in the tradition of community driven approaches to reproducibility and the acceleration of science and discovery. ...
We leverage an analysis of such workflows to (a) contextualize the 2019 National Academies of Science, Engineering, and Medicine report's recommendations in the HPC setting and (b) envision a path forward ...
This paper is distributed under the terms of the Creative Commons Attribution-Non Commercial 3.0 License which permits non-commercial use, reproduction and distribution of the work without further permission ...
doi:10.14529/jsfi200106
fatcat:65ngkgmfqjacbb2llj3exmpkei
The LSST DESC DC2 Simulated Sky Survey
[article]
2021
arXiv
pre-print
Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). ...
processing with Rubin's LSST Science Pipelines. ...
We thank Lindsey Bleem for many discussions and contributions relevant to galaxy clusters. ...
arXiv:2010.05926v3
fatcat:cm4egmbecre57ewrowpifyv3zm
The DOE Systems Biology Knowledgebase (KBase)
[article]
2016
bioRxiv
pre-print
infrastructure; and combine experimental evidence and conclusions that lead to accurate models of plant and microbial physiology and community dynamics. ...
KBase is available for anyone to use, and enables researchers to collaboratively generate, test, compare, and share hypotheses about biological functions; perform large-scale analyses on scalable computing ...
Because Narratives are built upon the Jupyter Notebook framework, users can create and run scripts within a Narrative using a "code cell." ...
doi:10.1101/096354
fatcat:ojeek6qm4nca5c2wtapougjlm4
Cloud enabling educational platforms with corc
2020
Workshop on Cloud Technologies in Education
Through this combination, we are able to dynamically orchestrate, authenticate, configure, and access interactive Jupyter Notebooks in the OCI with user defined hardware capabilities. ...
In addition, we lay out how this groundwork, will enable us to establish a Grid of Clouds between multiple trusted institutions. ...
Acknowledgments This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 765604. ...
dblp:conf/cte/MunkMV20
fatcat:wo4iu353xzaahka2zm4omfxhjy
ScienceSearch: Enabling Search through Automatic Metadata Generation
2018
2018 IEEE 14th International Conference on e-Science (e-Science)
an HPC system. ...
In this paper, we describe a) our search infrastructure and model, b) methods for generating metadata using machine learning techniques, and c) optimizations to improve search latency, and deployment on ...
This engine provides dataset search across scientific fields and its algorithms are adapted to the keywords used in science. ...
doi:10.1109/escience.2018.00025
dblp:conf/eScience/RodrigoHWOAR18
fatcat:a24oeicznjb6pe577on4fxwogu
Monitoring Scientific Python Usage on a Supercomputer
2021
Proceedings of the 20th Python in Science Conference
unpublished
understanding of user behavior and affording us opportunity to make increasingly data-driven decisions regarding Python at NERSC. ...
In 2021, more than 30% of users at the National Energy Research Scientific Computing Center (NERSC) used Python on the Cori supercomputer. ...
Finally we thank our users who were kind enough to provide feedback to us and allow us to use their quotes about how they are using Python at NERSC. ...
doi:10.25080/majora-1b6fd038-010
fatcat:4r6cezvkerenhoygcbfzhurav4
Advancing Fusion with Machine Learning Research Needs Workshop Report
2020
Journal of fusion energy
experimental planning. ...
The Department of Energy (DOE) Office of Science programs in Fusion Energy Sciences (FES) and Advanced Scientific Computing Research (ASCR) have organized several activities to identify best strategies ...
Because the science acceleration made possible by ML/ AI mathematics depends on data-driven or derived algorithms, strong experimental programs that produce large quantities of specifically useful data ...
doi:10.1007/s10894-020-00258-1
fatcat:pzk3vza7v5eytbsrg2htkr5ujq
BOOKLET_ASHPC22
2022
The goal of the JU is to coordinate actions, resources and policies between the European Commission and EU member states, in order to pursue in a concerted manner, the development of HPC in Europe, making ...
The goal of the Infrastructure pillar is the development of a world-class, state-of-the-art supercomputer ecosystem, able to satisfy the computational requirements of European HPC applications. ...
The computational results presented have been achieved using the Vienna Scientific Cluster (VSC). References [1] Quell, M., Diamantopoulos, G., Hössinger, A., and Weinbub, J., J. Comput. Appl. ...
doi:10.25365/phaidra.337
fatcat:uq5s5jm3ifhypd4clbtdhrz6ji
Business Model With Alternative Scenarios (D4.1)
2017
Zenodo
The report begins with a description of how climate and weather applications make use of HPC systems, the arising challenges and data requirements, and some trends that are likely to impact future data ...
(UREAD), and Science and Technology Facilities Council (STFC), Bryan Lawrence ...
. • Are ready-made and maintained virtual machine images or clusters available (e.g. for data science, or with Jupyter notebooks, etc.) • What support is available? ...
doi:10.5281/zenodo.1228749
fatcat:fdwtwtfcwjhhbkiusam6njs26a
« Previous
Showing results 1 — 15 out of 21 results