49,391 Hits in 7.0 sec

ONFS: a hierarchical hybrid file system based on memory, SSD, and HDD for high performance computers

Xin Liu, Yu-tong Lu, Jie Yu, Peng-fei Wang, Jie-ting Wu, Ying Lu
2017 Frontiers of Information Technology & Electronic Engineering  
It leverages dynamic random access memory (DRAM) and solid state drive (SSD) in compute nodes, and HDD in storage servers to build a three-level storage system in a unified namespace.  ...  In this paper, we present the technical details on distributed metadata management, the strategy of memory borrow and return, data consistency, parallel access control, and mechanisms guiding downward  ...  It further installs SSD on burst buffer nodes and provides storage space fast to applications dynamically. The enormous amount of I/O traffic is absorbed in the data staging area near compute nodes.  ... 
doi:10.1631/fitee.1700626 fatcat:yqorojwvrvhtfluirqessfcgme

The design of a distributed key-value store for petascale hot storage in data acquisition systems

Danilo Cicalese, Grzegorz Jereczek, Fabrice Le Goff, Giovanna Lehmann Miotto, Jeremy Love, Maciej Maciejewski, Remigius K Mommsen, Jakub Radtke, Jakub Schmiegel, Malgorzata Szychowska, A. Forti, L. Betev (+3 others)
2019 EPJ Web of Conferences  
DAQDB offers not only high-capacity and low-latency buffer for fast data selection, but also opens a new approach in high-bandwidth data acquisition by decoupling the lifetime of the data analysis processes  ...  In this context, we present the design of DAQDB (Data Acquisition Database) — a distributed key-value store for high-bandwidth, generic data storage in event-driven systems.  ...  There is a set of attributes assigned to each primary key, e.g., replication scheme or distributed lock. These attributes are kept in metadata attached to each key in the data store.  ... 
doi:10.1051/epjconf/201921401014 fatcat:pv6wbd5svzgu7e6k7li7f3ncce

Application specific non-volatile primary memory for embedded systems

Kwangyoon Lee, Alex Orailoglu
2008 Proceedings of the 6th IEEE/ACM/IFIP international conference on Hardware/Software codesign and system synthesis - CODES/ISSS '08  
In this paper, we introduce a highly effective non-volatile primary memory architecture which incorporates application specific information to develop a NAND flash based primary memory.  ...  the device life-cycle by autonomous wear-leveling and minimizing the program/erase operations.  ...  Along with the fast internal cache, the hardware interface to the standard memory of the proposed primary memory should be equivalently fast.  ... 
doi:10.1145/1450135.1450144 dblp:conf/codes/LeeO08 fatcat:26onssjnvzaubmhjsxvn6m3oai

Physics performance and event throughput of the GPU High Level Trigger 1 of LHCb

Dorothea Vom Bruch
2019 Zenodo  
Beginning in 2021, the upgraded LHCb experiment will use a triggerless readout system collecting data at an event rate of 30 MHz.  ...  In this talk we present work based on an R&D project in the context of the LHCb Upgrade I exploring the approach of executing the full HLT1 on GPUs.  ...  SV: Secondary vertex IP: Impact parameter: distance between point of closest approach of a track and a PV Similar strategy, but at 30x higher rate and 5x the pileup Disk buffer capacity reduces from  ... 
doi:10.5281/zenodo.3599004 fatcat:yejgymvz5nfjjbdisvm5ydcfli

Lifetime improvement of NAND flash-based storage systems using dynamic program and erase scaling

Jaeyong Jeong, Sangwook Shane Hahn, Sungjin Lee, Jihong Kim
2014 USENIX Conference on File and Storage Technologies  
In this paper, we propose a new system-level approach, called dynamic program and erase scaling (DPES), for improving the lifetime (particularly, endurance) of NAND flash memory.  ...  However, the decreasing lifetime of NAND flash memory as a side effect of recent advanced technologies is regarded as a main barrier for a wide adoption of NAND flash-based storage systems.  ...  This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Ministry of Science, ICT and Future Planning (MSIP) (NRF-2013R1A2A2A01068260).  ... 
dblp:conf/fast/JeongHLK14 fatcat:qibplb4ttbbjfos5ubb7sttaia

A BeeGFS-Based Caching File System for Data-Intensive Parallel Computing [chapter]

David Abramson, Chao Jin, Justin Luong, Jake Carroll
2020 Lecture Notes in Computer Science  
This approach has been exemplified in the design of "burst buffers", but more general caching systems have also been built.  ...  The solution unifies data access for both the internal storage and external file systems using a uniform namespace.  ...  We also acknowledge the University of Queensland who provided access to FlashLite. FlashLite was funded by the Australian Research Council Linkage Infrastructure Equipment Fund (LIEF).  ... 
doi:10.1007/978-3-030-48842-0_1 fatcat:xkcvamltifhmxdisxdpxftfj54

The software architecture of a SAN storage control system

J. S. Glider, C. F. Fuente, W. J. Scales
2003 IBM Systems Journal  
We discuss the software architecture of the storage control system and describe its major components: the cluster operating environment, the distributed I/O facilities, the buffer management component,  ...  The requirements placed on storage controllers in a UNIX or Windows environment are less exacting in terms of response time.  ...  The remote copy allows a secondary copy of a logical disk to be created and kept in sync with the primary copy (the secondary copy is updated any time the primary copy is updated), possibly at a remote  ... 
doi:10.1147/sj.422.0232 fatcat:7jfcpaefljetxhq4ynwuppmb7i


Panagiotis Antonopoulos, Naveen Prakash, Vijendra Purohit, Hugh Qu, Chaitanya Sreenivas Ravella, Krystyna Reisteter, Sheetal Shrotri, Dixin Tang, Vikram Wakade, Alex Budovski, Cristian Diaconu, Alejandro Hernandez Saenz (+5 others)
2019 Proceedings of the 2019 International Conference on Management of Data - SIGMOD '19  
The database-as-a-service paradigm in the cloud (DBaaS) is becoming increasingly popular.  ...  It has become clear, however, that these expectations cannot be met in the cloud with the traditional, monolithic database architecture.  ...  Socrates and SQL DB Hyperscale is the result of a large collaborative effort across the Microsoft SQL organization and Microsoft Research.  ... 
doi:10.1145/3299869.3314047 dblp:conf/sigmod/AntonopoulosBDS19 fatcat:7ignk2nuw5e6npmeclm6smckcq

Next-Generation Information Technology Systems for Fast Detectors in Electron Microscopy [chapter]

Dieter Weber, Alexander Clausen, Rafal E. Dunin-Borkowski
2020 Handbook on Big Data and Machine Learning in the Physical Sciences  
Starting from 2009, the data rate of TEM cameras has outpaced the development of network, mass storage and memory bandwidth by almost two orders of magnitude.  ...  The Gatan K2 IS direct electron detector (Gatan Inc., 2018), which was introduced in 2014, marked a watershed moment in the development of cameras for transmission electron microscopy (TEM) (Pan & Czarnik  ...  Acknowledgments The authors would like to acknowledge the ESTEEM3 network, many colleagues at Forschungszentrum Jülich and other institutions, and developers and users of various software and hardware  ... 
doi:10.1142/9789811204579_0005 fatcat:gi4bt7vbovc2hfzzzlyj6n56pu

Special Issue on Scalable Cyber–Physical Systems

Meikang Qiu, Saurabh Garg, Rujkumar Buyya, Bei Yu, Shiyan Hu
2017 Journal of Parallel and Distributed Computing  
A Modeling Language to Describe Massive Data Storage Management in Cyber-Physical Systems proposes a modeling language to describe the management programs in Massive Data Storage Systems (MDSSs).  ...  Innovative technologies addressing CPS challenges in smart energy systems, such as the fast growth in system scale and complexity, the distributed control and real-time interaction between dynamic environments  ... 
doi:10.1016/j.jpdc.2017.01.025 fatcat:p4mpknx4nbdzlm7dza4ml5hnpm

Page 33 of SMPTE Motion Imaging Journal Vol. 88, Issue 1 [page]

1979 SMPTE Motion Imaging Journal  
The system uti- lizes advanced computer programming techniques to map the action of a stylus di- rectly onto individual picture elements (pixels) in a digital framestore buffer.  ...  Programs are removed from storage by computer command, placed on a conveyor and automatically transported to a carousel near the playback machine in ac- cordance with the program timetable.  ... 

PILOT---A New Multiple Computer System

A. L. Leiner, W. A. Notz, J. L. Smith, A. Weinberger
1959 Journal of the ACM  
A simple example of a ready-signal message is used in coordinating the respective programs of the primary and secondary computers.  ...  Secondary Storage Unit. Associated with the secondary computer is a fast secondary storage unit of the diode capacitor type.  ... 
doi:10.1145/320986.320987 fatcat:dt26p4erqba2pgnzwagtanqkme

A message-queuing framework for STAR's online monitoring and metadata collection

D Arkhipkin, J Lauret, W Betts
2011 Journal of Physics, Conference Series  
This migration allows us to reduce the overall system complexity and greatly improve the reliability of the metadata collection and the performance of our online services in general.  ...  After careful consideration, we chose Google Protocol Buffers as our primary (de)serialization format for structured data exchange.  ...  Acknowledgments This work was supported by the Office of Nuclear Physics within the U.S. Department of Energy's Office of Science.  ... 
doi:10.1088/1742-6596/331/2/022003 fatcat:lumu4phhmbderkpvhdsgpouu2q

Accelerating Apache Farms Through Ad-HOC Distributed Scalable Object Repository [chapter]

M. Aldinucci, M. Torquati
2004 Lecture Notes in Computer Science  
We present hoc: a fast, scalable object repository providing programmers with a general storage module. hoc may be used to implement DSMs as well as distributed cache subsystems. hoc is composed of a set  ...  We designed an hoc-based Web cache that extends the Apache Web server and remarkably improves Apache farms performances with no modification to the Apache core code.  ...  Danelutto and M. Vanneschi for many fruitful discussions, and A. Petrocelli who has contributed in experimenting hoc.  ... 
doi:10.1007/978-3-540-27866-5_78 fatcat:4f46oznswjc2tdmfgu7waw5tnu

Single address space implementation in distributed systems

Alberto Bartoli, Gianluca Dini, Lanfranco Lopriore
2000 Concurrency Practice and Experience  
Our system implements a two-layer storage hierarchy in which the distributed secondary memory stores the valid data items and the primary memory supports a form of data caching, for fast processor access  ...  Moreover, the number of messages necessary to determine the network location of a given data item is low and independent of both the network size and the past movements of this data item in the distributed  ...  of the MOSAICO Project ('Design methodologies and tools of high performance systems for distributed applications').  ... 
doi:10.1002/(sici)1096-9128(20000410)12:4<251::aid-cpe475>;2-t fatcat:5rh3jtxtyrhrnm5jabgyd3uypm
« Previous Showing results 1 — 15 out of 49,391 results