3,158 Hits in 3.9 sec

Scheduling and flexible control of bandwidth and in-transit services for end-to-end application workflows

Mehmet Fatih Aktas, Georgiana Haldeman, Manish Parashar
2016 Future generations computer systems  
Specifically, we present a flexible control and a disciplined resource scheduling approach for data transport services for science networks.  ...  End-to-end scientific application workflows that integrate high-end experiments and instruments with large scale simulations and end-user displays are becoming increasingly important.  ...  Acknowledgement The research presented in this work is supported in part by the US National Science Foundation (  ... 
doi:10.1016/j.future.2015.09.011 fatcat:6l2fg5g53bbzhowwugotjblcjq

Virtual network on demand

Dimitrios Katramatos, Sushant Sharma, Dantong Yu
2012 Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date - DIDC '12  
At the same time, VNOD also offers a platform for co-scheduling end-site resources with local and wide-area network resources through the use of various algorithms and optimization objectives.  ...  Recent networking technologies, already deployed in production and/or in experimental phases, offer the capability to dynamically provision network resources interconnecting multiple end sites hosting  ...  Figure 3 demonstrates the co-scheduling workflow between two end-sites. This workflow can be considered in conjunction with end-sites storage systems or just for the network.  ... 
doi:10.1145/2286996.2287006 dblp:conf/hpdc/KatramatosSY12 fatcat:66d4j6mvebg5lkjcbkertu6i5y

SDN for End-to-End Networked Science at the Exascale (SENSE)

Inder Monga, Chin Guok, John MacAuley, Alex Sim, Harvey Newman, Justas Balcas, Phil DeMar, Linda Winkler, Tom Lehman, Xi Yang
2018 2018 IEEE/ACM Innovating the Network for Data-Intensive Science (INDIS)  
The Software-defined network for End-to-end Networked Science at Exascale (SENSE) research project is building smart network services to accelerate scientific discovery in the era of 'big data' driven  ...  The significance of these capabilities is the ability for science applications to manage the network as a firstclass schedulable resource akin to instruments, compute, and storage, to enable well defined  ...  But central to the end-to-end connection service orchestration are calls for intent based service negotiation and instantiation workflow.  ... 
doi:10.1109/indis.2018.00007 dblp:conf/sc/MongaGMSNBDWL018 fatcat:goux54vgbbebldcz7mzuverzwe

Latency-Sensitive Web Service Workflows: A Case for a Software-Defined Internet [article]

Pradeeban Kathiravelu, Peter Van Roy, Luís Veiga, Elhadj Benkhelifa
2020 arXiv   pre-print
The Internet of Things (IoT) and edge computing provide an increasing demand and potential for more user control for their web service workflows.  ...  In this work, we propose our vision for a Software-Defined Internet (SDI) for latency-sensitive web service workflows.  ...  It thus provides better flexibility and control for the tenant workflows and offers low latency to the user web service workflows on the Internet. III.  ... 
arXiv:2005.07136v1 fatcat:gzz5gxcmxbdm3isf6fvcwkvxi4

Software-Defined Network for End-to-end Networked Science at the Exascale

Inder Monga, Chin Guok, John MacAuley, Alex Sim, Harvey Newman, Justas Balcas, Phil DeMar, Linda Winkler, Tom Lehman, Xi Yang
2020 Future generations computer systems  
An intent based interface allows applications to express their high-level service requirements, an intelligent orchestrator and resource control systems allow for custom tailoring of scalability and real-time  ...  This provides the basis for further innovation of smart network services to accelerate scientific discovery in the era of big data, cloud computing, machine learning and artificial intelligence.  ...  Work discussed in this paper was supported through multiple projects and grants from the Department of Energy and National Science Foundation including the following:  ... 
doi:10.1016/j.future.2020.04.018 fatcat:j3lhfywfu5ezvnudosfft4dsmy

End-to-End QoS on Shared Clouds for Highly Dynamic, Large-Scale Sensing Data Streams

Rafael Tolosana-Calasanz, José Ángel Bañares, Congduc Pham, Omer Rana
2012 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)  
Such a strategy supports end-to-end QoS with variations in data size between the various nodes involved in the workflow enactment process.  ...  Where such data is processed in-transit (i.e. from data capture to delivery to a user) over a shared distributed computing infrastructure, it is necessary to provide some Quality of Service (QoS) guarantees  ...  At a sampling rate defined for each workflow instance, a control loop evaluates the actions to be taken and Transition t10 initiates this control loop.  ... 
doi:10.1109/ccgrid.2012.67 dblp:conf/ccgrid/Tolosana-CalasanzBPR12 fatcat:3ranpryysrcyxklgwdqk4nq3ry

Developing Applications with Networking Capabilities via End-to-End SDN (DANCES)

Victor Hazlewood, Derek Simmel, Joseph Lappa, Jared Yanovich, Kathy Benninger, Greg Peterson, Jason Charcalla, Benny Sparks, Jesse Hanley, Andrew Adams, Bryan Learn, Robert Budden
2016 Proceedings of the XSEDE16 on Diversity, Big Data, and Science at Scale - XSEDE16  
The Developing Applications with Networking Capabilities via End-to-End SDN (DANCES) project [1] is a collaboration between  ...  Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NSF.  ...  ACKNOWLEDGEMENTS This work was supported by the National Science Foundation (NSF) Campus Cyberinfrastructure -Network Infrastructure and Engineering (CC-NIE) program award numbers 1341005, 1340953, and  ... 
doi:10.1145/2949550.2949557 dblp:conf/xsede/HazlewoodBPCSHA16 fatcat:tl6i2gl6xbfdvk4lvdlfjzkify

NORNS: Extending Slurm to Support Data-Driven Workflows through Asynchronous Data Staging

Alberto Miranda, Adrian Jackson, Tommaso Tocci, Iakovos Panourgias, Ramon Nou
2019 2019 IEEE International Conference on Cluster Computing (CLUSTER)  
It also introduces a new service for asynchronous data staging called NORNS that coordinates with the job scheduler to orchestrate data transfers to achieve better resource utilization.  ...  This forces users to explicitly manage data movement between the different storage layers, which, coupled with the lack of interfaces to communicate data dependencies between jobs in a data-driven workflow  ...  For flexibility, we decided to create a standalone service, the NORNS service, to provide the functionality to manage and move data on compute nodes, with interfaces defined to enable both user and system  ... 
doi:10.1109/cluster.2019.8891014 dblp:conf/cluster/MirandaJTPN19 fatcat:hc7nopkglze3pe3njvkwkzhusi

MXF Practice and Reconfigurable Application Specific Computing

Chris Golson, Kees Vos, Frederic Guiot, Gregory Doyle
2006 SMPTE Motion Imaging Journal  
As a number of broadcasters transition from tape- based to file-based MXF workflows, allowing for greater flexibility in ingest, editing, media asset management, storage, and archiving product choices,  ...  To make it easier for ISVs to take advantage of these capabilities, a set of core services is implemented in logic that control data movement, function initialization and ini- tiation, as well as provide  ... 
doi:10.5594/j16172 fatcat:jjmhacvq2bdfhdnyvv2rupnp2e

The Bond Agent System and Applications [chapter]

Ladislau Bölöni, Kyungkoo Jun, Krzysztof Palacz, Radu Sion, Dan C. Marinescu
2000 Lecture Notes in Computer Science  
We discuss several applications of Bond agents: resource discovery, an adaptive video service, a workflow management system, a system of agents for remote monitoring of web servers, and a network of PDE  ...  If we have to use special agent communication and content languages, design our own societal services, use special toolkits for building agents, while waiting for someone to discover a "killer application  ...  The flexibility of the design is illustrated by several applications discussed in Section 4.  ... 
doi:10.1007/978-3-540-45347-5_9 fatcat:duvwa2hmubeilllzkpmbv4qrbu

Toward Prioritization of Data Flows for Scientific Workflows Using Virtual Software Defined Exchanges

Anirban Mandal, Paul Ruth, Ilya Baldin, Rafael Ferreira Da Silva, Ewa Deelman
2017 2017 IEEE 13th International Conference on e-Science (e-Science)  
In this work, we present an end-to-end framework for autonomic adaptation for scientific workflows on networked cloud systems, which leverages novel network provisioning technologies.  ...  management systems to address competing priorities of workflow operations, data movements in particular.  ...  Overton, and Erola Pairo-Castineira for their valuable help.  ... 
doi:10.1109/escience.2017.92 dblp:conf/eScience/MandalRBSD17 fatcat:7khyvyfixbhqlg3szcdt2bqaym

Reinforcement Learning for Security-Aware Workflow Application Scheduling in Mobile Edge Computing

Binbin Huang, Yuanyuan Xiang, Dongjin Yu, Jiaojiao Wang, Zhongjin Li, Shangguang Wang, Xiaolong Xu
2021 Security and Communication Networks  
In addition, the edge computing environment is dynamical and time-variant, which results in the fact that the existing quasistatic workflow application scheduling scheme cannot be applied to the workflow  ...  Mobile users can offload their partial or all computation tasks of a workflow application to the edge servers, thereby significantly reducing the completion time of the workflow application.  ...  In addition, it also faces two challenges for workflow application scheduling in mobile edge computing as follows.  ... 
doi:10.1155/2021/5532410 fatcat:enojxldyhfgcrm33tici4kxugy

Data Transfer and Network Services management for Domain Science Workflows [article]

Tom Lehman, Xi Yang, Chin Guok, Frank Wuerthwein, Igor Sfiligoi, John Graham, Aashay Arora, Dima Mishin, Diego Davila, Jonathan Guiang, Tom Hutton, Harvey Newman (+1 others)
2022 arXiv   pre-print
This paper describes a vision and work in progress to elevate network resources and data transfer management to the same level as compute and storage in the context of services access, scheduling, life  ...  Developing mechanisms to allow an application workflow to obtain information regarding the network services, capabilities, and options, to a degree similar to what is possible for compute resources is  ...  Discussion of Scale For this work it is assumed that in some future R&E networks, such as ESnet6, up to 80% of the bandwidth across the production infrastructure is available to be controlled via SENSE  ... 
arXiv:2203.08280v2 fatcat:w52ay7bkbbf3xp3szg4ccx44aq

Software-Defined Networking for Big-Data Science - Architectural Models from Campus to the WAN

I. Monga, E. Pouyoul, C. Guok
2012 2012 SC Companion: High Performance Computing, Networking Storage and Analysis  
and implemented successfully to meet the needs of science.  ...  Hybrid network architecture, multi-domain bandwidth reservations, performance monitoring and GLIF Open Lightpath Exchanges (GOLE) are examples of network architectures that have been proposed, championed  ...  research funding to explore OpenFlow's applicability to the wide-area.  ... 
doi:10.1109/sc.companion.2012.341 dblp:conf/sc/MongaPG12 fatcat:xecfajxhvnczlerfxprsfmdfn4

Enabling intent to configure scientific networks for high performance demands

Mariam Kiran, Eric Pouyoul, Anu Mercian, Brian Tierney, Chin Guok, Inder Monga
2018 Future generations computer systems  
Focusing particularly on science applications, iNDIRA uses natural language processing to construct semantic RDF graphs to understand, interact, and create the required network services.  ...  In this paper, we present the iNDIRA tool, which interacts with SDN north-bound interfaces to enable intent-based networking.  ...  ACKNOWLEDGMENT This work was supported in part by the Director, Office of Science, Office of Advanced Scientific Computing Research, of the US Department of Energy, under contract number DE-AC02-05CH11231  ... 
doi:10.1016/j.future.2017.04.020 fatcat:sjab3mfelvapzi5nfw33t4atdu
« Previous Showing results 1 — 15 out of 3,158 results