92,171 Hits in 5.1 sec

Memory, Communication, and Statistical Queries

Jacob Steinhardt, Gregory Valiant, Stefan Wager
2016 Annual Conference Computational Learning Theory  
We relate our memorybounded and communication-bounded learning models to the well-studied statistical query model.  ...  We introduce a formal framework for studying these questions, and investigate the relationship between the fundamental resources of memory or communication and the sample complexity of the learning task  ...  We also thank Ran Raz and Percy Liang for helpful and insightful conversations.  ... 
dblp:conf/colt/SteinhardtVW16 fatcat:gviwx634pfaw7a4a4v3egwt5ny

Communication Protocols and Message Formats for BLAST Parallelization on Cluster Systems

Hong-Soog Kim, Woo-Hyuk Jang, Dong-Soo Han
2008 22nd International Conference on Advanced Information Networking and Applications - Workshops (aina workshops 2008)  
This paper develops communication protocols and message formats to reduce the communication overheads for the parallel execution of BLAST in the search for individual query sequence on cluster systems.  ...  The developed communication protocols and message formats are implemented on a new version of BLAST on cluster systems. The new version of BLAST is named Hyper-BLAST in this paper.  ...  This research was financially supported by the Minstry of Commerce, Industry and Energy (MOCIE) and Korea Industrial Technology Foundation (KOTEF) through the Human Resource Training Project for Regional  ... 
doi:10.1109/waina.2008.238 dblp:conf/aina/KimJH08 fatcat:z7zt6ed3rfcypcjjkf5vxxlzsy

Query optimization in Oracle 12c database in-memory

Dinesh Das, Jiaqi Yan, Mohamed Zait, Satyanarayana R. Valluri, Nirav Vyas, Ramarajan Krishnamachari, Prashant Gaharwar, Jesse Kamp, Niloy Mukherjee
2015 Proceedings of the VLDB Endowment  
the full promise and performance of Oracle Database In-Memory.  ...  The new storage format brings new data processing techniques and query execution algorithms and thus new challenges for the query optimizer.  ...  The decision depends on the tradeoff between reading data from memory and doing inter-process communication (not using partition-wise join) vs. reading the data from disk and not doing inter-process communication  ... 
doi:10.14778/2824032.2824074 fatcat:cfz4slijczee3e5hkyxwmdj2va

The DBO database system

Florin Rusu, Fei Xu, Luis Leopoldo Perez, Mingxi Wu, Ravi Jampani, Chris Jermaine, Alin Dobra
2008 Proceedings of the 2008 ACM SIGMOD international conference on Management of data - SIGMOD '08  
This can result in significant savings in both user and computer time, since a user can abort a query as soon as he or she is happy with the guess' accuracy.  ...  final answer to a query from start to finish during query processing.  ...  steps, the in-memory join, and the statistics module.  ... 
doi:10.1145/1376616.1376740 dblp:conf/sigmod/RusuXPWJJD08 fatcat:t2ncjinadnduno3iws4z7qpgm4

Evaluation of Open-source Tools for Differential Privacy [article]

Shiliang Zhang, Anton Hagermalm, Sanjin Slavnic, Elad Michael Schiller, Magnus Almgren
2022 arXiv   pre-print
DP aims to deliver this promise by including well-crafted elements of random noise in the published data and thus there is an inherent trade-off between the degree of privacy protection and the ability  ...  This work proposes an open-source evaluation framework for privacy protection solutions and offers evaluation for OpenDP Smartnoise, Google DP, PyTorch Opacus, Tensorflow Privacy, and Diffprivlib.  ...  Memory overhead This section investigates how DP impacts memory usage when running statistical queries on Google DP and Smartnoise.  ... 
arXiv:2202.09587v3 fatcat:dktjbssqjvbdtdfrvcq3hoknsu

Enhanced Data Sharing over Mobile Ad Hoc Network Based on non-Selfish Exposure

Amrutha b k, Mr.I.Edwin Albert
2014 IOSR Journal of Computer Engineering  
Data replacing and Malicious nodes which effect the security of the MANET are also discussed which increases data accessibility and decreases communication cost that caused by Query delay.  ...  The proposed system outperforms traditional cooperative replica allocation techniques in terms of data accessibility, communication cost, and average query.  ...  The proposed strategies outperform existing representative cooperative replica allocation techniques in terms of data accessibility, communication cost, and query delay.  ... 
doi:10.9790/0661-16245865 fatcat:72ewj36cz5afrmepgw5pzckzra

Audiovisual Retrieval Framework for Multimedia Archives on Java Enabled Mobile Devices

I. Ahmad, S. Kiranyaz, M. Gabbouj
2005 EUROCON 2005 - The International Conference on "Computer as a Tool"  
the query requests and stream back the retrieval results.  ...  The client is developed for Java enabled mobile devices where a user can initiate a content-based query process to retrieve similar multimedia items and the server is designed on a host computer to execute  ...  Basically mean and standard deviation (SD) are the statistics computed over 50 query operations performed over the sample database.  ... 
doi:10.1109/eurcon.2005.1629884 fatcat:qlrcc6zu55gy5bj73yhmqiqray

Evaluating SPARQL queries on massive RDF datasets

Razen Harbi, Ibrahim Abdelaziz, Panos Kalnis, Nikos Mamoulis
2015 Proceedings of the VLDB Endowment  
Therefore, the resulting partitions are static and do not adapt to changes in the query workload; as a result, existing systems are unable to consistently avoid communication for queries that are not favored  ...  As a result, the communication cost for future queries is drastically reduced or even eliminated.  ...  If Q can be answered in parallel mode, the master broadcasts the query to all workers. Each worker generates its local query plan using local statistics and executes Q without communication.  ... 
doi:10.14778/2824032.2824083 fatcat:th33gqs3obhllatmonrj4ja324

Semantic connection set-based massive RDF data query processing in Spark environment

Jiuyun Xu, Chao Zhang
2019 EURASIP Journal on Wireless Communications and Networking  
In addition, some statistics and broadcast variable optimization strategies are introduced to reduce shuffling and data communication costs.  ...  However, there is a performance challenge in the distributed environment when RDF queries, which contain multiple join operations, such as network reshuffle and memory overhead, are processed.  ...  However, during the query process, the amount of associated data is limited, and excessive statistics can cause poor query performance.  ... 
doi:10.1186/s13638-019-1588-9 fatcat:gchrslcjundhjftqkjpfgujzmi

A Scalable Parallel Approach for Peptide Identification from Large-Scale Mass Spectrometry Data

Gaurav Kulkarni, Ananth Kalyanaraman, William R. Cannon, Douglas Baxter
2009 2009 International Conference on Parallel Processing Workshops  
memory machine model; ii) (time) Our algorithm uses a combination of parallel techniques such as one-sided communication and masking of communication with computation to ensure that the overhead introduced  ...  due to parallelism is minimal; and iii) (quality) The run-time savings achieved using parallel processing has allowed us to incorporate highly accurate statistical models that have previously been demonstrated  ...  From this perspective, it may be worth exploring an alternative strategy in which candidates, and not the database sequences, are stored in-memory and are communicated on demand to worker processors.  ... 
doi:10.1109/icppw.2009.41 dblp:conf/icppw/KulkarniKCB09 fatcat:3hvkfj34ozel3fqjocnlvhxmra

Statistics based Optimization Technique for Query Processing

The LUBM dataset contains the semantic queries and this dataset is used to measure the efficiency of the proposed Statistical based optimization method.  ...  The cost value of the triple scores is measured and given as input to the proposed statistics method.  ...  Memory Size Analysis The memory usage of the existing and statistics methods in query optimization are compared in the Table . 3.  ... 
doi:10.35940/ijitee.b1044.078219 fatcat:rczr2baelbf7rptssn4mg5ctv4

Architecture-oriented visualization

Mohlalefi Sefika, Aamod Sane, Roy H. Campbell
1996 SIGPLAN notices  
In addition, the paper presents architecture-aware instrumentation, a new technique for building efficient on-line instrumentation to support architectural queries.  ...  Tracking the changing dynamics of object-oriented frameworks [5], design patterns[7], architectural styles [8] , and subsystems during the development and reuse cycle can aid producing complex systems.  ...  Huang, and the anonymous OOPSLA referees for their helpful comments.  ... 
doi:10.1145/236338.236380 fatcat:x52vkno4tbfbrkxeslqz4wntxq

Laboratory Test Bench for Research Network and Cloud Computing

Evgeniy Pluzhnik, Evgeny Nikulchev, Simon Payain
2014 International Journal of Communications, Network and System Sciences  
Research and development of new solutions can be limited in case of using emulators or international commercial cloud services, due to the closed architecture and limited opportunities for experimentation  ...  It also describes architecture and configuration of the experimental setup. The proposed modular structure can be expanded by available computing power.  ...  and physical memory; • about the database queries, search systems, services.  ... 
doi:10.4236/ijcns.2014.77026 fatcat:aurcfhmifngizdhyfvlxhn4zje

Adaptive query processing in mobile environment

Hocine Grine, Thierry Delot, Sylvain Lecomte
2005 Proceedings of the 3rd international workshop on Middleware for pervasive and ad-hoc computing - MPAC '05  
Furthermore, a query processor deployed in this type of environment must face a significant heterogeneity, in particular mobile terminals, communication networks and different data sources.  ...  In this context, actual query evaluation and optimization techniques in distributed databases based on the use of a global schema and a cost model are no more relevant.  ...  Fluctuation in Memory: systems in this category try to adapt to memory shortages and to the availability of excess memory.  ... 
doi:10.1145/1101480.1101494 dblp:conf/middleware/GrineDL05 fatcat:zeqyuaverbcj3lcixmqizb5pmy

Data Stream Management: Aggregation, Classification, Modeling, and Operator Placement

Frank Olken, Le Gruenwald
2008 IEEE Internet Computing  
management and query optimization in distributed settings (minimizing query processing's communication costs, for example).  ...  aggregate queries over groups in data streams, while minimizing memory usage, execution costs, and latency.  ... 
doi:10.1109/mic.2008.121 fatcat:hp7m3s6kubd6zketa4aaavhtlq
« Previous Showing results 1 — 15 out of 92,171 results