15,377 Hits in 5.3 sec

Long Range Arena: A Benchmark for Efficient Transformers [article]

Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
2020 arXiv   pre-print
Our benchmark code will be released at  ...  Our benchmark is a suite of tasks consisting of sequences ranging from 1K to 16K tokens, encompassing a wide range of data types and modalities such as text, natural, synthetic images, and mathematical  ...  We would also like to thank Drew Linsley, who provided us with help and information for setting up the pathfinder benchmark.  ... 
arXiv:2011.04006v1 fatcat:fluopa56nreabkolp7p5ydrgve

Long Range Language Modeling via Gated State Spaces [article]

Harsh Mehta, Ankit Gupta, Ashok Cutkosky, Behnam Neyshabur
2022 arXiv   pre-print
State space models have shown to be effective at modeling long range dependencies, specially on sequence classification tasks.  ...  DSS) on TPUs, is fairly competitive with several well-tuned Transformer-based baselines and exhibits zero-shot generalization to longer inputs while being straightforward to implement.  ...  Finally, we are grateful to Ethan Dyer for discussions on long context modeling, Walid Krichene and John Anderson for providing feedback on an earlier draft of this paper.  ... 
arXiv:2206.13947v3 fatcat:52ohe7jsf5hirhhhnlwhfskoeq

The NLP Task Effectiveness of Long-Range Transformers [article]

Guanghui Qin, Yukun Feng, Benjamin Van Durme
2022 arXiv   pre-print
We design experiments to isolate the effect of pretraining and hyperparameter settings, to focus on their capacity for long-range attention.  ...  We benchmark 7 variants of Transformer models on 5 difficult NLP tasks and 7 datasets.  ...  Benchmarks and Analysis There is not an agreed-upon standard benchmark for long sequence transformers.  ... 
arXiv:2202.07856v1 fatcat:pmrm3ogiofgt3cqlysek6wppq4

Towards a General Purpose CNN for Long Range Dependencies in ND [article]

David W. Romero, David M. Knigge, Albert Gu, Erik J. Bekkers, Efstratios Gavves, Jakub M. Tomczak, Mark Hoogendoorn
2022 arXiv   pre-print
The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework.  ...  Continuous convolutional kernels model long range dependencies at every layer, and remove the need for downsampling layers and task-dependent depths needed in current CNN architectures.  ...  Romero sincerely thanks Qualcomm for his support. David W.  ... 
arXiv:2206.03398v2 fatcat:nzysemyhsjhmdizxsnshlc2c3i

One-dimensional long-range percolation: A numerical study

G. Gori, M. Michelangeli, N. Defenu, A. Trombettoni
2017 Physical review. E  
Our analysis is in agreement, up to a numerical precision ≈ 10^-3, with the mean field result for the anomalous dimension η=2-σ, showing that there is no correction to η due to correlation effects.  ...  The critical exponents in the range 0<σ<1 are reported and compared with mean-field and ε-expansion results.  ...  Hospitality in the Program "Conformal Field Theories and Renormalization Group Flows in Dimensions d > 2" at the Galileo Galilei Institute for Theoretical Physics, Florence (Italy), where part of this  ... 
doi:10.1103/physreve.96.012108 pmid:29347133 fatcat:emnmqgudirhw7fppiqc74otabu

The competitiveness of European industry

1990 Long range planning  
The importance of benchmarking as a tool for improving the performance of enterprises, sectors and policies is stressed.  ...  wide range of occupations.  ... 
doi:10.1016/0024-6301(90)90078-i fatcat:fq4k72d2eraylj3pbobpdaru5m

Short-Term Wind Power Forecasting at the Wind Farm Scale Using Long-Range Doppler LiDAR

Mathieu Pichault, Claire Vincent, Grant Skidmore, Jason Monty
2021 Energies  
This work seeks to address this issue by developing and testing two novel forecasting methodologies, based on measurements from a state-of-the-art long-range scanning Doppler LiDAR.  ...  This study is therefore a proof-of-concept demonstrating the potential offered by remote sensing instruments for short-term wind power forecasting applications.  ...  Energy Agency (ARENA) and the Australian Energy Market Operator (AEMO).  ... 
doi:10.3390/en14092663 fatcat:76j6w2jccbdujjb4herg72ive4

Strategic Development of Business Models

Bernd W. Wirtz, Oliver Schilke, Sebastian Ullrich
2010 Long range planning  
However, relatively little is known about how managers can go about achieving this transformation, and how, and to what extent, different types of business models should be adapted.  ...  Executives can use the ideas and frameworks presented in the article to benchmark their firm's efforts towards embracing the changes associated with the Web 2.0 into their business model.  ...  Acknowledgements We thank the Editor-in-Chief, the two Special Issue editors and two anonymous reviews for their valuable guidance and encouragement.  ... 
doi:10.1016/j.lrp.2010.01.005 fatcat:3ei37cxof5fltgrw7gmt4yl3vq

Making the Most of Your Company's Knowledge: A Strategic Framework

Georg von Krogh, Ikujiro Nonaka, Manfred Aben
2001 Long range planning  
This paper develops a framework of four strategies for managing knowledge.  ...  The framework is based on conceptualisation about knowledge management practices at Unilever, a multinational fast-moving consumer goods company. k c  ...  The authors wish to thank Charles Baden-Fuller, two LRP reviewers, Mark Macus, Simon Grand, Michael Cusumano, Ian Ritchie, and Wouter de Vries for their helpful comments.  ... 
doi:10.1016/s0024-6301(01)00059-0 fatcat:ggmtuz2yefb6peyk6jmrff2ewm

Java in the High Performance Computing arena: Research, practice and experience

Guillermo L. Taboada, Sabela Ramos, Roberto R. Expósito, Juan Touriño, Ramón Doallo
2013 Science of Computer Programming  
JOMP consists of a compiler (written in Java, and built using the JavaCC tool) and a runtime library.  ...  As Java has built-in multithreading support, the use of Java threads for parallel programming is quite extended due to its high performance, although it is a rather low-level option for HPC (work parallelization  ...  We gratefully thank CESGA (Galicia Supercomputing Center, Santiago de Compostela, Spain) for providing access to the Finis Terrae supercomputer.  ... 
doi:10.1016/j.scico.2011.06.002 fatcat:c4suwxfz45cbdpvfmnzmb3rofm

Arena-Bench: A Benchmarking Suite for Obstacle Avoidance Approaches in Highly Dynamic Environments [article]

Linh Kästner, Teham Bhuiyan, Tuan Anh Le, Elias Treis, Johannes Cox, Boris Meinardus, Jacek Kmiecik, Reyk Carstens, Duc Pichel, Bassel Fatloun, Niloufar Khorsandi, Jens Lambrecht
2022 arXiv   pre-print
In this paper, we present Arena-bench, a benchmark suite to train, test, and evaluate navigation planners on different robotic platforms within 3D environments.  ...  The code is publicly available at  ...  The generated ROS maps can be transformed into a 3D Gazebo world.  ... 
arXiv:2206.05728v1 fatcat:xg7btxr7tfdpffjborj6hdky34

Competing Business Models, Value Creation and Appropriation in English Football

Peter McNamara, Simon I. Peck, Amir Sasson
2013 Long range planning  
Drawing on the time series nature of our data, we also show that transitioning between business models can involve a decline in performance (which may be temporary), and draw some implications for managers  ...  This article integrates the business model concept with an understanding of industry recipes to show how competing business models can co-exist in a competitive market.  ...  Player demographic and market value data for each club were obtained under licence from Association of Football Statisticians, Errors etc. remain our own.  ... 
doi:10.1016/j.lrp.2011.10.002 fatcat:vsvxy6s5dfb4vm2lpoa5s2lkqq

The future role of official statistics in the business data arena

Stefano Menghinello, Alessandro Faramondi, Tiziana Laureti
2019 Statistical Journal of the IAOS  
consistency benchmarking services and data integration opportunities.  ...  The adoption of a register based approach to increase both the efficiency and flexibility of statistical production processes, and more active data dissemination strategies finalised to reduce the gap  ...  New sources of data in the Big Data domain provide a range of challenges and risks to the Substitute with NSIs but at the same time offer an opportunity to deliver a more efficient and effective statistical  ... 
doi:10.3233/sji-190557 fatcat:m32fhp3zhfaazh4ewaqipj7l6q

Intellectual Property in the Global Arena [chapter]

2019 The Essential Guide to Intellectual Property  
For a right limited in time, this is too long.  ...  treaties have been discussed for a long time.  ...  Considerations bearing on this matter include: (a) the convenience and efficiency of centralized adjudication versus the convenience and efficiency of cooperation; (b) the cost of pursuing related actions  ... 
doi:10.2307/j.ctvgc628g.11 fatcat:mpet6mn6r5a6dc7mnjysidahi4

Benkler Revisited - Venturing beyond the Open Source Software Arena?

Dennis Hilgers, Gordon Müller-Seitz, Frank Thomas Piller
2010 International Conference on Information Systems  
However, we also find several factors which limit its adoption to non-software related arenas.  ...  In a seminal paper, Benkler (2002) provided a comprehensive framework to structure and explain these OSS principles.  ...  Policy Implications It still is too early to evaluate the long-term success of CBPP for non-software development.  ... 
dblp:conf/icis/HilgersMP10 fatcat:trv2jtuksnff5f6m4vghxp66aa
« Previous Showing results 1 — 15 out of 15,377 results