Filters








3,748 Hits in 4.8 sec

Controlled Experimentation in Continuous Experimentation: Knowledge and Challenges [article]

Florian Auer and Rasmus Ros and Lukas Kaltenbrunner and Per Runeson and Michael Felderer
2021 arXiv   pre-print
Context: Continuous experimentation and A/B testing is an established industry practice that has been researched for more than 10 years. Our aim is to synthesize the conducted research.  ...  Finally, we were interested in the challenges and benefits reported of continuous experimentation.  ...  Acknowledgements This work was partially supported by the Wallenberg Artificial Intelligence, Autonomous Systems and Software Program (WASP) funded by Knut and Alice Wallenberg Foundation and the Austrian  ... 
arXiv:2102.05310v2 fatcat:fs73k5q32jckvji3q4lhofbtny

Controlled experimentation in continuous experimentation: Knowledge and challenges

Florian Auer, Rasmus Ros, Lukas Kaltenbrunner, Per Runeson, Michael Felderer
2021 Information and Software Technology  
Context: Continuous experimentation and A/B testing is an established industry practice that has been researched for more than 10 years. Our aim is to synthesize the conducted research.  ...  Auer et al. and Netflix [34], which adopted data-driven decision making [35] , shared their experiences [36] and lessons learned [37] about experimentation over the years with the research community.  ...  Acknowledgments This work was partially supported by the Wallenberg Artificial Intelligence, Autonomous Systems and Software Program (WASP) funded by Knut and Alice Wallenberg Foundation and the Austrian  ... 
doi:10.1016/j.infsof.2021.106551 fatcat:bygtzpqotjc5jipg64dcelk4km

Comparison Lift: Bandit-based Experimentation System for Online Advertising [article]

Tong Geng, Xiliang Lin, Harikesh S. Nair, Jun Hao, Bin Xiang, Shurui Fan
2020 arXiv   pre-print
Comparison Lift is an experimentation-as-a-service (EaaS) application for testing online advertising audiences and creatives at JD.com.  ...  Second, by adapting experimental design to information acquired during the test, it reduces substantially the cost of experimentation to the advertiser.  ...  Acknowledgments We thank Jack Lin, Paul Yan, Lei Wu and the JD.com engineering, product and sales teams for collaboration and support.  ... 
arXiv:2009.07899v1 fatcat:t25w7kdodfhnpby3p2norfhkg4

Big Data and Marketing Analytics in Gaming: Combining Empirical Models and Field Experimentation

Harikesh Nair, Sanjog Misra, William J. Hornbuckle, Ranjan Mishra, Anand Acharya
2013 Social Science Research Network  
variety of channels including direct-mail, email, online advertising, and banners.  ...  ) ; Sahni 2012 (online advertising); Misra and Kishore et al. 2013 (salesforce compensation) .  ... 
doi:10.2139/ssrn.2399676 fatcat:33tkklvjczh6nd62g4zexq56pe

An Experimental Study on the Innovative CDIO Method in English Language Teaching

Ahmet Yusuf, Filiz Yalçin Tilfarlioğlu
2020 Journal of Education and Training Studies  
This experimental study is an attempt to bring a new perspective and a new teaching method CDIO (Conceiving, Designing, Implementing, and Operating) to the ELT field.  ...  Accordingly, there is a great improvement in the students' performance of the experimental group.  ...  industry leaders in the USA, and senior academics from other USA universities.  ... 
doi:10.11114/jets.v8i9.4949 fatcat:hzimsynzojbb3iybepgh3hmbmy

Lessons from Four Years of PHONELAB Experimentation [article]

Jinghao Shi, Edwin Santos, Geoffrey Challen
2019 arXiv   pre-print
The experimental platform consists of both instrumentation and experimental changes to platform components, including core Android services and Linux.  ...  We also offer many lessons learned along the way, almost all of which have been learned the hard way--through trial and a lot of error.  ...  It records the status of cores as they are brought online and offline as needed. Data Release We are working on an online catalog of the PHONELAB dataset.  ... 
arXiv:1902.01929v1 fatcat:camyxnc4gfbprnvqzooreg5yoe

Experimentation Strategies and Entrepreneurial Innovation: Inherited Market Differences in the iPhone Ecosystem

Jason P. Davis, Yulia Muzyrya, Pai-Ling Yin
2014 Social Science Research Network  
Although experimentation is critical to the innovation process in startups, little research has explored the link between different experimentation strategies and entrepreneurial innovation.  ...  We use unique data on experimentation strategies and innovation outcomes of firms producing iPhone applications to show that the appropriateness of different strategies depends on market characteristics  ...  Simultaneous and sequential experimentation strategies Simultaneous experimentation strategies direct search towards broad exploration with many varied innovation attempts that are tested in the market  ... 
doi:10.2139/ssrn.2408310 fatcat:kplu7kvqgbeijjbryfkawezuva

Big Data and Marketing Analytics in Gaming: Combining Empirical Models and Field Experimentation

Harikesh S. Nair, Sanjog Misra, William J. Hornbuckle, Ranjan Mishra, Anand Acharya
2017 Marketing science (Providence, R.I.)  
variety of channels including direct-mail, email, online advertising, and banners.  ...  Consumer exposure to print, online and billboard advertising and other media are not included in the data. Hence, some effects of marketing are not captured in our results.  ... 
doi:10.1287/mksc.2017.1039 fatcat:ej4mufhov5gz3ijvuw77taomja

Inefficiencies in Digital Advertising Markets [article]

Brett R Gordon, Kinshuk Jerath, Zsolt Katona, Sridhar Narayanan, Jiwoong Shin, Kenneth C Wilbur
2020 arXiv   pre-print
Digital advertising markets are growing and attracting increased scrutiny.  ...  We identify relevant findings in the academic literature, recent developments in practice, and promising topics for future research.  ...  Acknowledgements: We are grateful for many helpful suggestions from the special issue editors, John Deighton, Carl Mela and Chris Moorman, and four anonymous reviewers.  ... 
arXiv:1912.09012v2 fatcat:6v6wgtcudvcldgnm2s44bmp3ju

The Effectiveness of Combining Online and Print Advertisements

Lea M. Wakolbinger, Michaela Denk, Klaus Oberecker
2009 Journal of Advertising Research  
“The 368 JOURNAL OF ADVERTISING RESEARCH September 2009 TABLE 4 EFFECTIVENESS OF COMBINING ONLINE AND PRINT ADVERTISING y*-Test and One-Sided Wilcoxon Rank-Sum Test Results for Recall and Recognition Measures  ...  In another study, Briggs, Krishnan, and Borin (2005) discussed the incremental impact of online advertising in a Ford campaign, concluding that six percent of the product’s total sales could be linked  ... 
doi:10.2501/s0021849909090436 fatcat:elnphogjonf4pgtywckmpuugoq

Experimental Evaluations and the Evolution of the Reemployment and Eligibility Assessment Program [chapter]

Jacob M. Benus
2017 Lessons Learned from Public Workforce Program Experiments  
The states and the number of interventions tested in each state were as follows: New York, 27; California, 26; Illinois, 19; Pennsylvania, 19; Ohio, 16; Florida, 13; Massachusetts, 13; Texas, 13; and  ...  Workforce Innovation and Opportunity Act, Section 169. Greenberg, David, Mark Shroder, and Matthew Onstott. 2004 References  ...  For instance, for the SET Demonstration, we developed an online orientation video and online participant application to save American Job Center staff from conducting these in person.  ... 
doi:10.17848/9780880996310.ch4 fatcat:ofejmgxsvvf2za3ethbhckxyje

A New Method of Measuring Online Media Advertising Effectiveness: Prospective Meta-Analysis in Marketing

Gui Liberali, Glen L. Urban, Catherine E. Tucker, Yakov Bart, S. Stremersch
2016 Social Science Research Network  
The authors introduce a new method, prospective meta-analysis in marketing (PMM), to estimate consumer response to online advertising on a large and adaptive scale.  ...  They also show how engagement and attention strengthen consumer response to advertising.  ...  This allowed us to develop and empirically test a conceptual framework to study response to online advertising based on attention and engagement.  ... 
doi:10.2139/ssrn.2838258 fatcat:b2qnc3pxmbe7hfrsvxb6qxerg4

"Does Anyone Really Know If Online Ad Campaigns Are Working?"

Paul J. Lavrakas, Sherrill Mane, Joe Laszlo
2010 Journal of Advertising Research  
experimental design and/or the unwillingness of advertisers to provide the incremental funding necessary to conduct experimental studies.  ...  That is, an existing online panel is ideal for testing the effects of an online advertising campaign using a true experimental design.  ... 
doi:10.2501/s002184991009152x fatcat:dcmdx4iwsrd7nc75xfsqfvtj4u

Model-driven system development: Experimental design and report of the pilot experiment [article]

Sergio España, Nelly Condori, Roel Wieringa, Arturo González, Óscar Pastor
2011 arXiv   pre-print
The other variant is an ad-hoc, text-based requirements practice similar to the one that is applied in industrial projects by OO-Method practitioners.  ...  This report describes de design of an experiment that intends to compare two variants of a modeldriven system development method, so as to assess the impact of requirements engineering practice in the  ...  ACKNOWLEDGEMENTS We, the researchers, are grateful to the following institutions and individuals; this research would not have been possible without them.  ... 
arXiv:1111.0562v1 fatcat:xrpoxcn7uffmdctsxmovlhflme

Lean Workflow and Quality Assurance when Creating Software-Intensive Products and Services [chapter]

Mary Poppendieck
2021 The Cambridge International Handbook of Lean Production  
Controlled experiments, also called randomized experiments and A/B tests, have had a profound influence on multiple fields, including medicine, agriculture, manufacturing, and advertising.  ...  The Experimentation Platform (ExP) was built to accelerate innovation through trustworthy experimentation.  ...  Special thanks to David Treadwell, Ray Ozzie, and Eric Rudder; without their support the experimentation platform would not have existed.  ... 
doi:10.1017/9781108333870.017 fatcat:46hp7faypfghrfwzjftz5wmsv4
« Previous Showing results 1 — 15 out of 3,748 results