1,119 Hits in 5.4 sec

Improving random GUI testing with image-based widget detection

Thomas D. White, Gordon Fraser, Guy J. Brown
2019 Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis - ISSTA 2019  
We propose a technique for improving random GUI testing by automatically identifying GUI widgets in screen shots using machine learning techniques.  ...  In our experiments, we found that identifying GUI widgets from screen shots and using this information to guide random testing achieved a signiicantly higher branch coverage in 18 of 20 applications, with  ...  We describe a technique based on deep learning that adapts machine learning object detection algorithms to the problem of GUI widget detection. • We propose an improve random GUI testing approach that  ... 
doi:10.1145/3293882.3330551 dblp:conf/issta/WhiteFB19 fatcat:254ed52xovdpviz37wgn5a3zki

Psychologically-Inspired, Unsupervised Inference of Perceptual Groups of GUI Widgets from GUI Images [article]

Mulong Xie, Zhenchang Xing, Sidong Feng, Chunyang Chen, Liming Zhu, Xiwei Xu
2022 arXiv   pre-print
Inspired by these principles, we present a novel unsupervised image-based method for inferring perceptual groups of GUI widgets.  ...  Our method requires only GUI pixel images, is independent of GUI implementation, and does not require any training data.  ...  [45] apply a popular object detection model YOLOv2 [33] to detect GUI widgets in GUI images for random GUI testing. Feng et al.  ... 
arXiv:2206.10352v1 fatcat:7rczforlobahjcqy4dvgk3xqlq

A Manually Captured and Modified Phone Screen Image Dataset for Widget Classification on CNNs

Sung Chul Byun, Seong-Soo Han, Chang-Sung Jeong
2022 Journal of Information Processing Systems  
An implementation for widget detection and classification on RetinaNet and EfficientNet is then executed.  ...  For example, deep learning can be an innovative solution to classify widgets in screen images for increasing convenience.  ...  Categorizing and generalizing GUI components with myriad forms based on functionality is a complex subject.  ... 
doi:10.3745/jips.02.0169 dblp:journals/jips/ByunHJ22 fatcat:dhf2r2ekbvh6hd2vfky6x6a6nm

Black-Box Test Data Generation for GUI Testing

Mohammad Ali Darvish Darab, Carl K. Chang
2014 2014 14th International Conference on Quality Software  
Effective system testing of applications with a Graphical User Interface (GUI) front-end demands careful generation of event sequences as well as providing relevant test data for parameterized widgets,  ...  an opportunity to be integrated with the existing GUI testing frameworks.  ...  The results show that our approach is capable of improving the code coverage compared to using random values.  ... 
doi:10.1109/qsic.2014.42 dblp:conf/qsic/DarabC14 fatcat:gmkjhbpl4negrg35zjovspy7fa

testar - scriptless testing through graphical user interface

Tanja E. J. Vos, Pekka Aho, Fernando Pastor Ricós, Olivia Rodriguez Valdes, Ad Mulders
2021 Software testing, verification & reliability  
With this paper, we hope we can help and encourage other researchers to use TESTAR for their GUI testing-related research and pave the way for an international research agenda in GUI testing built upon  ...  Covering all the possible paths of the graphical user interface (GUI) with test scripts would take too much effort and result in serious maintenance issues.  ...  Tycho Menting, Perttu Moilanen, Mirella Oreto Martínez Murillo, Carlos Ortega, Mauro Pezze, Dietmar Pfahl, Tomi Piirainen, Wishnu Prasetya, Enrique Reverón, Antonio de Rojas, Urko Rueda, Carlo Sengers, Guy  ... 
doi:10.1002/stvr.1771 dblp:journals/stvr/VosARVM21 fatcat:hvh63bm555gehjzjouggbzzuka

Evaluation of the Automated Testing Framework: A Case Study

Abel Méndez-Porras, Jorge Alfaro-Velasco, Alexandra Martínez
2020 Tecnología en Marcha  
It has shown that it works well detecting bugs associated with user-interactions.  ...  Automated software test can be the key to improve the traditional manual testing, often time consuming and repetitive.  ...  In this part of the research, a bug analyzer based on digital image processing was implemented, as well as another one based on GUI information.  ... 
doi:10.18845/tm.v33i3.4372 fatcat:kkujnvcoufb7df6vshgj2plgza

Unsupervised Detection of Changes in Usage-Phases of a Mobile App

Hoyeol Chae, Ryangkyung Kang, Ho-Sik Seok
2020 Applied Sciences  
Our experimental results on commercial mobile apps show promising improvement over the state-of-the-practice method based on SIFT (scale-invariant feature transform).  ...  This work proposes novel approaches for one of the core functionalities of automated app testing: the detection of changes in usage-phases of a mobile app.  ...  Android Monkey takes a practical solution for GUI (graphical user interface) based testing: a random testing approach ("monkey testing") for generating random events [3, 4] .  ... 
doi:10.3390/app10103656 fatcat:us5frw3hwncplj7gfhli7pgxze

Behind the Scenes: An Approach to Incorporate Context in GUI Test Case Generation

Stephan Arlt, Cristiano Bertolini, Martin Schäf
2011 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops  
In this paper we propose a model for better GUI testing. Our model is created based on two observations.  ...  Graphical user interfaces (GUIs) are a common way to interact with software. To ensure the quality of such software it is important to test the possible interactions with its user interface.  ...  Related Work Recent works have been done to improve GUI testing using the application's source code. Zhao and Cai [5] propose a coverage criteria based on the handler of the widgets.  ... 
doi:10.1109/icstw.2011.70 dblp:conf/icst/ArltBS11 fatcat:v6kte5tigjbdnhfvwq5ymxbgpe

User Interface Level Testing with TESTAR; What about More Sophisticated Action Specification and Selection?

Sebastian Bauersfeld, Tanja E. J. Vos
2014 Seminar on Advanced Techniques and Tools for Software Evolution  
In earlier works we presented the TESTAR tool, a Model-Based approach to automate testing of applications at the GUI level whose objective is to generate test cases based on a model that is automatically  ...  Testing software applications at the Graphical User Interface (GUI) level is a very important testing phase to ensure realistic tests because the GUI represents a central juncture in the application under  ...  In previous work, we have presented TESTAR [5, 6, 3] , a Model-Based approach to automate testing at the GUI level.  ... 
dblp:conf/sattose/BauersfeldV14 fatcat:rkv7pwzsyra47f5vgsfnrnpfou

GUITAR: an innovative tool for automated testing of GUI-driven software

Bao N. Nguyen, Bryan Robbins, Ishan Banerjee, Atif Memon
2013 Automated Software Engineering : An International Journal  
., model-based, capture/replay, manually scripted) for effective GUI testing. Yet, the tools available today for GUI testing are limited in the techniques they support.  ...  We term GUI testing as the process of testing a software application through its GUI.  ...  Monkey, a tool for random walking of Android application GUIs 2. NModel, a model-based testing framework for C# programs 3.  ... 
doi:10.1007/s10515-013-0128-9 fatcat:72pi5kcg6vc3xfgeq3rgxxkmgu


2017 Asia Pacific Journal of Contemporary Education and Communication Technology  
This paper presents an overview of recent work done in the area of automated GUI based testing of Android applications.  ...  The traditional GUI testing of today's smart phones is not enough to test the Android application.  ...  Client server based model Testing based on Image flow Images are taken as input Silkuli Tool Based TEMA Tools Model based Model based GUI testing for web based android applications Model based  ... 
doi:10.25275/apjcectv3i2ict1 fatcat:75iwd6aopzgsflcrfhlre22dfi

Parameterized GUI Tests [chapter]

Stephan Arlt, Pedro Borromeo, Martin Schäf, Andreas Podelski
2012 Lecture Notes in Computer Science  
GUI testing is a form of system testing where test cases are based on user interactions.  ...  The approach is based on the new notion of parameterized GUI tests. We have implemented the approach in a new tool.  ...  Introduction GUI testing is a form of system testing where test cases are based on user interactions.  ... 
doi:10.1007/978-3-642-34691-0_18 fatcat:duc72szigjc6rhbihspptq6pgy

Glyph-Based Visualization of Affective States

Nikola Kovacevic, Rafael Wampfler, Barbara Solenthaler, Markus Gross, Tobias Günther
2020 Eurographics Conference on Visualization  
In a user study with 644 participants, the widgets were evaluated in relation to a baseline widget and were tested on intuitiveness and understandability.  ...  In the entertainment industry, game mechanics can be adapted based on the boredom and frustration levels of a player.  ...  Thus, we mapped affective keywords to the images instead, and then tested and improved the choice of images as well as sentences in a pilot study (n = 10).  ... 
doi:10.2312/evs.20201059 dblp:conf/vissym/KovacevicWSGG20 fatcat:sbxibnu4yfa2jfibts5ks32spa

DroidbotX: Test Case Generation Tool for Android Applications Using Q-Learning

Husam N. Yasin, Siti Hafizah Ab Hamid, Raja Jamilah Raja Yusof
2021 Symmetry  
A Q-Learning-based test coverage approach developed in DroidbotX was proposed to generate GUI test cases for Android applications to maximize instruction coverage, method coverage, and activity coverage  ...  Such tools must choose not only which user interface element to interact with, but also which type of action to be performed, in order to increase the percentage of code coverage and to detect faults with  ...  Implementation Q-Learning technique with UCB exploration strategy was adopted to generate a GUI test case for Android apps to improve coverage and crash detection.  ... 
doi:10.3390/sym13020310 fatcat:6v6ovsadavfr7nkaxoujcgymsq

SSLDetecter: Detecting SSL Security Vulnerabilities of Android Applications Based on a Novel Automatic Traversal Method

Junwei Tang, Jingjing Li, Ruixuan Li, Hongmu Han, Xiwu Gu, Zhiyong Xu
2019 Security and Communication Networks  
Existing methods based on static decompiling technology to detect SSL security vulnerabilities of Android applications cannot cope with the increasingly common packed applications.  ...  Compared with the existing system SMV-HUNTER, the time efficiency of our system increases by 38% and the average detection rate increases by 6.39 percentage points, with many types of SSL vulnerabilities  ...  Monkey drives the automation of applications based on a sequence of random events, while our system is based on application widgets.  ... 
doi:10.1155/2019/7193684 fatcat:ldbrr77hfzgwvjsgdvyiew3eyq
« Previous Showing results 1 — 15 out of 1,119 results