5 Hits in 1.5 sec

Sketch2Code: Transformation of Sketches to UI in Real-time Using Deep Neural Network [article]

Vanita Jain, Piyush Agrawal, Subham Banga, Rishabh Kapoor, Shashwat Gulyani
2019 arXiv   pre-print
In this paper, we put forward a novel approach wherein we employ a Deep Neural Network that is trained on our custom database of such sketches to detect UI elements in the input sketch.  ...  Detection of objects in sketches is a peculiar visual recognition task that requires a specific solution that our deep neural network model attempts to provide.  ...  CONCLUSION The presented work, Sketch2Code, demonstrates that we can train a neural network to identify UI elements in hand-drawn sketches.  ... 
arXiv:1910.08930v1 fatcat:763vrwlharfjrnn656a4t2elze

Recent Progress in Automated Code Generation from GUI Images Using Machine Learning Techniques

Daniel Baulé, Christiane Gresse von Wangenheim, Aldo Wangenheim, Jean Carlo Rossa Hauck
2020 Journal of universal computer science (Online)  
The manual transformation of a user interface design into code is a costly and time-consuming process.  ...  These results can be used by researchers and practitioners in order to improve the efficiency of the GUI design process as well as continue to evolve and improve approaches for its support.  ...  Acknowledgements This work was supported by CNPq (Conselho Nacional de Desenvolvimento Científico e Tecnoló, an entity of the Brazilian government focused on scientific and technological  ... 
doi:10.3897/jucs.2020.058 fatcat:nil4nwhs7vhqfphkwkrg6i2jky

LoFi Sketch: A Large Scale Dataset of Smartphone Low Fidelity Sketches

Vinoth Pandian Sermuga Pandian, Abdullah Shams, Sarah Suleri, Prof. Dr. Matthias Jarke
2022 CHI Conference on Human Factors in Computing Systems Extended Abstracts  
Recent research on automating the transformation of low fdelity (LoFi) sketches to code using Deep Neural Networks require a largescale dataset for generalizable results.  ...  This dataset enables further research on several avenues of AI assistance in UI design, such as UI element detection, sketch completion, UI layout refnement, and Sketch-based image retrieval.  ...  As a solution, several recent research projects endeavoured to generate code from LoFi sketches and wireframes using Deep Neural Networks (DNNs).  ... 
doi:10.1145/3491101.3519624 fatcat:i5zkska27nafrfbdricjrskhmu

Deep learning-based prototyping of android GUI from hand-drawn mockups

Abdelaziz A. Abdelhamid, Sultan R. Alotaibi, Abdelaziz Mousa
2020 IET Software  
In this study, the authors employed YOLOv5 is a fast and accurate deep learning framework to automate the process of converting hand-drawn GUI mockups into Android-based GUI prototype.  ...  However, this transformation usually takes time especially when GUI changes keep pace with evolutionary features.  ...  They employ a deep neural network that is trained on a custom database of sketches to detect UI elements. The output from the network is a platform-independent UI representation object.  ... 
doi:10.1049/iet-sen.2019.0378 fatcat:qjtjpmtg75adpicrl4b2najx4y

Transforming Hand Drawn Wireframes into Front-End Code with Deep Learning

Saman Riaz, Ali Arshad, Shahab S. Band, Amir Mosavi
2022 Computers Materials & Continua  
This process can take up a large amount of resource real estate, and as we have laid out in this paper, by using a Model consisting of various Neural Networks trained on a custom dataset.  ...  Over the past 20 years, the boom in how much the internet is used and the sheer volume of pages on it demands a high level of work and time to create them.  ...  Acknowledgement: We would like to thank Sir Syed CASE Institute of Technology for their resources and help throughout both the development of this project, as well as our time gaining the knowledge and  ... 
doi:10.32604/cmc.2022.024819 fatcat:epoaf7f3brcmzk3qjmk7ikwoxy