A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is
In this paper, we put forward a novel approach wherein we employ a Deep Neural Network that is trained on our custom database of such sketches to detect UI elements in the input sketch. ... Detection of objects in sketches is a peculiar visual recognition task that requires a specific solution that our deep neural network model attempts to provide. ... CONCLUSION The presented work, Sketch2Code, demonstrates that we can train a neural network to identify UI elements in hand-drawn sketches. ...arXiv:1910.08930v1 fatcat:763vrwlharfjrnn656a4t2elze
The manual transformation of a user interface design into code is a costly and time-consuming process. ... These results can be used by researchers and practitioners in order to improve the efficiency of the GUI design process as well as continue to evolve and improve approaches for its support. ... Acknowledgements This work was supported by CNPq (Conselho Nacional de Desenvolvimento Científico e Tecnológicowww.cnpq.br), an entity of the Brazilian government focused on scientific and technological ...doi:10.3897/jucs.2020.058 fatcat:nil4nwhs7vhqfphkwkrg6i2jky
CHI Conference on Human Factors in Computing Systems Extended Abstracts
Recent research on automating the transformation of low fdelity (LoFi) sketches to code using Deep Neural Networks require a largescale dataset for generalizable results. ... This dataset enables further research on several avenues of AI assistance in UI design, such as UI element detection, sketch completion, UI layout refnement, and Sketch-based image retrieval. ... As a solution, several recent research projects endeavoured to generate code from LoFi sketches and wireframes using Deep Neural Networks (DNNs). ...doi:10.1145/3491101.3519624 fatcat:i5zkska27nafrfbdricjrskhmu
In this study, the authors employed YOLOv5 is a fast and accurate deep learning framework to automate the process of converting hand-drawn GUI mockups into Android-based GUI prototype. ... However, this transformation usually takes time especially when GUI changes keep pace with evolutionary features. ... They employ a deep neural network that is trained on a custom database of sketches to detect UI elements. The output from the network is a platform-independent UI representation object. ...doi:10.1049/iet-sen.2019.0378 fatcat:qjtjpmtg75adpicrl4b2najx4y
This process can take up a large amount of resource real estate, and as we have laid out in this paper, by using a Model consisting of various Neural Networks trained on a custom dataset. ... Over the past 20 years, the boom in how much the internet is used and the sheer volume of pages on it demands a high level of work and time to create them. ... Acknowledgement: We would like to thank Sir Syed CASE Institute of Technology for their resources and help throughout both the development of this project, as well as our time gaining the knowledge and ...doi:10.32604/cmc.2022.024819 fatcat:epoaf7f3brcmzk3qjmk7ikwoxy