Towards Sketch-based User Interaction with Integrated Software Development Environments

Sigurdur Gauti Samuelsson, Matthias Book
2020 Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops  
Powerful software tools, such as software development environments, often have complex graphical user interfaces (GUIs) that are not intuitive to handle, especially when performing complex, multistep operations. We hypothesize that sketching could be a more intuitive way of expressing user intentions than navigating nested menus or memorizing keyboard shortcuts to accomplish complex operations. Enabling this vision requires software capable of both allowing the user to sketch anywhere on a GUI,
more » ... and interpreting those sketches as specific commands to be performed within the integrated development environment (IDE). In this paper, we report on preliminary results of an elicitation study performed to gather insights into how developers would use a sketch-based interface. CCS CONCEPTS • Human-centered computing → Interaction techniques; Empirical studies in interaction design; Touch screens; • Software and its engineering → Integrated and visual development environments.
doi:10.1145/3387940.3392231 dblp:conf/icse/SamuelssonB20 fatcat:wnowpduimfdxdctqlhaiwuq5ny