FINDING USER INTERFACE COMPONENTS USING MACHINE LEARNING
DOI:
https://doi.org/10.34185/1991-7848.itmm.2023.01.083Keywords:
UI, recognize, neural network, component, design, libraryAbstract
Modern technologies and products are becoming more complex and multi-component, which requires the creation of a convenient and intuitive user interface. One way to ease the interface development process is to use machine learning techniques to find user interface components and generate ready-made templates for subsequent software development. There are several approaches and methods that can be used to detect UI components on a finished design using machine learning: - Image segmentation; - Layout Analysis; - Component Recognition Libraries; - Neural networks; This mechanism will allow in the future to be used in various areas related to the development and design of the user interface.
References
Long, J.; Shelhamer, E. & Darrell, T. (2014), Fully convolutional networks for semantic segmentation
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Vijay Badrinarayanan, Alex Kendall, Roberto Cipolla, Senior Member, IEEE, 2015
