Design of interactive system interfaces using machine learning techniques: a review of design and usability
DOI:
https://doi.org/10.26439/interfases2022.n016.6028Keywords:
user interface (UI), user experience (UX), machine learning (ML), usabilityAbstract
This article presents different approaches to user interface design through machine learning techniques. It reviews various approaches to interface design, such as combinational optimizers, frameworks, and free-of-text interface design. Moreover, it shows how interface design with machine learning techniques is based on usability and user experience (UX). Likewise, the design process uses interactions stored in persistence systems or databases, which are then analyzed with machine learning techniques. Another design approach uses sketches and graphic layouts and, after evaluating their usability, uses image recognition algorithms to generate the interfaces; these designs are generally for mobile devices. Some techniques also analyze usability but focus more on the user’s bodily functions (movement, biological functions such as blood pressure, heartbeat, etcetera); this data can also be analyzed with machine learning algorithms to generate user interfaces.
Downloads
References
Akinsola, J. E. T., Akinseinde, S., Kalesanwo, O., Adeagbo, M., Oladapo, K., Awoseyi, A., & Kasali, F. (2021). Application of artificial intelligence in user interfaces design for cyber security threat modeling. En L. M. Castro, D. Cabrero & R. Heimgärtner (Eds.), Software usability. IntechOpen. https://www.intechopen.com/chapters/76094
Braun, M., Weber, F., & Alt, F. (2021). Affective automotive user interfaces. Reviewing the state of driver affect research and emotion regulation in the car. ACM Computing Surveys (CSUR), 54(7), 1-26. https://doi.org/10.1145/3460938
Buschek, D., Anlauff, C., & Lachner, F. (2020, September). Paper2Wire: A case study of user-centred development of machine learning tools for UX designers. En Proceedings of the Conference on Mensch und Computer (pp. 33-41). https://dl.acm.org/doi/abs/10.1145/3404983.3405506
Cruz-Benito, J., Vázquez-Ingelmo, A., Sánchez-Prieto, J. C., Therón, R., García-Peñalvo, F. J., & Martín-González, M. (2017). Enabling adaptability in web forms based on user characteristics detection through A/B testing and machine learning. IEEE Access, 6, 2251-2265. https://ieeexplore.ieee.org/abstract/document/8240912
Ferreira, J. M., Acuña, S. T., Dieste, O., Vegas, S., Santos, A., Rodríguez, F., & Juristo, N. (2020). Impact of usability mechanisms: An experiment on efficiency, effectiveness and user satisfaction. Information and Software Technology, 117, 106195. http://jultika.oulu.fi/files/nbnfi-fe202002054561.pdf
Ilyas, Q. M., Ahmad, M., Zaman, N., Alshamari, M. A., & Ahmed, I. (2021). Localized text-free user interfaces. IEEE Access, 10, 2357-2371. https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9665747
Joo, M., & Lee, W. (2019). WebProfiler: User interaction prediction framework for web applications. IEEE Access, 7, 154946-154958. https://ieeexplore.ieee.org/abstract/document/8880603
Lee, K. T., Yoon, H., & Lee, Y. S. (2018). Implementation of smartwatch user interface using machine learning based motion recognition. En 2018 International Conference on Information Networking (ICOIN) (pp. 807-809). http://csc.villanova.edu/~beck/csc8570/papers/lee.pdf
Mezhoudi, N. (2013). User interface adaptation based on user feedback and machine learning. En Proceedings of the companion publication of the 2013 International Conference on Intelligent User Interfaces Companion (pp. 25-28). https://dial.uclouvain.be/pr/boreal/object/boreal%3A153816/datastream/PDF_01/view
Moran, K., Bernal-Cárdenas, C., Curcio, M., Bonett, R., & Poshyvanyk, D. (2018). Machine learning-based prototyping of graphical user interfaces for mobile apps. IEEE Transactions on Software Engineering, 46(2), 196-221. https://ieeexplore.ieee.org/abstract/document/8374985
Oulasvirta, A., Dayama, N. R., Shiripour, M., John, M., & Karrenbauer, A. (2020). Combinatorial optimization of graphical user interface designs. Proceedings of the IEEE, 108(3), 434-464. https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9000519
Pressman, R. S. (2010). Ingeniería del software. Un enfoque práctico. McGraw-Hill.
Sackl, M., Steinmaurer, A., Cheong, C., Cheong, F., Filippou, J., & Gütl, C. (2020). sCool: Impact on human-computer interface improvements on learner experience in a game-based learning platform. En International Conference on Interactive Collaborative Learning (pp. 439-451). Springer. https://www.researchgate.net/profile/Alexander-Steinmaurer-3/publication/350001425_sCool_Impact_on_Human-Computer_Interface_Improvements_on_Learner_Experience_in_a_Game-Based_Learning_Platform/links/606cb77092851c4f268661c4/sCool-Impact-on-Human-Computer-Interface-Improvements-on-Learner-Experience-in-a-Game-Based-Learning-Platform.pdf
Sánchez, W. O. (2015). La usabilidad en ingeniería de software: definición y características. Ing-novación, 2, 7-21. http://www.redicces.org.sv/jspui/bitstream/10972/1937/1/2.%20La%20usabilidad%20en%20Ingenieria%20de%20Software-%20definicion%20y%20caracteristicas.pdf
Sanctorum, A., & Signer, B. (2019). A unifying reference framework and model for adaptive distributed hybrid user interfaces. En 2019 13th International Conference on Research Challenges in Information Science (RCIS) (pp. 1-6). https://ieeexplore.ieee.org/abstract/document/8877048
Sboui, T., Ayed, M. B., & Alimi, A. M. (2017). A UI-DSPL approach for the development of context-adaptable user interfaces. IEEE Access, 6, 7066-7081. https://ieeexplore.ieee.org/abstract/document/8194842
Shackel, B., & Richardson, S. J. (Eds.). (1991). Human factors for informatics usability. Cambridge University Press.
Yang, B., Wei, L., & Pu, Z. (2020). Measuring and improving user experience through artificial intelligence-aided design. Frontiers in Psychology, 11, 595374. https://www.frontiersin.org/articles/10.3389/fpsyg.2020.595374/full
Yang, Q. (2017). The role of design in creating machine-learning-enhanced user experience. En The AAAI 2017 Spring Symposium on Designing the User Experience of Machine Learning Systems (pp. 406-411). https://www.aaai.org/ocs/index.php/SSS/SSS17/paper/viewFile/15363/14575
Yang, Q. (2018). Machine learning as a UX design material: How can we imagine beyond automation, recommenders, and reminders? AAAI Spring Symposia. https://www.researchgate.net/profile/Qian-Yang-19/publication/324077664_Machine_Learning_as_a_UX_Design_Material_How_Can_We_Imagine_Beyond_Automation_Recommenders_and_Reminders/links/5b3cfe2ca6fdcc8506f560e1/Machine-Learning-as-a-UX-Design-Material-How-Can-We-Imagine-Beyond-Automation-Recommenders-and-Reminders.pdf
Downloads
Published
Issue
Section
License
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under an Attribution 4.0 International (CC BY 4.0) License. that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Last updated 03/05/21
