Innovaciones tecnológicas en la evaluación psicológica: reflexiones sobre su impacto y aplicaciones en la psicometría contemporánea
Resumen
En el ámbito de la evaluación psicológica, se puede observar un viraje en el uso de métodos tradicionales hacia procedimientos que incorporan innovaciones tecnológicas, tales como plataformas digitales, videojuegos, chatbots, realidad virtual e inteligencia artificial. El objetivo de este ensayo es describir las innovaciones tecnológicas actualmente disponibles y las que se encuentran en vías de desarrollo en el ámbito de la evaluación psicológica. Estas herramientas, conocidas por sus siglas en inglés TBA (technology-based assessment), se caracterizan por ser evaluaciones basadas en un tipo de tecnología particular: la digital. En este trabajo, se describen los distintos tipos de TBA y se presentan diferentes desarrollos disponibles para evaluar un amplio abanico de variables psicológicas. Se detalla la creciente inclusión de TBA en el ámbito de la evaluación psicológica y se ponderan las ventajas y limitaciones que su uso conlleva. Finalmente, se realiza un recorrido por los lineamientos internacionales que se han consensuado en cuanto al desarrollo de TBA que sean válidas, confiables y justas y su uso. Se concluye que la incorporación de TBA en procesos de evaluación psicológica podría resultar ventajosa en cuanto a la accesibilidad y el engagement. Asimismo, este tipo de tecnologías superarían en abundancia y variedad al cúmulo de información obtenido por métodos tradicionales.
Descargas
Citas
American Psychological Association. (2017). Ethical principles of psychologists and code of conduct. http://www.apa.org/ethics/code/index.html
Arslan, B., Jiang, Y., Keehner, M., Gong, T., Katz, I., & Yan, F. (2020). The effect of drag‐and‐drop item features on test‐taker performance and response strategies. Educational measurement: Issues and practice, 39(2), 96-106. https://doi.org/10.1111/emip.12326
Ashford, L. J., Spivak, B. L., Ogloff, J. R. P., & Shepherd, S. M. (2023). Statistical learning methods and cross-cultural fairness: Trade-offs and implications for risk assessment instruments. Psychological Assessment, 35(6), 484-496. https://dx.doi.org/10.1037/pas0001228
Bravo García, L. Y., & Losada, A. V. (2023). Vulnerability to child sexual abuse: NOABS tool. Quaderns de Psicologia, 25(1), Artículo e1742. https://doi.org/10.5565/rev/qpsicologia.1742
Butcher, J. N., Perry, J., & Hahn, J. (2004). Computers in clinical assessment: Historical developments, present status, and future challenges. Journal of Clinical Psychology, 60(3), 331-345. https://doi.org/10.1002/jclp.10267
Cacheda, F., Fernandez, D., Novoa, F. J., & Carneiro, V. (2019). Early detection of depression: Social network analysis and random forest techniques. Journal of Medical Internet Research, 21(6), Artículo e12554. https://doi.org/10.2196/12554
Cannata, D., Breil, S. M., Lepri, B., Back, M. D., & O’Hora, D. (2022). Toward an integrative approach to nonverbal personality detection: Connecting psychological and artificial intelligence research. Technology, Mind, and Behavior, 3(2), 1-16. https://doi.org/10.1037/tmb0000054
Chitale, V., Baghaei, N., Playne, D., Liang, H. N., Zhao, Y., Erensoy, A., & Ahmad, Y. (2022). The use of videogames and virtual reality for the assessment of anxiety and depression: A scoping review. Games for Health Journal, 11(6), 341-354. https://doi.org/10.1089/g4h.2021.0227
Cohen, R. J., & Swerdlik, M. E. (2017). Psychological testing and assessment: An introduction to tests and measurement (9.a ed.). McGraw-Hill.
Cooper, C. (2023). An introduction to psychometrics and psychological assessment: Using, interpreting and developing tests (2.a ed.). Routledge.
Drake, P., Hartig, J., Froitzheim, M., Mau, G., Schramm-Klein, H., & Schuhen, M. (2023). Theory-based behavioral indicators for children’s purchasing self-control in a computer-based simulated supermarket. European Journal of Psychological Assessment, 39(4), 289-298. https://doi.org/10.1027/1015-5759/a000757
Fan, J., Sun, T., Liu, J., Zhao, T., Zhang, B., Chen, Z., Glorioso, M., & Hack, E. (2023). How well can an AI chatbot infer personality? Examining psychometric properties of machine-inferred personality scores. Journal of Applied Psychology, 108(8), 1277-1299. https://doi.org/10.1037/apl0001082
Farmer, R. L., McGill, R. J., Dombrowski, S. C., Benson, N. F., Smith-Kellen, S., Lockwood, A. B., Powell, S., Pynn, C., & Stinnett, T. A. (2021). Conducting psychoeducational assessments during the COVID-19 crisis: The danger of good intentions. Contemporary School Psychology, 25(1), 27-32. https://doi.org/10.1007/s40688-020-00293-x
Flens, G., Smits, N., Terwee, C. B., Dekker, J., Huijbrechts, I., Spinhoven, P., & de Beurs, E. (2019). Development of a Computerized Adaptive Test for Anxiety based on the Dutch-Flemish version of the PROMIS item bank. Assessment, 26(7), 1362-1374. https://doi.org/10.1177/1073191117746742
Fortea, L., Tortella-Feliu, M., Juaneda-Seguí, A., De la Peña-Arteaga, V., Chavarría-Elizondo, P., Prat-Torres, L., Soriano-Mas, C., Lane, S. P., Radua, J., & Fullana, M. A. (2023). Development and validation of a smartphone-based app for the longitudinal assessment of anxiety in daily life. Assessment, 30(4), 959-968. https://doi.org/10.1177/10731911211065166
Gilbert, K., Benson, N. F., & Kranzler, J. H. (2023). What does the digital administration format of the Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V) measure? Contemporary School Psychology, 27, 623-633. https://doi.org/10.1007/s40688-022-00447-z
Gnambs, T. (2022). The web-based assessment of mental speed: An experimental study of testing mode effects for the trail-making test. European Journal of Psychological Assessment, 39(5), 349-353. https://doi.org/10.1027/1015-5759/a000711
Gnosis Kids. (2022). Kiki en equilibrio [Software].
Graham, S., Depp, C., Lee, E. E., Nebeker, C., Tu, X., Kim, H. C., & Jeste, D. V. (2019). Artificial intelligence for mental health and mental illnesses: An overview. Current Psychiatry Reports, 21(11), Artículo 116. https://doi.org/10.1007/s11920-019-1094-0
Granziol, U., Brancaccio, A., Pizziconi, G., Spangaro, M., Gentili, F., Bosia, M., Gregori, E., Luperini, C., Pavan, C., Santarelli, V., Cavallaro, R., Cremonese, C., Favaro, A., Rossi, A., Vidotto, G., & Spoto, A. (2020). On the implementation of computerized adaptive observations for psychological assessment. Assessment, 29(2), 225-241. https://doi.org/10.1177/1073191120960215
Hodent, C. (2017). The gamer’s brain: How neuroscience and UX can impact video game design. Crc Press. https://doi.org/10.1201/9781315154725
Huff, K. L., & Sireci, S. G. (2001). Validity issues in computer‐based testing. Educational measurement: Issues and Practice, 20(3), 16-25. https://doi.org/10.1111/j.1745-3992.2001.tb00066.x
Hungerbuehler, I., Daley, K., Cavanagh, K., Garcia Claro, H., & Kapps, M. (2021). Chatbot-based assessment of employees’ mental health: Design process and pilot implementation. JMIR Formative Research, 5(4), Artículo e21678. https://doi.org/10.2196/21678
Iliescu, D., Greiff, S., Ziegler, M., & Fokkema, M. (2022). Artificial intelligence, machine learning, and other demons. European Journal of Psychological Assessment, 38(3), 163-164. https://doi.org/10.1027/1015-5759/a000713
International Test Commission and Association of Test Publishers. (2022). Guidelines for technology-based assessment. ATP Global.
Jahidin, A. H., Taib, M. N., Tahir, N. M., & Megat Ali, M. S. A. (2015). IQ classification via brainwave features: Review on artificial intelligence techniques. International Journal of Electrical & Computer Engineering, 5(1), 84-91. https://ijece.iaescore.com/index.php/IJECE/article/view/5620/4784
Javed, A. R., Saadia, A., Mughal, H., Gadekallu, T. R., Rizwan, M., Maddikunta, P. K. R., Mahmud, M., & Hussain, A. (2023). Artificial intelligence for cognitive health assessment: State-of-the-art, open challenges and future directions. Cognitive Computation, 15(6), 1767-1812. https://doi.org/10.1007/s12559-023-10153-4
Kim, W. P., Kim, H. J., Pack, S. P., Lim, J. H., Cho, C. H., & Lee, H. J. (2023). Machine learning–based prediction of attention-deficit/hyperactivity disorder and sleep problems with wearable data in children. JAMA Network Open, 6(3), Artículo e233502. https://doi.org/10.1001/jamanetworkopen.2023.3502
Krach, S. K., Paskiewicz, T. L., & Monk, M. M. (2020). Testing our children when the world shuts down: Analyzing recommendations for adapted tele-assessment during COVID-19. Journal of Psychoeducational Assessment, 38(8), 923-941. https://doi.org/10.1177/0734282920962839
Kourtesis, P., Collina, S., Doumas, L. A. A., & MacPherson, S. E. (2020). Validation of the Virtual Reality Everyday Assessment Lab (VR-EAL): An immersive virtual reality neuropsychological battery with enhanced ecological validity. Journal of the International Neuropsychological Society, 27(2), 181-196. https://doi.org/10.1017/S1355617720000764
Leong, F. T. L., Bartram, D. Cheung, F. M., Geisinger, K. F., & Iliescu, D. (2016). The ITC international handbook of testing and assessment. Oxford University Press.
Lindner, M. A., & Greiff, S. (2023). Process data in computer-based assessment. European Journal of Psychological Assessment, 39(4), 241-251. https://doi.org/10.1027/1015-5759/a000790
López Steinmetz, L. C. & Godoy, J. C. (2023). Posibles aplicaciones prácticas del uso de Machine Learning (ML) en la investigación y práctica de la clínica psicológica. Acta Psiquiátrica y Psicológica de América Latina, 69(4), 266-272. https://ri.conicet.gov.ar/handle/11336/234969
Losada, A. & Gaggino, M. (2023). Avances acerca del juego interactivo NOABS de diagnóstico de vulnerabilidad y prevención del ASI [Presentación de escrito]. XVII Jornadas de Informática en Salud, Buenos Aires, Argentina.
Nawaiam Ltd. (2019). Nawaiam [Software].
O’Brien, M., & McNicholas, F. (2020). The use of telepsychiatry during COVID-19 and beyond. Irish Journal of Psychological Medicine, 37(4), 250-255. https://doi.org/10.1017/ipm.2020.54
Pellert, M., Lechner, C. M., Wagner, C., Rammstedt, B., & Strohmaier, M. (2024). AI psychometrics: Assessing the psychological profiles of large language models through psychometric inventories. Perspectives on Psychological Science, 19(5), 808-826. https://doi.org/10.1177/17456916231214460
Pokropek, A., Żółtak, T., & Muszyński, M. (2023). Mouse chase. Detecting careless and unmotivated responders using cursor movements in web-based surveys. European Journal of Psychological Assessment, 39(4), 299-306. https://doi.org/10.1027/1015-5759/a000758
Quwaider, M., Alabed, A., & Duwairi, R. (2023). Shooter video games for personality prediction using five factor model traits and machine learning. Simulation Modelling Practice and Theory, 122, Artículo 102665. https://doi.org/10.1016/j.simpat.2022.102665
Ramos-Villagrasa, P. J., & Fernández del Río, E. (2023). Predictive validity, applicant reactions, and influence of personal characteristics of a gamefully designed assessment. Journal of Work and Organizational Psychology, 39(3), 169-178. https://doi.org/10.5093/jwop2023a18
Rosas, R., Ceric, F., Aparicio, A., Arango, P., Arroyo, R., Benavente, C., Escobar, P., Olguín, P., Pizarro, M., Ramírez, M. P., Tenorio, M., & Véliz, S. (2015). ¿Pruebas Tradicionales o Evaluación Invisible a Través del Juego? Nuevas Fronteras de la Evaluación Cognitiva. Psykhe, 24(1), 1-11. https://doi.org/10.7764/psykhe.24.1.724
Sawyer, S. M. (2021). Psychosocial assessments after COVID-19. Journal of Adolescent Health, 68(3), 429-430. https://doi.org/10.1016/j.jadohealth.2020.12.126
Schick, A., Feine, J., Morana, S., Maedche, A., & Reininghaus, U. (2022). Validity of chatbot use for mental health assessment: Experimental study. JMIR MHealth and UHealth, 10(10), Artículo e28082. https://doi.org/10.2196/28082
Shahamiri, S. R., & Thabtah, F. (2020). Autism AI: A new autism screening system based on artificial intelligence. Cognitive Computation, 12, 766-777. https://doi.org/10.1007/s12559-020-09743-3
Tan, Q., Cai, Y., Li, Q., Zhang, Y., & Tu, D. (2018). Development and validation of an item bank for depression screening in the Chinese population using computer adaptive testing: A Simulation study. Frontiers in Psychology, 9, Artículo 1225. https://doi.org/10.3389/fpsyg.2018.01225
Veerbeek, J., & Vogelaar, B. (2023). Computerized process-oriented dynamic testing of children’s ability to reason by analogy using log data. European Journal of Psychological Assessment, 39(4), 263-273. https://doi.org/10.1027/1015-5759/a000749
Wang, P., Fang, Y., Qi, J.-Y., & Li, H.-J. (2023). FISHERMAN: A serious game for executive function assessment of older adults. Assessment, 30(5), 1499-1513. https://doi.org/10.1177/10731911221105648
Wiebe, A., Kannen, K., Li, M., Aslan, B., Anders, D., Selaskowski, B., Ettinger, U., Philipsen, A., & Braun, N. (2023). Multimodal virtual reality-based assessment of adult ADHD: A feasibility study in healthy subjects. Assessment, 30(5), 1435-1453. https://doi.org/10.1177/10731911221089193
Wigdorowitz, M., Rajab, P., Hassem, T., & Titi, N. (2021). The impact of COVID-19 on psychometric assessment across industry and academia in South Africa. African Journal of Psychological Assessment, 3, Artículo a38. https://doi.org/10.4102/ajopa.v3i0.38
Wools, S., Molenaar, M., & Hopster-den Otter, D. (2019). The validity of technology enhanced assessments – threats and opportunities. En B. P. Veldkamp & C. Sluijter (Eds.), Theoretical and practical advances in computer-based educational measurement (pp. 3-19). Springer International Publishing. https://doi.org/10.1007/978-3-030-18480-3_1
Wosik, J., Fudim, M., Cameron, B., Gellad, Z. F., Cho, A., Phinney, D., Curtis, S., Roman, M., Poon, E. G., Ferranti, J., Katz, J. N., & Tcheng, J. (2020). Telehealth transformation: COVID-19 and the rise of virtual care. Journal of the American Medical Informatics Association, 27(6), 957-962. https://doi.org/10.1093/jamia/ocaa067
Wright, A. J. (2020). Equivalence of remote, digital administration and traditional, in-person administration of the Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V). Psychological Assessment, 32(9), 809-817. https://doi.org/10.1037/pas0000939
Wright, J., Mihura, J., Pade, H., & McCord, D. (2020). Guidance on psychological tele-assessment during the COVID-19 crisis. American Psychological Association. https://www.apaservices.org/practice/reimbursement/health-codes/testing/tele-assessment-covid-19
Wrzus, C., & Neubauer, A. B. (2023). Ecological momentary assessment: A meta-analysis on designs, samples, and compliance across research fields. Assessment, 30(3), 825-846. https://doi.org/10.1177/10731911211067538
Zhou, S., Zhao, J., & Zhang, L. (2022). Application of artificial intelligence on psychological interventions and diagnosis: An overview. Frontiers in Psychiatry, 13, Artículo 811665. https://doi.org/10.3389/fpsyt.2022.811665
Zhu, Y., Maikusa, N., Radua, J., Sämann, P. G., Fusar-Poli, P., Agartz, I., Andreassen, O. A., Bachman, P., Baeza, I., Chen, X., Choi, S., Corcoran, C. M., Ebdrup, B. H., Fortea, A., Garani, R. R. G., Glenthoj, B. Y., Glenthoj, L. B., Hass, S. S., Hamilton, H. K., ... & Koike, S. (2024). Using brain structural neuroimaging measures to predict psychosis onset for individuals at clinical high-risk. Molecular Psychiatry, 29, 1465-1477. https://doi.org/10.1038/s41380-024-02426-7
Zieschank, K., Ireland, M. J., Day, J., & March, S. (2022). Psychometric evaluation of a new digitally animated child self-report assessment instrument: The Interactive Child Distress Screener. Assessment, 30(3), 907-922. https://doi.org/10.1177/10731911211072907
Zumbo, B. D. (2023). A dialectic on validity: Explanation-focused and the many ways of being human. International Journal of Assessment Tools in Education, 10, 1-96. https://doi.org/10.21449/ijate.1406304
Zumbo, B. D., Maddox, B., & Care, N. M. (2023). Process and product in computer-based assessments: Clearing the ground for a holistic validity framework. European Journal of Psychological Assessment, 39(4), 252-262. https://doi.org/10.1027/1015-5759/a000748
Esta obra está bajo licencia internacional Creative Commons Reconocimiento 4.0.
La aceptación de publicación implica ceder los derechos de impresión y de reproducción por cualquier forma y medio al editor, manteniendo el autor la propiedad intelectual del artículo.