DETECTION OF MENTAL DISORDERS BASED ON THE ANALYSIS OF EMOTION, FACIAL EXPRESSIONS AND FACIAL MOVEMENTS IN A VIDEO STREAM

Authors

DOI:

https://doi.org/10.26577/jpcsit2025337

Keywords:

emotion recognition, video models, individual differences, personalized models, deep learning, affective computing

Abstract

Traditional emotion recognition systems often rely on generalized person-centered models that do not consider the variability of individual emotion expression. This paper explores individual differences in emotion expression and facial expressions for recognizing mental disorders based on video streaming. Using machine learning techniques and deep learning algorithms, we aim to create an algorithm for emotion recognition using a personalized approach. The paper discusses the data collection methods, the condition and the impact of personalization on recognition accuracy. Experimental results demonstrate the advantages of automated personalized models over traditional models, highlighting their potential in the field of affective computing. The study also addresses ethical implications, advocating for bias-mitigated training through cross-cultural datasets and user-controlled calibration. With help of real-time edge computing, our system enables scalable, privacy-preserving mental health monitoring, underscoring the transformative potential of adaptive affective computing and remote diagnostics.

Downloads

Download data is not yet available.

Author Biographies

Aizhan Nurzhanova, L.N. Gumilyov Eurasian National University, Astana, Kazakhstan

Aizhan Nurzhanova is a 1st year doctoral student in the Department of Computer and Software Engineering at L.N. Gumilyov Eurasian National University (Astana, Kazakhstan, nuraizhan87@mail.ru, +77028307620). Her research interests include video-based emotion recognition, facial expression analysis, and machine learning applications in mental health. ORCID iD: 0009-0006-9871-9823.

Miras Mussabek, Astana IT University, Astana, Kazakhstan

Miras Mussabek is a 1st year doctoral student in the Department of Computer Engineering at Astana IT University (Astana, Kazakhstan, miras.k@astanait.edu.kz, +77071771011). His research interests include video-based detection, recognition. ORCID iD: 0009-0009-2353-3524.

Gokhan Ince, Istanbul Technical University, Istanbul, Turkey

Dr. Gokhan Ince is an Associate Professor in the Computer Engineering Department, Faculty of Computer and Informatics Engineering at Istanbul Technical University (Istanbul, Turkey, gokhan.ince@itu.edu.tr, +90 (212) 285 69 86 ext: 6986). He has extensive experience in signal processing, affective computing, and human–robot interaction. ORCID iD: 0000-0002-0034-030X.

Mas Rina Mustaffa, Universiti Putra Malaysia, Serdang, Malaysia

Dr. Mas Rina Mustaffa is an Associate Professor at the Faculty of Computer Science, University Putra Malaysia (Serdang, Malaysia, MasRina@ump.edu.my). Her research interests include pattern recognition, emotion detection, and deep learning for intelligent systems. ORCID iD: 0000-0001-5088-2871.

Ainur Zhumadillayeva, L.N. Gumilyov Eurasian National University, Astana, Kazakhstan

Dr. Ainur Zhumadillayeva is an Associate Professor in the Faculty of Information Systems, Department of Computer and Software Engineering at L.N. Gumilyov Eurasian National University (Astana, Kazakhstan, zhumadillayeva_ak@enu.kz, +77025295999). Her research focuses on machine learning, data mining, and educational technologies. ORCID iD: 0000-0003-1042-0415.

        2 0

Downloads

How to Cite

Nurzhanova, A., Mussabek, M., Ince, G., Mustaffa, M. R. ., & Zhumadillayeva, A. (2025). DETECTION OF MENTAL DISORDERS BASED ON THE ANALYSIS OF EMOTION, FACIAL EXPRESSIONS AND FACIAL MOVEMENTS IN A VIDEO STREAM. Journal of Problems in Computer Science and Information Technologies, 3(3), 68–78. https://doi.org/10.26577/jpcsit2025337