Classification of Dyslexia Among School Students Using Deep Learning
DOI:
https://doi.org/10.51173/jt.v6i1.1893Keywords:
Dyslexia, CNN, Deep Learning, Types of Dyslexia, SpectrogramsAbstract
Dyslexia is a common learning disorder that affects children’s reading and writing skills. Early identification of Dyslexia is essential for providing appropriate interventions and support to affected children. Traditional methods of diagnosing Dyslexia often rely on subjective assessments and the expertise of specialists, leading to delays and potential inaccuracies in diagnosis. This study proposes a novel approach for diagnosing dyslexic children using spectrogram analysis and convolutional neural networks (CNNs). Spectrograms are visual representations of audio signals that provide detailed frequency and intensity information. CNNs are powerful deep-learning models capable of extracting complex patterns from data. In this research, raw audio signals from dyslexic and non-dyslexic children are transformed into spectrogram images. These images are then used as input for a CNN model trained on a large dataset of dyslexic and non-dyslexic samples. The CNN learns to automatically extract discriminative features from the spectrogram images and classify them into dyslexic and non-dyslexic categories. This study’s results demonstrate the proposed approach’s effectiveness in diagnosing dyslexic children. The CNN accurately identified dyslexic individuals based on the spectrogram features, outperforming traditional diagnostic methods. Spectrograms and CNNs provide a more objective and efficient approach to dyslexia diagnosis, enabling earlier intervention and support for affected children. This research contributes to the field of dyslexia diagnosis by harnessing the power of machine learning and audio analysis techniques. Facilitating faster and more accurate identification of Dyslexia in children, ultimately improving their educational outcomes and quality of life.
Downloads
References
K. Singh, V. Goyal, and P. Rana, “Existing Assistive Techniques for Dyslexics: A Systematic Review,” Artificial Intelligence for Accurate Analysis and Detection of Autism Spectrum Disorder, pp. 94-104, 2021, doi: 10.4018/978-1-7998-7460-7.ch007.
R. Werth, “Dyslexia: Causes and Concomitant Impairments,” Brain Sciences, vol. 13, no. 3, p. 472, 2023, doi: https://doi.org/10.3390/brainsci13030472.
J. Stein, “Theories about developmental dyslexia,” Brain Sciences, vol. 13, no. 2, p. 208, 2023, doi:org/10.3390/brainsci13030472.
O. Pronina and O. Piatykop, “The recognition of speech defects using convolutional neural network,” in CTE Workshop Proceedings, 2023, vol. 10, pp. 153-166, doi: DOI: https://doi.org/10.55056/cte.554
F. Latifoğlu, R. İleri, and E. Demirci, “Assessment of dyslexic children with EOG signals: Determining retrieving words/re-reading and skipping lines using convolutional neural networks,” Chaos, Solitons & Fractals, vol. 145, p. 110721, 2021, doi: https://doi.org/10.1016/j.chaos.2021.110721.
Husni, Husniza, Nik Nurhidayat Nik Him, Mohamad M. Radi, Yuhanis Yusof, and Siti Sakira Kamaruddin. "Automatic transcription and segmentation accuracy of dyslexic children’s speech." In AIP Conference Proceedings, vol. 1891, no. 1. AIP Publishing, 2017., doi:https://doi.org/10.1063/1.5005387.
M. Kaushik, N. Baghel, R. Burget, C. M. Travieso, and M. K. Dutta, “SLINet: Dysphasia detection in children using deep neural network,” Biomedical Signal Processing and Control, vol. 68, p. 102798, 2021, doi: https://doi.org/10.1016/j.bspc.2021.102798.
M. Gharaibeh, “Predicting dyslexia in Arabic‐speaking children: Developing instruments and estimating their psychometric indices,” Dyslexia, vol. 27, no. 4, pp. 436-451, 2021, doi: https://doi.org/10.1002/dys.1682.
S. Parmar and C. Paunwala, “A novel and efficient Wavelet Scattering Transform approach for primitive-stage dyslexia-detection using electroencephalogram signals,” Healthcare Analytics, vol. 3, p. 100194, 2023, doi: https://doi.org/10.1016/j.health.2023.100194.
M. Khudhair and A. Talib, “Improving Low Resources Arabic Speech Recognition using Data Augmentation,” in 2022 Fifth College of Science International Conference of Recent Trends in Information Technology (CSCTIT), 2022: IEEE, pp. 60-65, doi: DOI: 10.1109/CSCTIT56299.2022.10145613.
O. L. Usman, R. C. Muniyandi, K. Omar, and M. Mohamad, “Advance machine learning methods for dyslexia biomarker detection: A review of implementation details and challenges,” IEEE Access, vol. 9, pp. 36879-36897, 2021, doi: DOI: 10.1109/ACCESS.2021.3062709.
I. S. Isa, M. A. Zahir, S. A. Ramlan, L.-C. Wang, and S. N. Sulaiman, “CNN comparisons models on dyslexia handwriting classification,” ESTEEM Academic Journal (EAJ), vol. 17, pp. 12-25, 2021.
A. M. Badshah et al., “Deep features-based speech emotion recognition for smart affective services,” Multimedia Tools and Applications, vol. 78, pp. 5571-5589, 2019, doi: https://doi.org/10.1007/s11042-016-4041-7.
S. Revay and M. Teschke, “Multiclass language identification using deep learning on spectral images of audio signals,” arXiv preprint arXiv:1905.04348, 2019, doi:https://doi.org/10.48550/arXiv.1905.04348.
F. Ramo and M. N. Kannah, "Intelligence System for Multi-Language Recognition," Journal of Education and Science, vol. 31, no. 1, pp. 93-110, 2022, doi: DOI: 10.33899/edusj.2021.129868.1156.
G. E. Dahl, T. N. Sainath, and G. E. Hinton, “Improving deep neural networks for LVCSR using rectified linear units and dropout,” in 2013 IEEE international conference on acoustics, speech and signal processing, 2013: IEEE, pp. 8609-8613, doi: 10.1109/ICASSP.2013.6639346.
N. L. Hakim, T. K. Shih, S. P. Kasthuri Arachchi, W. Aditya, Y.-C. Chen, and C.-Y. Lin, “Dynamic hand gesture recognition using 3DCNN and LSTM with FSM context-aware model,” Sensors, vol. 19, no. 24, p. 5429, 2019, doi: https://doi.org/10.1002/dys.1682.
G. Atkar and P. Jayaraju, “Speech synthesis using generative adversarial network for improving readability of Hindi words to recuperate from dyslexia,” Neural Computing and Applications, vol. 33, pp. 9353-9362, 2021, DOI: 10.33899/edusj.2021.129868.1156.
Rochford, M. Visual Speech Recognition Using a 3D Convolutional Neural Network (Doctoral dissertation, California Polytechnic State University), 2019, doi: https://doi.org/10.15368/theses.2020.7.
Jasira, K. T., & Laila, V. DyslexiScan: A Dyslexia Detection Method from Handwriting Using CNN LSTM Model. In 2023 International Conference on Innovations in Engineering and Technology (ICIET) (pp. 1-6). IEEE, , DOI: 10.1109/ICIET57285.2023.10220750.
N. Friedmann and M. Haddad-Hanna, “Types of developmental dyslexia in Arabic,” Handbook of Arabic literacy: Insights and perspectives, pp. 119-151, 2014, (2023, July), doi: DOI 10.1007/978-94-017-8545-7_6.
M. Sameer, A. Talib, A. Hussein, and H. Husni, “Arabic Speech Recognition Based on Encoder-Decoder Architecture of Transformer,” Journal of Techniques, vol. 5, no. 1, pp. 176-183, 2023, DOI: https://doi.org/10.51173/jt.v5i1.749 .
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Alia Hussein, Ahmed Talib Abdulameer, Ali Abdulkarim, Husniza Husni, Dalia Al-Ubaidi
This work is licensed under a Creative Commons Attribution 4.0 International License.