International Journal of Education and Management Engineering (IJEME)
IJEME Vol. 14, No. 4, 8 Aug. 2024
Cover page and Table of Contents: PDF (size: 750KB)
Depression Detection: Unveiling Mental Health Insights with Twitter Data and BERT Models
PDF (750KB), PP.1-14
Views: 0 Downloads: 0
Author(s)
Index Terms
Self-harm, Twitter, Tweepy, Depressed Keywords, VADER, Transformer Models, Convolution Neural Network (CNN), Albert, Distilbert
Abstract
Social media platforms serve as avenues for individuals to express themselves and share pertinent details concerning their mental well-being through posts and comments. However, many individuals tend to overlook their mental health. This data lends itself to insightful analysis of an individual's psychological state through sentiment analysis techniques. The research explores the utilization of sentiment analysis techniques on social media data, specifically focusing on mental health discussions. Data gathered from platforms like Twitter is preprocessed and then used to train various Transformer models including DistilBERT, Albert, and a hybrid BERT-CNN model. Notably, the BERT-CNN hybrid model achieved a remarkable accuracy of 95%. This outcome underscores the effectiveness of advanced model architectures in analyzing mental health-related sentiment on social media. The significance of this research lies in its potential to offer valuable insights into individuals' mental states through computational analysis of their online expressions. The study's thorough methodology, encompassing data collection, preprocessing, and model training, sets a strong precedent for future research in this domain. Additionally, the successful performance of the BERT-CNN hybrid model highlights the importance of innovative model design in achieving accurate sentiment analysis results. Overall, this research contributes to the growing body of knowledge aimed at leveraging technology for mental health awareness and support.
Cite This Paper
Rohini Kancharapu, Sri Nagesh Ayyagari, "Depression Detection: Unveiling Mental Health Insights with Twitter Data and BERT Models", International Journal of Education and Management Engineering (IJEME), Vol.14, No.4, pp. 1-14, 2024. DOI:10.5815/ijeme.2024.04.01
Reference
[1]R. Chatterjee, R. K. Gupta, and B. Gupta, “Depression detection from social media posts using multinomial naive theorem,” in IOP Conference Series: Materials Science and Engineering, Jan. 2021, vol. 1022, no. 1. doi: 10.1088/1757- 899X/1022/1 /012095.
[2]G. Alorini, D. B. Rawat, and D. Alorini, “LSTM-RNN Based Sentiment Analysis to Monitor COVID-19 Opinions using Social Media Data,” in IEEE International Conference on Communications, Jun. 2021. doi: 10.1109/ICC42927.2021.9500897.
[3]M. E. Basiri, S. Nemati, M. Abdar, E. Cambria, and U. R. Acharya, “ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis,” Future Generation Computer Systems, vol. 115, pp. 279–294, Feb. 2021, doi:10.1016/j.future.2020.08.005.
[4]S. Behl, A. Rao, S. Aggarwal, S. Chadha, and H. S. Pannu, “Twitter for disaster relief through sentiment analysis for COVID-19 and natural hazard crises,” International Journal of Disaster Risk Reduction, vol. 55, Mar. 2021, doi: 10.1016/j.ijdrr.2021.102101.
[5]H. Kour and M. K. Gupta, “An hybrid deep learning approach for depression prediction from user tweets using feature-rich CNN and bi- directional LSTM,” Multimed Tools Appl, vol. 81, no. 17, pp. 23649– 23685, Jul. 2022, doi: 10.1007/s11042-022-12648-y.
[6]Z.Hameed and B. Garcia-Zapirain, “Sentiment Classification Using a Single-LayeredBiLSTM Model,” IEEE Access, vol. 8, pp. 73992–74001, 2020, doi:10.1109/ACCESS.2020.2988550.
[7]H.S. Alsagri and M. Ykhlef, “Machine learning-based approach for depression detection in twitter using content and activity features,” IEICE Trans Inf Syst, vol. E103D, no. 8, pp. 1825–1832, Aug. 2020, doi:10.1587/transinf.2020EDP7023.
[8]N. P. Shetty, B. Muniyal, A. Anand, S. Kumar, and S. Prabhu, “Predicting depression using deep learning and ensemble algorithms on raw twitter data,” International Journal of Electrical and Computer Engineering, vol. 10, no. 4, pp. 3751–3756, 2020, doi: 10.11591/ijece.v10i4.pp3751-3756.
[9]WenboZheng , Lan Yan, Chao Gou ,Fei-Yue Wang,“ Graph Attention Model Embedded With Multi-modal Knowledge For Depression Detection ”,Institute of Electrical and Electronics Engineers, IEEE Computer Society, IEEE Circuits and Systems Society, IEEE Communications Society, and IEEE Signal Processing Society, 2020 IEEE International Conference on Multimedia and Expo (ICME) : 06-10 July 2020,London, UK.
[10]M.Trotzek, S. Koitka, and C. M. Friedrich, “Utilizing Neural Networks and Linguistic Metadata for Early Detection of Depression Indications in Text Sequences,” IEEE Trans Knowl Data Eng, vol. 32, no. 3, pp. 588–601, Mar. 2020, doi: 10.1109/TKDE.2018.2885515.
[11]Bhargava C, Poornima S, Mahur S, PushpalathaM.Depression Detection Using Sentiment Analysis of Tweets. Vol. 12, Turkish Journal of Computer and Mathematics Education. 2021.
[12]H. Kaur, S. UlAhsaan, B. Alankar, and V. Chang, “A Proposed Sentiment Analysis Deep Learning Algorithm for Analyzing COVID-19 Tweets”, doi: 10.1007/s10796-021- 10135-7/Published.
[13]P. P. A., “Performance Evaluation and Comparison using Deep Learning Techniques in Sentiment Analysis,” Journal of Soft Computing Paradigm, vol. 3, no. 2, pp. 123–134, Jul. 2021, doi: 10.36548/jscp.2021.2.006.
[14]M. Divyapushpalakshmi and R. Ramalakshmi, “An efficient sentimental analysis using hybrid deep learning and optimization technique for Twitter using parts of speech (POS) tagging,” Int J Speech Technol, vol. 24, no. 2, pp. 329–339, Jun. 2021, doi: 10.1007/s10772-021- 09801-7
[15]M. L. Joshi and N. Kanoongo, “Depression detection using emotional artificial intelligence and machine learning: A closer review,” Mater Today Proc, vol. 58, pp. 217– 226, Jan. 2022, doi: 10.1016/j.matpr.2022.01.467.
[16]N. V. Babu and E. G. M. Kanaga, “Sentiment Analysis in Social Media Data for Depression Detection Using Artificial Intelligence: A Review,” SN ComputSci,, vol. 3, no. 1, Jan. 2022, doi: 10.1007/s42979-021-00958-1.
[17]https://www.researchgate.net/figure/Keywords-and-phrases-search-terms_tbl2_282633445