Sentiment Analysis of Covid-19 Vaccination in Under-Resourced Bangla Mixed-Text from Social Media

Khan, Mahamudur Rahaman; Islam, Md Fuadul; Rahmatullah, SM Nawsad

dc.contributor.author	Khan, Mahamudur Rahaman
dc.contributor.author	Islam, Md Fuadul
dc.contributor.author	Rahmatullah, SM Nawsad
dc.date.accessioned	2023-03-16T09:12:01Z
dc.date.available	2023-03-16T09:12:01Z
dc.date.issued	2022-05-30
dc.identifier.citation	[1] Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dandelion Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. TensorFlow: Large-scale machine learning on heterogeneous systems, 2015. Software available from tensorflow.org. [2] Abubakar Abid, Ali Abdalla, Ali Abid, Dawood Khan, Abdulrahman Alfozan, and James Zou. Gradio: Hassle-free sharing and testing of ml models in the wild. arXiv preprint arXiv:1906.02569, 2019. [3] Hassan Adamu, Mat Jasri Bin Mat Jiran, Keng Hoon Gan, and Nur-Hana Samsudin. Text analytics on twitter text-based public sentiment for covid-19 vaccine: A machine learning approach. In 2021 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET), pages 1–6, 2021. [4] AH Alamoodi, BB Zaidan, Maimonah Al-Masawa, Sahar M Taresh, Sarah Noman, Ibraheem YY Ahmaro, Salem Garfan, Juliana Chen, MA Ahmed, AA Zaidan, et al. Multiperspectives systematic review on the applications of sentiment analysis for vaccine hesitancy. Computers in Biology and Medicine, 139:104957, 2021. [5] Nora Alturayeif and Hamzah Luqman. Fine-grained sentiment analysis of arabic covid-19 tweets using bert-based transformers and dynamically weighted loss function. Applied 47 BIBLIOGRAPHY 48 Sciences, 11(22), 2021. [6] Mithun Biswas, Rafiqul Islam, Gautam Kumar Shom, Md Shopon, Nabeel Mohammed, Sifat Momen, and Anowarul Abedin. Banglalekha-isolated: A multi-purpose comprehensive dataset of handwritten bangla isolated characters. Data in brief, 12:103–107, 2017. [7] James Briggs. Masked-language modeling with bert, 2021. [Accessed December 2, 2021]. [8] covidvax.live. Vaccination in bangladesh, (Dec. 31, 2021). [Accessed Dec. 31, 2021][Online]. [9] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: pre-training of deep bidirectional transformers for language understanding. CoRR, abs/1810.04805:1– 16, 2018. [10] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: pre-training of deep bidirectional transformers for language understanding. CoRR, abs/1810.04805, 2018. [11] Eve Dubé, Maryline Vivion, and Noni E MacDonald. Vaccine hesitancy, vaccine refusal and the anti-vaccine movement: influence, impact and implications. Expert review of vaccines, 14(1):99–117, 2015. [12] Steven Y Feng, Varun Gangal, Jason Wei, Sarath Chandar, Soroush Vosoughi, Teruko Mitamura, and Eduard Hovy. A survey of data augmentation approaches for nlp. arXiv preprint arXiv:2105.03075, 2021. [13] Adeep Hande, Ruba Priyadharshini, and Bharathi Raja Chakravarthi. Kancmd: Kannada codemixed dataset for sentiment analysis and offensive language detection. In Proceedings of the Third Workshop on Computational Modeling of People’s Opinions, Personality, and Emotion’s in Social Media, pages 54–63, 2020. [14] Adeep Hande, Ruba Priyadharshini, and Bharathi Raja Chakravarthi. KanCMD: Kannada CodeMixed dataset for sentiment analysis and offensive language detection. In BIBLIOGRAPHY 49 Proceedings of the Third Workshop on Computational Modeling of People’s Opinions, Personality, and Emotion’s in Social Media, pages 54–63, Barcelona, Spain (Online), December 2020. Association for Computational Linguistics. [15] Md. Rakibul Hasan, Maisha Maliha, and M. Arifuzzaman. Sentiment analysis with nlp on twitter data. In 2019 International Conference on Computer, Communication, Chemical, Materials and Electronic Engineering (IC4ME2), pages 1–4, Rajsahi University, Bangladesh, 2019. IEEE Bangladesh Section. [16] Hatice İkiışık, Mehmet Akif Sezerol, Yusuf Taşçı, and Işıl Maral. Covid-19 vaccine hesitancy: A community-based research in turkey. International Journal of Clinical Practice, 75(8):e14336, 2021. [17] Our World in Data. Bangladesh coronavirus vaccination rate: Any dosage, (Jan 2021-Mar 2022). [18] Gutti Gowri Jayasurya, Sanjay Kumar, Binod Kumar Singh, and Vinay Kumar. Analysis of public sentiment on covid-19 vaccination using twitter. IEEE Transactions on Computational Social Systems, pages 1–11, 2021. [19] Renuka Joshi. Accuracy, precision, recall and f1 score: Interpretation of performance measures, 2016. [Accessed November 23, 2021]. [20] Md. Kamruzzaman. Bangladesh starts nationwide covid vaccination drive, (Feb. 07, 2021). [Accessed Dec. 31, 2021][Online]. [21] Gloria J. Kang, Sinclair R. Ewing-Nelson, Lauren Mackey, James T. Schlitt, Achla Marathe, Kaja M. Abbas, and Samarth Swarup. Semantic network analysis of vaccine sentiment in online social media. Vaccine, 35(29):3621–3638, 2017. [22] Emilie Karafillakis, Heidi J Larson, et al. The benefit of the doubt or doubts over benefits? a systematic literature review of perceived risks of vaccines in european populations. Vaccine, 35(37):4840–4850, 2017. BIBLIOGRAPHY 50 [23] Mohammad Khan. Deep learning-based sentiment analysis of covid-19 vaccination responses from twitter data. Computational and Mathematical Methods in Medicine, 2021, 12 2021. [24] Diederik Kingma and Jimmy Ba. Adam: A method for stochastic optimization. International Conference on Learning Representations, 12 2014. [25] Alison Knopf. Time to remember: Vaccines don’t cause autism. The Brown University Child and Adolescent Behavior Letter, 37(7):9–10, 2021. [26] Kiprono Elijah Koech. Softmax activation function — how it actually works [online], 2020. [Accessed January 23, 2022]. [27] Mary Koslap-Petraco. Vaccine hesitancy: Not a new phenomenon, but a new threat. Journal of the American Association of Nurse Practitioners, 31(11):624–626, 2019. [28] The Lancet. Looking beyond the decade of vaccines, 2018. [29] Dehong Ma, Sujian Li, Xiaodong Zhang, and Houfeng Wang. Interactive attention networks for aspect-level sentiment classification. arXiv preprint arXiv:1709.00893, 2017. [30] Rui Man and Ke Lin. Sentiment analysis algorithm based on bert and convolutional neural network. In 2021 IEEE Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC), pages 769–772, 2021. [31] Shie Mannor, Dori Peleg, and Reuven Rubinstein. The cross entropy method for classification. In Proceedings of the 22nd International Conference on Machine Learning, ICML ’05, page 561–568, New York, NY, USA, 2005. Association for Computing Machinery. [32] Chad A. Melton, Olufunto A. Olusanya, Nariman Ammar, and Arash Shaban-Nejad. Public sentiment analysis and topic modeling regarding covid-19 vaccines on the reddit social media platform: A call to action for strengthening vaccine confidence. Journal of Infection and Public Health, 14(10):1505–1512, 2021. Special Issue on COVID-19 – Vaccine, Variants and New Waves. BIBLIOGRAPHY 51 [33] Saif Mohammad. A practical guide to sentiment annotation: Challenges and solutions. In Proceedings of the 7th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pages 174–179, San Diego, California, June 2016. Association for Computational Linguistics. [34] Ebelechukwu Nwafor, Ryan Vaughan, and Christopher Kolimago. Covid vaccine sentiment analysis by geographic region. In 2021 IEEE International Conference on Big Data (Big Data), pages 4401–4404, 2021. [35] Douglas J Opel, Bernard Lo, and Monica E Peek. Addressing mistrust about covid-19 vaccines among patients of color, 2021. [36] Varun K Phadke, Robert A Bednarczyk, and Saad B Omer. Vaccine refusal and measles outbreaks in the us. Jama, 324(13):1344–1345, 2020. [37] Hilary Piedrahita-Valdés, Diego Castillo, Javier Bermejo, Patricia Guillem-Saiz, Juan- Ramón Higuera, Javier Guillem-Saiz, Juan Antonio Montalvo, and Francisco Machio. Vaccine hesitancy on social media: Sentiment analysis from june 2011 to april 2019. Vaccines, 9:28, 01 2021. [38] Star Online Report. Nurse runu veronica first to receive covid-19 vaccine in bangladesh, (Jan. 27, 2021). [Accessed Dec. 31, 2021][Online]. [39] Sagor Sarker. Banglabert: Bengali mask language model for bengali language understading, 2020. [40] Piotr Semberecki and Henryk Maciejewski. Deep learning methods for subject text classification of articles. In 2017 Federated Conference on Computer Science and Information Systems (FedCSIS), pages 357–360, 2017. [41] Heereen Shim, Dietwig Lowet, Stijn Luca, and Bart Vanrumste. Lets: A label-efficient training scheme for aspect-based sentiment analysis by using a pre-trained language model. IEEE Access, 9:115563–115578, 2021. [42] StatCounter. Social media usage of bangladesh, (Feb 2021-Feb 2022). BIBLIOGRAPHY 52 [43] Lisa Torrey and Jude Shavlik. Transfer learning. In Handbook of research on machine learning applications and trends: algorithms, methods, and techniques, pages 242–264. IGI global, 2010. [44] Nafis Tripto and Mohammed Eunus Ali. Detecting multilabel sentiment and emotions from bangla youtube comments. In 2018 International Conference on Bangla Speech and Language Processing (ICBSLP), pages 1–6, 09 2018. [45] Guido Van Rossum and Fred L Drake Jr. Python reference manual. Centrum voor Wiskunde en Informatica Amsterdam, 1995. [46] Annika B Wilder-Smith and Kaveri Qureshi. Resurgence of measles in europe: a systematic review on parental attitudes and beliefs of measles vaccine. Journal of epidemiology and global health, 10(1):46, 2020. [47] Worldometer. Coronavirus update (live), (Dec. 31, 2021). [Accessed Dec. 31, 2021][Online]. [48] Guixian Xu, Yueting Meng, Xiaoyu Qiu, Ziheng Yu, and Xu Wu. Sentiment analysis of comment texts based on bilstm. Ieee Access, 7:51522–51532, 2019. [49] Guixian Xu, Yueting Meng, Xiaoyu Qiu, Ziheng Yu, and Xu Wu. Sentiment analysis of comment texts based on bilstm. IEEE Access, 7:51522–51532, 2019. [50] Ohid Yaqub, Sophie Castle-Clarke, Nick Sevdalis, and Joanna Chataway. Attitudes to vaccination: a critical review. Social science & medicine, 112:1–11, 2014. [51] Sumu Zhao, Damian Pascual, Gino Brunner, and Roger Wattenhofer. Of non-linearity and commutativity in bert. In 2021 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE, 2021.	en_US
dc.identifier.uri	http://hdl.handle.net/123456789/1777
dc.description	Supervised by Dr. Md. Azam Hossain, Asst. Professor, Department of Computer Science and Engineering(CSE), Islamic University of Technology (IUT) Board Bazar, Gazipur-1704, Bangladesh. This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2022.	en_US
dc.description.abstract	Vaccine reluctance is one of the top ten global health concerns to confront. In this day and age, social media plays a critical role in disseminating vaccination information, even material that is incorrect or misleading. Monitoring the emotion expressed in vaccine-related social media interactions can assist the health authority in introducing the public safety procedure and guiding the government in developing appropriate policies. Newly developed vaccines for COVID-19 are causing widespread reactions all around the globe. Trust is an essential factor to success in vaccine inoculation and sentiment analysis may help assess public opinion. Social media is prevalent in Bangladesh where more than 80 million Internet users express their opinions in Bangla, English, and a mixture of Bangla and English text which are commonly referred to as codemixed language. Since sentiment analysis on Bangla has not progressed significantly compared to other prominent languages like English, this proved to be a major undertaking on our part. In this paper, we propose a method for determining vaccination-related sentiment from public comments on Facebook written in Bangla, English, or a combination of both texts. The proposed model is constructed on the basis of the multilingual BERT model. It achieves a validation accuracy of around 97.3% and a training accuracy of approximately 98.8%.	en_US
dc.language.iso	en	en_US
dc.publisher	Department of Computer Science and Engineering(CSE), Islamic University of Technology(IUT), Board Bazar, Gazipur, Bangladesh	en_US
dc.subject	ultilingual, Bangla, Sentiment Analysis, COVID-19, Transformers, Facebook	en_US
dc.title	Sentiment Analysis of Covid-19 Vaccination in Under-Resourced Bangla Mixed-Text from Social Media	en_US
dc.type	Thesis	en_US