Performance Assessment of Different Machine Learning Algorithms in Predicting Diabetes Mellitus

Mahbub, Md. Hasib; Islam, Shuvo; Mahbub, Md. Ashif

IUT Repository Home
→
Electrical and Electronics Engineering (EEE)
→
Thesis
→
Undergraduate
→
2021
→
View Item

dc.contributor.author	Mahbub, Md. Hasib
dc.contributor.author	Islam, Shuvo
dc.contributor.author	Mahbub, Md. Ashif
dc.date.accessioned	2022-04-30T03:28:35Z
dc.date.available	2022-04-30T03:28:35Z
dc.date.issued	2021-03-30
dc.identifier.citation	Temurtas, Hasan, Nejat Yumusak, and Feyzullah Temurtas. ”A comparative study on diabetes disease diagnosis using neural networks.” Expert Systems with applications 36, no. 4 (2009): 8610-8615. Reddy, Shiva Shankar, Nilambar Sethi, and R. Rajender. ”A comprehensive analysis of machine learning techniques for incessant prediction of diabetes mellitus.” International Journal of Grid and Distributed Computing 13, no. 1 (2020): 1-22. Wettayaprasit, W.; Sangket, U. Linguistic knowledge extraction from neural networks using maximum weight and frequency data representation. In Proceedings of the IEEE Conference on Cybernetics and Intelligent Systems, Bangkok, Thailand, 7–9 June 2006; pp. 1–6. M. Sagir and S. Sathasivam, ”Design of a modified adaptive neuro fuzzy inference system classifier for medical diagnosis of Pima Indians Diabetes,” in AIP Conference Proceedings, 2017, p. 040048. Balaji, V.R., Suganthi, S.T., Rajadevi, R., Kumar, V.K., Balaji, B.S. and Pandiyan, S., (2020), Skin disease detection and segmentation using dynamic graph cut algorithm and classification through Naive Bayes Classifier. Measurement, 107922. Chen, X., Huang, L., Xie, D. and Zhao, Q., (2018), EGBMMDA: extreme gradient boosting machine for MiRNA-disease association prediction. Cell death & disease, 9(1), 1-16. 72 CHAPTER 9. REFERENCE 73 Djelloul, N. and Amir, A., (2019), Analysis of legendre polynomial kernel in support vector machines, International Journal of Computing Science and Mathematics, 10(6), 580-595. Guo, Yang, G. Bai and Y. Hu, 2012. Using Bayes Network for Prediction of Type2 diabetes.” 2012 International Conference for Internet Technology and Secured Transactions, 471-472. Hossain, E., Hossain, M.F. and Rahaman, M.A., (2019), A color and texture-based approach for the detection and classification of plant leaf disease using KNN classifier. In 2019 International Conference on Electrical, Computer and Communication Engineering (ECCE), IEEE, 1-6. Javeed, A., Zhou, S., Yongjian, L., Qasim, I., Noor, A. and Nour, R., (2019), An Intelligent Learning System based on Random Search Algorithm and Optimized Random Forest Model for Improved Heart Disease Detection, IEEE Access, 7, 180235-180243. Kaggle Diabetes Dataset, Frankfurt hospital, Germany, (https://www.kaggle.com/johndasilva/diabetKahramanli, H., Allahverdi, N., (2008), Design of a hybrid system for the diabetes and heart diseases. Expert Systems with Applications, (35), 82–89. Lang, M., Pfister, F.M., Fr¨ohner, J., Abedinpour, K., Pichler, D., Fietzek, U., Um, T.T., Kuli´c, D., Endo, S. and Hirche, S., (2019), A Multi-Layer Gaussian Process for Motor Symptom Estimation in People with Parkinson’s Disease. IEEE Transactions on Biomedical Engineering, 66(11), 3038-3049. Lee, K.W., Ching, S.M., Ramachandran, V., Yee, A., Hoo, F.K., Chia, Y.C., Sulaiman, W.A.W., Suppiah, S., Mohamed, M.H. and Veettil, S.K., (2018), Prevalence and risk factors of gestational diabetes mellitus in Asia: a systematic review and meta-analysis. BMC pregnancy and childbirth, 18(1):494. Li, H., Liu, S., Hassan, M.M., Ali, S., Ouyang, Q., Chen, Q., Wu, X. and Xu, Z., (2019), Rapid quantitative analysis of Hg2+ residue in dairy products using SERS coupled with ACO-BP-AdaBoost algorithm, Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy, 223: 117281. CHAPTER 9. REFERENCE 74 Maniruzzaman, M., Ra‘hman, M.J., Ahammed, B. and Abedin, M.M., (2019), Logistic Regression based Feature Selection and Classification of Diabetes Disease using Machine Learning Paradigm, 7th Int. Conf. on Data Science & SDGs EC, 67-74 Meng, X.-H., Huang, Y.-X., Rao, D.-P., Zhang, Q., and Liu, Q., (2013), Comparison of three data mining models for predicting diabetes or prediabetes by risk factors. Kaohsiung Journal of Medical Science, 29(2):93-9. Nasser, I.M. and Abu-Naser, S.S., (2019), Lung Cancer Detection Using Artificial Neural Network. International Journal of Engineering and Information Systems (IJEAIS), 3(3), 17-23. Polat, K., S. G¨unecs, and A. Arslan, (2008), A cascade learning system for classification of diabetes disease: Generalized discriminant analysis and least square support vector machine, Expert Systems with Applications, 34(1), 482–487. Saeedi, P., Salpea, P., Karuranga, S., Petersohn, I., Malanda, B., Gregg, E.W., Unwin, N., Wild, S.H. and Williams, R., 2020. Mortality attributable to diabetes in 20–79 years old adults, 2019 estimates: Results from the International Diabetes Federation Diabetes Atlas. Diabetes research and clinical practice, 108086. Sagir, A.M. and Sathasivam, S., (2017), Design of a modified adaptive neuro fuzzy inference system classifier for medical diagnosis of Pima Indians Diabetes. In AIP Conference Proceedings, AIP Publishing LLC, 1870(1):040048. Talo, M., Yildirim, O., Baloglu, U.B., Aydin, G. and Acharya, U.R., (2019), Convolutional neural networks for multi-class brain disease detection using MRI images. Computerized Medical Imaging and Graphics, 78:101673. Yoon, Y.S., Jung, J.W., Jeon, E.J., Seo, H., Ryu, Y.J., Yim, J.J., Kim, Y.H., Lee, B.H., Park, Y.B., Lee, B.J. and Kang, H., (2017), The effect of diabetes control status on treatment response in pulmonary tuberculosis: a prospective study. Thorax, 72(3), 263-270. Zangooei, Mohammad Hossein, Jafar Habibi, and Roohallah Alizadehsani, (2014), Disease Diagnosis with a hybrid method SVR using NSGA-II, Neurocomputing, 136 (14-29). CHAPTER 9. REFERENCE 75 Pourpanah, F.; Lim, C.P.; Saleh, J.M. A hybrid model of fuzzy ARTMAP and genetic algorithm for data classification and rule extraction. Expert Syst. Appl. 2016, 49, 74–85. [CrossRef] Supervised Machine Learning: A Review of Classification Techniques Informatica 31 (2007) 249-268 249 LeCun & Bengio: Convolutional Networks for Images, Speech, and Time-Series. 2 RUNNING HEAD: Convolutional Networks. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556, 2014. Bengio, Y. (2009). Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1), 1– 127. Also published as a book. Now Publishers, 2009. Gradient-Based Learning Applied to Document Recognition By Yann LeCun et al. (1998) GRAM-CNN: a deep learning approach with local context for named entity recognition in biomedical text Bioinformatics, Volume 34, Issue 9, 01 May 2018, Pages 1547–1554 Premanand Ghadekar and Anay Dombe. Image-Based Product Recommendations Using Market Basket Analysis 2019 5th International Conference On Computing, Communication, Control And Automation (ICCUBEA) M. Osadchy, Y. LeCun, and M. Miller. Synergistic Face Detection and Pose Estimation with Energy-Based Models. Journal of Machine Learning Research, 8:1197–1215, May 2007. M. D. Zeiler, R. Fergus. Visualizing and understanding convolutional networks. New York: Springer International Publishing, 2014: 818-833. F. Agostinelli, M. Hoffman, P. Sadowski, and P. Baldi. Learning activation functions to improve deep neural networks. arXiv:1412.6830, 2014. Y. LeCun, Y. Bengio, G. E. Hinton, Deep learning, Nature 521 (2015) 436–444. CHAPTER 9. REFERENCE 76 Lu, Dengsheng, and Qihao Weng. ”A survey of image classification methods and techniques for improving classification performance.”, International Journal of Remote sensing, Vol.28, Issue.5, pp.823-870, 2007. A. Krizhevsky, J. Sutskever, G. E. Hinton. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems. Cambridge: MIT Press, 2012: 1097-1105. Dejean-Servi`eres, Mathieu, et al. “Study of the Impact of Standard Image Compression Techniques on Performance of Image Classification with a Convolutional Neural Network”, Diss. INSA Rennes; Univ Rennes; IETR; Institut Pascal, 2017. C. Szegedy, et al. Going deeper with convolutions. Computer Vision and Pattern Recognition (CVPR), IEEE Conference on. Boston, USA: IEEE, 2015: 1-9 Hoo-Chang, Shin, et al. ”Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning.”, IEEE transactions on medical imaging, Vol.35, Issues.5, pp.1285, 2016. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, pages 1929–1958, 2014. C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. J. Goodfellow, R. Fergus, Intriguing properties of neural networks. URL http://arxiv.org/abs/1312.6199 D. E. Rumelhart, G. E. Hinton, R. J. Williams. Learning representations by backpropagating errors. Nature, 1986, 323: 533-538. Y. LeCun, L. Bottou, G. Orr, and K. Mller. Efficient BackProp. In Neural Networks: Tricks of the trade. Springer, 1998. T. Wiatowski, H. B¨olcskei, A mathematical theory of deep convolutional neural networks for feature extraction, arXiv preprint arXiv:1512.06293. Introduction to Convolutional Neural Networks By Jianxin Wu (2017) Understanding Convolutional Neural Netorks with A Mathematical Model By C.- C. Jay Kuo (2016) CHAPTER 9. REFERENCE 77 Delving Deep Into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification By Kaiming He et al. (2015) Evaluation of Pooling Operations in Convolutional Architectures for Object Recogniction By Dominik Scherer et al. (2010) A. G. Howard. Some improvements on deep convolutional neural network based image classification. arXiv:1312.5402, 2013. Review of Deep Convolution Neural Network in Image Classification. 2017 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications.pg26-31.	en_US
dc.identifier.uri	http://hdl.handle.net/123456789/1452
dc.description	Supervised by Prof. Dr. Md. Ashraful Hoque DEAN, Faculty of Science and Engineering Islamic University of Technology. Board Bazar, Gazipur-1704. Bangladesh	en_US
dc.description.abstract	Diabetes Mellitus (DM) is a heretical metabolic disorder and a commonly distributed long-term sluggish poison that poses a serious threat to human health. Faster and more precise diabetes diagnosis is critical, and Machine Learning (ML) will help improve medical health technologies and build an e-healthcare infrastructure. Thirteen machine learning algorithms have been thoroughly researched in this respect, and Jupyter Notebook has been used to apply them. Hence, The ML models are trained with dataset of Kaggle machine learning data repository of Frankfurt hospital, Germany. To achieve stable accuracy, a 5-fold cross validation approach is proposed as an effective data processing method. However, in order to improve the efficiency of the ML models, the hyper-parameter tuning technique is used. Gaussian Process (GP) emerged as the highest performing algorithm and is proposed as the most effective classifier with an accuracy of 98.25% after comprehensive simulation. However, the accuracy of Random Forest (RF) and Artificial Neural Network (ANN) was 97.25% and 96.5%, respectively, which is very well. As a result, the performance of the ML models is evaluated using various metrics such as Accuracy, Sensitivity, Precision, F1-score, Specificity, and ROCAUC, and a graphic comparison of all the ML models is shown. Effective diabetes prediction using machine learning algorithms can help to reduce annual mortality rates, particularly in developing countries like Bangladesh. As a result, this research will help healthcare providers manage Diabetes Mellitus more effectively and efficiently, paving the way for a more robust e-healthcare system in the future	en_US
dc.language.iso	en	en_US
dc.publisher	Department of Electrical and Electronic Engineering, Islamic University of Technology (IUT) The Organization of Islamic Cooperation (OIC) Board Bazar, Gazipur-1704, Bangladesh	en_US
dc.title	Performance Assessment of Different Machine Learning Algorithms in Predicting Diabetes Mellitus	en_US
dc.type	Thesis	en_US