Exploring the Role of Dimensionality Reduction in Enhancing Machine Learning Algorithm Performance
John Kamwele Mutinda, Amos Kipkorir Langat
Asian Journal of Research in Computer Science · pp. 157–166 · Published 11 Mar 2024
10.9734/ajrcos/2024/v17i5445Abstract
In this study, we delve into the pivotal role of dimension reduction techniques in influencing the performance of machine learning algorithms for heart disease prediction. Through a comprehensive exploration of a dataset encompassing crucial features such as age, sex, chest pain type, blood pressure, cholesterol levels, and more, we investigate the impact of different techniques—namely, Principal Component Analysis (PCA), Kernel Principal Component Analysis (KPCA), and Linear Discriminant Analysis (LDA) on classification algorithm effectiveness. The classification algorithms considered were Logistic Regression, Support Vector Machine (SVM), k-Nearest Neighbors (KNN), Naive Bayes, and Deep Neural Network (DNN). We used K-fold cross validation to train and validate the classification algorithms. The performance of these algorithms was assessed using a range of key metrics including accuracy, F1-score, precision, recall, and specificity. The results reveals that Linear Discriminant Analysis consistently emerged as a potent method, remarkably enhancing algorithm performance across all assessed metrics. We also identified Naive Bayes and Logistic Regression as standout algorithms, demonstrating remarkable resilience and reliability across diverse scenarios. These findings collectively shed light on the intricate interplay between dimension reduction techniques and algorithm selection, offering critical insights for crafting more accurate and robust strategies in the prediction of heart disease.
Cited by 8
Deny Jollyta, Julianti Kasih, Pihandoko Pihandoko · 2025 International Conference on Computing and Applied Informatics (ICCAI) · 2025
Sanjay BASU, Tasneem CHHERAWALA, Alka VAIDYA · Journal of Applied Economic Sciences (JAES) · 2025
William Watasendjaja, Billy Chandra, Ito Wasito · sinkron · 2025
John Kamwele Mutinda, Amos Kipkorir Langat, Samuel Musili Mwalili · International Journal of Mathematics and Mathematical Sciences · 2025
Suvendu Kumar Jena, Taki Alrwbaye, Piyush Kumar Pareek · 2025 4th International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE) · 2025
Laura Suleimenova, Zhanat Umarova, Kamalbek Berkimbayev · 2025 10th International Conference on Computer Science and Engineering (UBMK) · 2025
Lesia Mochurad, Roman Kapustiak · Applied Sciences · 2025
Lionel Nkenyereye, Boon Giin Lee, Wan-Young Chung · Engineering Applications of Artificial Intelligence · 2025
Related research
- On Applications of Fuzzy Soft Sets in Dimension Reduction and Medical Diagnosis — shares topic coverage
- On Designing Invertible Pseudo Covariance Matrix for Undersampled Cases in Classification — shares topic coverage
- Scalable Machine Learning Algorithms for Processing High-dimensional Data: A Case Study Approach — shares topic coverage
- Local Binary Pattern and Ant Colony Optimization Based Feature Dimensionality Reduction Technique for Face Recognition Systems — shares topic coverage
- Detection of Face Recognition of Interviewee Using Transform Technique and Machinle Learning Algorithm — shares topic coverage
Article metrics
Real usage data collected on this platform.
0
Page views
0
PDF downloads
0
Outbound clicks
8
Citations
Views by country
Approximate, from request IP at view time — not citizenship or institution. Countries with fewer than 5 views are grouped as "Other".
No views recorded yet.
Traffic sources
Referring site, by host.
No traffic recorded yet.
Views and downloads exclude known bots/crawlers. Citations combines this platform's own DOI-resolved index with each external source's own reported total — see Cited by above for individually listed citing works. Last refreshed 0 seconds ago.