A Rough Set Approach to Dimensionality Reduction for Performance Enhancement in Machine Learning

  • M. O. Odighi Federal Polytechnic, Auchi, Nigeria
  • J. O. Olaniyan Landmark University, Omu- Aran, Nigeria
  • R. E. Imhanlahimi Ambrose Alli University, Ekpoma, Nigeria
Keywords: Core, Dimensional space, Dimensionality reduction, Intrinsic dimension, Machine learning, Reducts


Machine learning uses complex mathematical algorithms to turn data set into a model for a problem domain. Analysing high dimensional data in their raw form usually causes computational overhead because the higher the size of the data, the higher the time it takes to process it. Therefore, there is a need for a more robust dimensionality reduction approach, among other existing methods, for feature projection (extraction) and selection from data set, which can be passed to a machine learning algorithm for optimal performance. This paper presents a generic mathematical approach for transforming data from a high dimensional space to low dimensional space in such a manner that the intrinsic dimension of the original data is preserved using the concept of indiscernibility, reducts, and the core of the rough set theory. The flue detection dataset available on the Kaggle website was used in this research for demonstration purposes. The original and reduced datasets were tested using a logistic regression machine learning algorithm yielding the same accuracy of 97% with a training time of 25 min and 11 min respectively.


Download data is not yet available.


M. Sammany, T. Medhat, “Dimensionality reduction using rough set approach for two neural networks-based applications,” In M. Kryszkiewicz, J. F. Peters, H. Rybinski, A. Skowron, (eds), Rough Sets and Intelligent Systems Paradigms. RSEISP 2007. Lecture Notes in Computer Science, vol. 4585, Springer, Berlin, Heidelberg.

Z. Pawlak, “Rough sets,” International Journal of Computer and Information Sciences, vol. 11, no. 5, pp. 341-356, 1982.

S. Shampa, “A rough set theory-based approach to feature selection for incremental data,” International Journal for Research in Engineering Application & Management, vol. 5, no. 4., pp. 247-252, 2019.

T. Keerthika, K. Premalatha, “Medical domain-based feature selection using rough set reduct algorithm,” International Journal of Engineering Research & Technology, vol. 3, no. 15., pp. 1-6, 2015.

C. Avian, J. S. Leu, S.W. Prakosa, Muhamad Faisal, “An improved classification of pork adulteration in beef based on the electronic nose using modified deep extreme learning with principal component analysis as feature learning,” Food Analytical Methods, vol. 21, 2022, DOI: 10.1007/s12161-022-02361-9

S. Akodad, “Ensemble learning methods on the space of covariance matrices: Application to remote sensing scene and multivariate time series classification,” Automatic Control Engineering, Université de Bordeaux, NNT: 2021BORD0310ff, tel-03484011v2f, 2021.

R. Silvia, L. Germano, “Rough set theory – Fundamental concepts, principals, data extraction, and applications data mining and knowledge discovery in real life applications, J. Ponce, A. Karahoca (eds), I-Tech, Vienna, Austria, 2009.

T. R. JeraldBeno, M. Karnan, “Dimensionality reduction: Rough set-based feature reduction,” International Journal of Scientific and Research Publications, vol. 2, no. 9, pp. 1-6, 2012.

M. Amsaveni, S. Duraisamy, “A parallel rough set theory for nonlinear dimension-reduction in big data analysis,” International Journal of Intelligent Engineering & Systems, vol.12, no.5, pp. 170-178, 2019.

E. Aboul, M. H. A. Jafar, “Rough set approach for generation of classification rules of breast cancer data,” Informatica, vol. 15, no. 1, pp. 23–38, 2004.

P. Chaturvedi, A. K. Daniel, K. Khusboo, “Concept of rough set theory and its applications in decision-making processes,” International Journal of Advanced Research in Computer and Communication Engineering, vol. 6, special issue 2, pp. 43-46, 2017.

D. Miao, W. Pedrycz, D. Ślȩzak, G. Peters, Q. Hu, R. Wang, “Rough Sets and Knowledge Technology,” 9th International Conference, RSKT 2014, Shanghai, China, October 24-26, 2014,

N. Sengupta, J. Sil, “Dimension reduction using rough set theory for intrusion detection system,” Proceedings of the 4th National Conference, Computing for Nation Development, February 25 – 26, 2010, Bharati Vidyapeeth’s Institute of Computer Applications and Management, New Delhi.

D. K. Srivastava, “Data classification: A rough - SVM approach,” Contemporary Engineering Sciences, vol. 3, no. 2, pp. 77 – 86, 2010.

A. O. Adetunmbi, S. O. Falaki, O. S. Adewale, B. K. Alese, “Network intrusion detection based on rough set and k-nearest neighbour,” International Journal of Computing & ICT Research, vol. 2, no. 1, pp. 60-66, 2008.

A. Waleed, U. K. Rehan, K. Khalil, “Attributes reduction in big data,” Applied Sciences, vol. 10, no. 14, 2020, doi: 10.3390/app10144901

S. Qiang, C. Alexios, “Rough set-based dimensionality reduction for supervised and unsupervised learning,” International Journal of Applied Mathematics & Computational Science, vol.11, no. 3, pp. 583-601, 2001.

Y. Li, S. C. K. Shiu, S. K. Pal, J. N. K. Liu, “A rough set-based case-based reasoner for text categorization,” International Journal of Approximate Reasoning, vol. 41, no. 2, pp. 229-255, 2006.

A. Basant, M. Namita, “Sentiment classification using rough set based hybrid feature selection,” Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment, and Social Media Analysis, pp. 115–119, 2013.

M. K. Sabu, “A rough set based feature selection approach for the prediction of learning disabilities,” International Journal of Advanced Computational Engineering and Networking, vol. 2, no. 12, pp. 43-48, 2014.

B. Femina, S. Anto, “Disease diagnosis using rough set based feature selection and K-nearest neighbour classifier,” International Journal of Multidisciplinary Research and Development, vol. 2, no. 4, pp. 664-668, 2015.

L. Al-Shalabi, “Rough set-based reduction of incomplete medical datasets by reducing the number of missing values,” International Arab Journal of Information Technology, vol. 16, no. 2, pp. 203-210, 2019

W. Zhenhua, L. Suling, X. Lizhi, S. Wei, W. Dexing, H. Dongmei, “Dimensionality reduction method for hyperspectral image analysis based on rough set theory,” European Journal of Remote Sensing, vol. 53, no. 1, pp. 192–200, 2020.

How to Cite
Odighi, M. O., Olaniyan, J. O., & Imhanlahimi, R. E. (2022). A Rough Set Approach to Dimensionality Reduction for Performance Enhancement in Machine Learning. International Journal of Emerging Scientific Research, 4, 15-23. https://doi.org/10.37121/ijesr.vol4.192
Research Articles