Please use this identifier to cite or link to this item:
https://ptsldigital.ukm.my/jspui/handle/123456789/578680| Title: | Feature selection methods: case of filter and wrapper approaches for maximising classification accuracy |
| Authors: | Yap Bee Wah (UITM) Nurain Ibrahim (UITM) Hamzah Abdul Hamid (UITM) Shuzlina Abdul-Rahman (UITM) Simon Fong |
| Keywords: | Feature selection methods Filter method Logistic regression Simulation Wrapper method |
| Issue Date: | Jan-2018 |
| Description: | Feature selection has been widely applied in many areas such as classification of spam emails, cancer cells, fraudulent claims, credit risk, text categorisation and DNA microarray analysis. Classification involves building predictive models to predict the target variable based on several input variables (features). This study compares filter and wrapper feature selection methods to maximise the classifier accuracy. The logistic regression was used as a classifier while the performance of the feature selection methods was based on the classification accuracy, Akaike information criteria (AIC), Bayesian information criteria (BIC), Area Under Receiver operator curve (AUC), as well as sensitivity and specificity of the classifier. The simulation study involves generating data for continuous features and one binary dependent variable for different sample sizes. The filter methods used are correlation based feature selection and information gain, while the wrapper methods are sequential forward and sequential backward elimination. The simulation was carried out using R, an open-source programming language. Simulation results showed that the wrapper method (sequential forward selection and sequential backward elimination) methods were better than the filter method in selecting the correct features. |
| News Source: | Pertanika Journals |
| ISSN: | 0128-7680 |
| Volume: | 26 |
| Pages: | 329-340 |
| Publisher: | Universiti Putra Malaysia Press |
| Appears in Collections: | Journal Content Pages/ Kandungan Halaman Jurnal |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| ukmvital_116123+Source01+Source010.PDF | 345.64 kB | Adobe PDF |  View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.