Access the full text.
Sign up today, get DeepDyve free for 14 days.
Rafael Cruz, R. Sabourin, George Cavalcanti (2015)
META-DES.H: A Dynamic Ensemble Selection technique using meta-learning and a dynamic weighting approach2015 International Joint Conference on Neural Networks (IJCNN)
Liying Yang (2011)
Classifiers selection for ensemble learning based on accuracy and diversityProcedia Engineering, 15
H. Escalante, M. Montes-y-Gómez, L. Sucar (2010)
Ensemble particle swarm model selectionThe 2010 International Joint Conference on Neural Networks (IJCNN)
P. Indyk, S. Mahabadi, Mohammad Mahdian, V. Mirrokni (2014)
Composable core-sets for diversity and coverage maximizationProceedings of the 33rd ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Huaping Guo, Ming Fan (2011)
Ensemble Pruning via Base-Classifier Replacement
Qun Dai, Meiling Li (2015)
Introducing randomness into greedy ensemble pruning algorithmsApplied Intelligence, 42
Huaping Guo, Hongbing Liu, Ran Li, C. Wu, Yibo Guo, Mingliang Xu (2018)
Margin & diversity based ordering ensemble pruningNeurocomputing, 275
Grigorios Tsoumakas, L. Angelis, I. Vlahavas (2005)
Selective fusion of heterogeneous classifiersIntell. Data Anal., 9
Nan Li, Zhi-Hua Zhou (2009)
Selective Ensemble under Regularization Framework
Luc Giffon, C. Lamothe, Léo Bouscarrat, P. Milanesi, Farah Cherfaoui, Sokol Koço (2020)
Pruning Random Forest with Orthogonal Matching Trees
Nan Li, Yang Yu, Zhi-Hua Zhou (2012)
Diversity Regularized Ensemble Pruning
James McDonald, Yexiao Xu (1995)
A generalization of the beta distribution with applicationsFuel and Energy Abstracts
S. García, Alberto Fernández, J. Luengo, F. Herrera (2010)
Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of powerInf. Sci., 180
M. Hall (2003)
Correlation-based Feature Selection for Machine Learning
Hongwei Hao, Cheng-Lin Liu, H. Sako (2003)
Comparison of genetic algorithm and sequential search methods for classifier subset selectionSeventh International Conference on Document Analysis and Recognition, 2003. Proceedings.
B. Kiran, J. Serra (2017)
Cost-Complexity Pruning of Random Forests
B. Damodaran, R. Nidamanuri, Y. Tarabalka (2015)
Dynamic Ensemble Selection Approach for Hyperspectral Image Classification With Joint Spectral and Spatial InformationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8
A. Britto, R. Sabourin, Luiz Oliveira (2014)
Dynamic selection of classifiers - A comprehensive reviewPattern Recognit., 47
Yijun Bian, Huanhuan Chen (2019)
When Does Diversity Help Generalization in Classification Ensembles?IEEE Transactions on Cybernetics, 52
Pablo Pérez-Gállego, Alberto Castaño, J. Quevedo, J. Coz (2019)
Dynamic ensemble selection for quantification tasksInf. Fusion, 45
Jitendra Kumar, Ashutosh Singh, Anand Mohan, R. Buyya (2019)
Ensemble LearningMachine Learning Foundations
Yi Zhang, S. Burer, W. Street (2006)
Ensemble Pruning Via Semi-definite ProgrammingJ. Mach. Learn. Res., 7
Kewen Li, Wenying Liu, K. Zhao, Mingwen Shao, Lu Liu (2014)
A Novel Dynamic Weight Neural Network Ensemble ModelInternational Journal of Distributed Sensor Networks, 11
Qiangli Zhao, Yan-Huang Jiang, Ming Xu (2009)
A fast ensemble pruning algorithm based on pattern mining processData Mining and Knowledge Discovery, 19
Zhengshen Jiang, Hongzhi Liu, Bin Fu, Zhonghai Wu (2016)
A Novel Bayesian Ensemble Pruning Method2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW)
Zhaozhao Li, Lide Wang, Ping Shen, Huijuan Song, Xiaoming Du (2019)
Fault Diagnosis of MVB Based on Random Forest and Ensemble Pruning
Mahardhika Pratama, W. Pedrycz, E. Lughofer (2017)
Evolving Ensemble Fuzzy ClassifierIEEE Transactions on Fuzzy Systems, 26
L. Kuncheva (2004)
Diversity in multiple classifier systemsInf. Fusion, 6
Sergio González, F. Herrera, S. García (2015)
Monotonic Random Forest with an Ensemble Pruning Mechanism based on the Degree of MonotonicityNew Generation Computing, 33
Chao Qian, Yang Yu, Zhi-Hua Zhou (2015)
Pareto Ensemble Pruning
(2019)
A pruning of random forests: a diversity-based heuristic measure to simplify a random forest ensemble
Zardad Khan, Asma Gul, A. Perperoglou, M. Miftahuddin, Osama Mahmoud, W. Adler, B. Lausen (2019)
Ensemble of optimal trees, random forest and random projection ensemble classificationAdvances in Data Analysis and Classification, 14
Rafael Cruz, George Cavalcanti, Ing Tsang (2011)
A method for dynamic ensemble selection based on a filter and an adaptive distance to improve the quality of the regions of competenceArXiv, abs/1811.00669
F. Roli, G. Giacinto, G. Vernazza (2001)
Methods for Designing Multiple Classifier Systems
Simon Bernard, L. Heutte, Sébastien Adam (2009)
On the selection of decision trees in Random Forests2009 International Joint Conference on Neural Networks
Zhenyu Lu, Xindong Wu, Xingquan Zhu, J. Bongard (2010)
Ensemble pruning via individual contribution orderingProceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
D. Gacquer, V. Delcroix, F. Delmotte, S. Piechowiak (2009)
On the Effectiveness of Diversity When Training Multiple Classifier Systems
Yi Yang, Deqiang Han, J. Dezert (2018)
A Ranking Distance Based Diversity Measure for Multiple Classifier Systems2018 International Conference on Control, Automation and Information Sciences (ICCAIS)
Anil Narassiguin, H. Elghazel, A. Aussem (2017)
Dynamic Ensemble Selection with Probabilistic Classifier Chains
M. Ahmed, Luca Didaci, Bahram Lavi, G. Fumera (2018)
Using Diversity for Classifier Ensemble Pruning: An Empirical InvestigationTheoretical and Applied Informatics, 29
A. Raharjo, M. Quafafou, Faicel Chamroukhi (2020)
On Reliability of Majority Voting
H. Elghazel, A. Aussem, Florence Perraud (2011)
Trading-Off Diversity and Accuracy for Optimal Ensemble Tree Selection in Random Forests
Rafael Cruz, R. Sabourin, George Cavalcanti (2014)
Analyzing Dynamic Ensemble Selection Techniques Using Dissimilarity Analysis
Zahra Taghavi, Masood Torshiz, Alireza Fardad (2015)
2PS: A novel swarm based selection algorithm for ensemble learning problem2015 International Congress on Technology, Communication and Knowledge (ICTCK)
Byungdae An, Yongmoo Suh (2020)
Identifying financial statement fraud with decision rules obtained from Modified Random ForestData Technol. Appl., 54
Xuhui Zhu, Zhiwei Ni, Liping Ni, Feifei Jin, Meiying Cheng, Jingming Li (2019)
Improved discrete artificial fish swarm algorithm combined with margin distance minimization for ensemble pruningComput. Ind. Eng., 128
Shaowei Wang, Liusheng Huang, Pengzhan Wang, Hongli Xu, Wei Yang (2017)
Personalized Classifier Ensemble Pruning Framework for Mobile CrowdsourcingArXiv, abs/1701.07166
H. Escalante, M. Montes-y-Gómez, Jesus Gonzalez, P. Gómez-Gil, L. Robles, C. García, Carolina Reta, Alejandro Rosales-Pérez (2012)
Acute leukemia classification by ensemble particle swarm model selectionArtificial intelligence in medicine, 55 3
Zhi-Hua Zhou, Jianxin Wu, Wei Tang (2002)
Ensembling neural networks: Many could be better than allArtif. Intell., 137
D. Margineantu, Thomas Dietterich (1997)
Pruning Adaptive Boosting
Simon Bernard, L. Heutte, Sébastien Adam (2009)
Influence of Hyperparameters on Random Forest Accuracy
Rafael Cruz, Hiba Zakane, R. Sabourin, George Cavalcanti (2017)
Dynamic ensemble selection VS K-NN: Why and when dynamic selection obtains higher classification performance?2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA)
Mojtaba Maskouni, S. Hosseini, Hadi Abachi, M. Kangavari, Xiaofang Zhou (2018)
Auto-CES: An Automatic Pruning Method Through Clustering Ensemble Selection
D. Ruta, B. Gabrys (2005)
Classifier selection for majority votingInf. Fusion, 6
M. Hall (1999)
Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning
J. Demšar (2006)
Statistical Comparisons of Classifiers over Multiple Data SetsJ. Mach. Learn. Res., 7
Albert Ko, R. Sabourin, A. Britto, Luiz Oliveira (2014)
A Classifier-free Ensemble Selection Method based on Data Diversity in Random SubspacesArXiv, abs/1408.2889
Shashidhar Kaparthi, D. Bumblauskas (2020)
Designing predictive maintenance systems using decision tree-based machine learning techniquesInternational Journal of Quality & Reliability Management, 37
Qun Dai (2013)
A novel ensemble pruning algorithm based on randomized greedy selective strategy and ballotNeurocomputing, 122
Vasudha Bhatnagar, M. Bhardwaj, Shivam Sharma, Sufyan Haroon (2014)
Accuracy–diversity based pruning of classifier ensemblesProgress in Artificial Intelligence, 2
Li Guo, S. Boukir (2013)
Margin-based ordered aggregation for ensemble pruningPattern Recognit. Lett., 34
Ioannis Partalas, Grigorios Tsoumakas, I. Vlahavas (2010)
An ensemble uncertainty aware measure for directed hill climbing ensemble pruningMachine Learning, 81
Journal of Econometrics, 66
Xu-Cheng Yin, Chun Yang, Hongwei Hao (2014)
Learning to Diversify via Weighted Kernels for Classifier EnsembleArXiv, abs/1406.1167
L. Breiman (2001)
Random ForestsMachine Learning, 45
Harris Butler, Mark Friend, K. Bauer, Trevor Bihl (2018)
The effectiveness of using diversity to select multiple classifier systems with varying classification thresholdsJournal of Algorithms and Computational Technology, 12
Khaled Fawagreh, M. Gaber, Eyad Elyan (2015)
On Extreme Pruning of Random Forest Ensembles for Real-time Predictive ApplicationsArXiv, abs/1503.04996
S. Fernandes, A. Souza, Danilo Gastaldello, D. Pereira, J. Papa (2017)
Pruning optimum-path forest ensembles using metaheuristic optimization for land-cover classificationInternational Journal of Remote Sensing, 38
Gonzalo Martínez-Muñoz, D. Hernández-Lobato, A. Suárez (2009)
An Analysis of Ensemble Pruning Techniques Based on Ordered AggregationIEEE Transactions on Pattern Analysis and Machine Intelligence, 31
Reza Mousavi, M. Eftekhari, F. Rahdari (2018)
Omni-Ensemble Learning (OEL): Utilizing Over-Bagging, Static and Dynamic Ensemble Selection Approaches for Software Defect PredictionInt. J. Artif. Intell. Tools, 27
K. Hera, S. Ayush, M.A. Kumar (2020)
Use of classification algorithms in health careBig Data Analytics and Intelligence: A Perspective for Health Care
R. Maclin, D. Opitz (1999)
Popular Ensemble Methods: An Empirical StudyJ. Artif. Intell. Res., 11
Edgar Cano, F. Cosío, Luc Duong, C. Bellefleur, M. Roy-Beaudry, J. Joncas, S. Parent, H. Labelle (2018)
Dynamic ensemble selection of learner-descriptor classifiers to assess curve types in adolescent idiopathic scoliosisMedical & Biological Engineering & Computing, 56
Gavin Brown, L. Kuncheva (2010)
"Good" and "Bad" Diversity in Majority Vote Ensembles
Ensemble methods have been widely used in the field of pattern recognition due to the difficulty of finding a single classifier that performs well on a wide variety of problems. Despite the effectiveness of these techniques, studies have shown that ensemble methods generate a large number of hypotheses and that contain redundant classifiers in most cases. Several works proposed in the state of the art attempt to reduce all hypotheses without affecting performance.Design/methodology/approachIn this work, the authors are proposing a pruning method that takes into consideration the correlation between classifiers/classes and each classifier with the rest of the set. The authors have used the random forest algorithm as trees-based ensemble classifiers and the pruning was made by a technique inspired by the CFS (correlation feature selection) algorithm.FindingsThe proposed method CES (correlation-based Ensemble Selection) was evaluated on ten datasets from the UCI machine learning repository, and the performances were compared to six ensemble pruning techniques. The results showed that our proposed pruning method selects a small ensemble in a smaller amount of time while improving classification rates compared to the state-of-the-art methods.Originality/valueCES is a new ordering-based method that uses the CFS algorithm. CES selects, in a short time, a small sub-ensemble that outperforms results obtained from the whole forest and the other state-of-the-art techniques used in this study.
International Journal of Intelligent Computing and Cybernetics – Emerald Publishing
Published: Apr 23, 2021
Keywords: Ensemble pruning; Random forest; Tree selection; Correlation; CFS; CES
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.