logo
Volume 8, Issue 2 (3-2012)                   JSDP 2012, 8(2): 101-114 | Back to browse issues page

XML Persian Abstract Print

Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Mohammadzadeh J, Masoudnia S, Araani A. Improving classification performance using combination features of different neural network ensemble methods. JSDP 2012; 8 (2) :101-114
URL: http://jsdp.rcisp.ac.ir/article-1-704-en.html
Improving classification performance using combination features of different neural network ensemble methods
Javad Mohammadzadeh * , Saeed Masoudnia , Ali Araani
Abstract:   (4840 Views)

Both theoretical and experimental studies have shown that combining accurate Neural Networks (NN) in the ensemble with negative error correlation greatly improves their generalization abilities. Negative Correlation Learning (NCL) and Mixture of Experts (ME), two popular combining methods, each employ different special error functions for the simultaneous training of NN experts to produce negatively correlated NN experts. In this paper, we review the properties of the NCL and ME methods, discussing their advantages and disadvantages. Characterization of both methods showed that they have different but complementary features, so if a hybrid system can be designed to include features of both NCL and ME, it may be better than each of its basis approaches. In this study, an approach is proposed to combine the features of both methods, i.e., Mixture of Negatively Correlated Experts (MNCE). In this approach, the capability of a control parameter for NCL is incorporated in the error function of ME, which enables the training algorithm of ME to establish better balance in bias-variance-covariance trade-offs. The proposed hybrid ensemble method, MNCE, are compared with their constituent methods, ME and NCL, in solving several benchmark problems. The experimental results show that our proposed method preserve the advantages and alleviate the disadvantages of their basis approaches, offering significantly improved performance over the original methods.
Keywords: Classification-Neural network ensemble-Negative Correlation Learning-Mixture of Experts
Full-Text [PDF 3791 kb]   (1214 Downloads)    
Type of Study: Research | Subject: Paper
Received: 2012/03/19 | Accepted: 2018/02/19 | Published: 2018/02/19 | ePublished: 2018/02/19
Add your comments about this article : Your username or Email:
CAPTCHA
Send email to the article author

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.