Feature selection with fuzzy-rough minimum classification error criterion
Authors: Changzhong Wang, Yuhua Qian, Weiping Ding, Xiaodong Feng
Abstract:
Classical fuzzy rough set often uses fuzzy rough dependency as an evaluation function of feature selection. However, this function only retains the maximum member- ship degree of a sample to one decision class, it can not describe the classification error. Therefore, in this work, a novel criterion function for feature selection is proposed to overcome this weakness. To characterize the classification error rate, we first introduce a class of irreflexive and symmetric fuzzy binary relations to redefine the concepts of fuzzy rough approximations. Then, we propose a novel concept of dependency: inner product dependency to describe the classification error, and construct a criterion function to evaluate the importance of candidate features. The proposed criterion function not only can maintain a maximum dependency function, but also guarantees the minimum classification error. The experimental analysis shows that the proposed criterion function is effective for data sets with a large overlap between different categories.
Keywords: Fuzzy rough set; Dependency function; Fuzzy inner product; Feature selection
Feature selection with fuzzy-rough minimum classification error criterion.pdf
Thu Nov 25 18:50:00 CST 2021