Hybrid feature selection for text classification

Serkan GÜNAL

Makale detayları

Hybrid feature selection for text classification

Yazarlar:

Serkan GÜNAL

Yayıncı:

TUBITAK

Dergi:

Turkish Journal of Electrical Engineering and Computer Science 2012 Vol.20 Issue Sup.2, pp.1296-1311

Belge Tipi:

Makale

Yayın Tarihi:

11/2011

Belge Dili:

Türkçe

Document ID (Org No.):

2000743692

Sıklık:

İki Aylık

eISSN:

1303-6203

pISSN:

1300-0632

Özet:

 

Feature selection is vital in the field of pattern  classification due to accuracy and processing time considerations.  The selection of proper features is of greater importance when the  initial feature set is considerably large.  Text classification is a  typical example of this situation, where the size of the initial  feature set may reach to hundreds or even thousands.  There are  numerous research studies in the literature offering different feature selection strategies for text classification, mostly focused on filters.  In spite of the extensive number of these studies, there is no significant work investigating the efficacy of a combination of features, which are selected by different selection methods, under different conditions.  In this study, a hybrid feature selection strategy, which consists of both filter and wrapper feature selection steps, is proposed to comprehensively analyze the redundancy or relevancy of the text features selected by different methods in the case of different feature set sizes, dataset characteristics, classifiers, and success measures.  The results of the experimental study reveal that a combination of the features selected by various methods is more effective than the features selected by the single selection method.  The profile of the combination is, however, influenced by characteristics of the dataset, choice of the classification algorithm, and the success measure.

 

Feature selection is vital in the field of pattern  classification due to accuracy and processing time considerations.  The selection of proper features is of greater importance when the  initial feature set is considerably large.  Text classification is a  typical example of this situation, where the size of the initial  feature set may reach to hundreds or even thousands.  There are  numerous research studies in the literature offering different feature selection strategies for text classification, mostly focused on filters.  In spite of the extensive number of these studies, there is no significant work investigating the efficacy of a combination of features, which are selected by different selection methods, under different conditions.  In this study, a hybrid feature selection strategy, which consists of both filter and wrapper feature selection steps, is proposed to comprehensively analyze the redundancy or relevancy of the text features selected by different methods in the case of different feature set sizes, dataset characteristics, classifiers, and success measures.  The results of the experimental study reveal that a combination of the features selected by various methods is more effective than the features selected by the single selection method.  The profile of the combination is, however, influenced by characteristics of the dataset, choice of the classification algorithm, and the success measure.

Makale detayları

Hybrid feature selection for text classification

Yazarlar: Serkan GÜNAL

Yayıncı: TUBITAK

Dergi: Turkish Journal of Electrical Engineering and Computer Science 2012 Vol.20 Issue Sup.2, pp.1296-1311

Belge Tipi: Makale

Yayın Tarihi: 11/2011

Belge Dili: Türkçe

Document ID (Org No.): 2000743692

Sıklık: İki Aylık

eISSN: 1303-6203

pISSN: 1300-0632

Sayı

Yazarlar:

Serkan GÜNAL

Yayıncı:

TUBITAK

Dergi:

Turkish Journal of Electrical Engineering and Computer Science 2012 Vol.20 Issue Sup.2, pp.1296-1311

Belge Tipi:

Makale

Yayın Tarihi:

11/2011

Belge Dili:

Türkçe

Document ID (Org No.):

2000743692

Sıklık:

İki Aylık

eISSN:

1303-6203

pISSN:

1300-0632