An Arabic text categorization approach using term weighting and multiple reducts

An Arabic text categorization approach using term weighting and multiple reducts Text categorization is the process of assigning a predefined category label to an unlabeled document based on its content. One of the challenges of automatic text categorization is the high dimensionality of data that may affect the performance of the categorization model. This paper proposed an approach for the categorization of Arabic text based on term weighting and the reduct concept of the rough set theory to reduce the number of terms used to generate the classification rules that form the classifier. The paper proposed a multiple minimal reduct extraction algorithm by improving the Quick reduct algorithm. The multiple reducts are used to generate the set of classification rules which represent the rough set classifier. To evaluate the proposed approach, an Arabic corpus of 2700 documents nine categories is used. In the experiment, we compared the results of the proposed approach when using multiple and single minimal reducts. The results showed that the proposed approach had achieved an accuracy of 94% when using multiple reducts, which outperformed the single reduct method which achieved an accuracy of 86%. The results of the experiments also showed that the proposed approach outperforms both the K -NN and J48 algorithms regarding classification accuracy http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Soft Computing Springer Journals

An Arabic text categorization approach using term weighting and multiple reducts

15 pages
Read Article

Loading next page...
 
/lp/springer_journal/an-arabic-text-categorization-approach-using-term-weighting-and-Xaszs4vklT
Publisher
Springer Berlin Heidelberg
Copyright
Copyright © 2018 by Springer-Verlag GmbH Germany, part of Springer Nature
Subject
Engineering; Computational Intelligence; Artificial Intelligence (incl. Robotics); Mathematical Logic and Foundations; Control, Robotics, Mechatronics
ISSN
1432-7643
eISSN
1433-7479
D.O.I.
10.1007/s00500-018-3249-z
Publisher site
See Article on Publisher Site

Abstract

Text categorization is the process of assigning a predefined category label to an unlabeled document based on its content. One of the challenges of automatic text categorization is the high dimensionality of data that may affect the performance of the categorization model. This paper proposed an approach for the categorization of Arabic text based on term weighting and the reduct concept of the rough set theory to reduce the number of terms used to generate the classification rules that form the classifier. The paper proposed a multiple minimal reduct extraction algorithm by improving the Quick reduct algorithm. The multiple reducts are used to generate the set of classification rules which represent the rough set classifier. To evaluate the proposed approach, an Arabic corpus of 2700 documents nine categories is used. In the experiment, we compared the results of the proposed approach when using multiple and single minimal reducts. The results showed that the proposed approach had achieved an accuracy of 94% when using multiple reducts, which outperformed the single reduct method which achieved an accuracy of 86%. The results of the experiments also showed that the proposed approach outperforms both the K -NN and J48 algorithms regarding classification accuracy

Journal

Soft Computing – Springer Journals

Published: Jun 5, 2018

References

  • Applying genetic algorithms to information retrieval using vector space model
    Abualigah, LMQ; Hanandeh, ES
  • Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering
    Abualigah, LM; Khader, AT
  • A new feature selection method to improve the document clustering using particle swarm optimization algorithm
    Abualigah, LM; Khader, AT; Hanandeh, ES
  • Arabic text categorization using classification rule mining
    Al-Diabat, M
  • An associative rule-based classifier for Arabic medical text
    Al-Radaideh, Q; Al-Khateeb, S
  • Application of rough set-based feature selection for Arabic sentiment analysis
    Al-Radaideh, Q; Al-Qudah, G
  • A hybrid approach for arabic text summarization using domain knowledge and genetic algorithms
    Al-Radaideh, Q; Bataineh, D
  • An approach for Arabic text categorization using association rule mining
    Al-Radaideh, Q; Al-Shawakfa, E; Ghareb, A; Abu Salem, H
  • Automated Arabic text categorization using SVM and NB
    Alsaleem, S
  • Statistical Bayesian learning for automatic arabic text categorization
    Al-Salemi, B; Aziz, M
  • Neighborhood rough set reduction with fish swarm algorithm
    Chen, Y; Zeng, Z; Lu, J
  • Machine learning for Arabic text categorization
    Duwairi, R
  • Arabic text categorization
    Duwairi, R
  • A study of the effects of preprocessing strategies on sentiment analysis for Arabic text
    Duwairi, R; El-Orfali, M
  • Feature reduction techniques for Arabic text categorization
    Duwairi, R; Al-Refai, M; Khasawneh, N
  • Hybrid feature selection based on enhanced genetic algorithm for text categorization
    Ghareb, A; Hamdan, A; Bakar, A
  • Enhanced filter feature selection methods for Arabic text categorization
    Ghareb, A; Bakar, AA; Al-Radaideh, Q; Hamdan, A
  • Arabic text classification using support vector machines
    Gharib, TF; Habib, MB; Fayed, ZT
  • The WEKA data mining software: an update
    Hall, M; Frank, E; Holmes, G; Pfahringer, B; Reutemann, P; Witten, I
  • Data mining concepts and techniques
    Han, J; Kamber, M; Pei, J
  • Performance of KNN and SVM classifiers on full word Arabic articles
    Hmeidi, I; Hawashin, B; El-Qawasmeh, E
  • Automatic Arabic text categorization: a comprehensive comparative study
    Hmeidi, I; Al-Ayyoub, M; Abdulla, N; Almodawar, A; Abooraig, R; Mahyoub, N
  • Arabic text classification using SMO, Naive Bayesian, J48 algorithm
    Hussien, MI; Olayah, F; AL-dwan, M; Shamsan, A
  • Automatic text categorization and its application to text retrieval
    Lam, W; Ruiz, M; Srinivasan, P
  • Chi-square feature extraction based SVMs Arabic language text categorization system
    Mesleh, A
  • Rough sets
    Pawlak, Z
  • Rough sets: theoretical aspects of reasoning about data
    Pawlak, Z
  • A new classification method based on rough sets theory
    Rasim, Cekik R; Telceken, S
  • An intelligent system for arabic text categorization
    Syiam, MM; Fayed, ZT; Habib, MB
  • Dimensionality reduction based on rough set theory: a review
    Thangavel, K; Pethalakshmi, A
  • Unsupervised quick reduct algorithm using rough set theory
    Velayutham, C; Thangavel, K
  • The effect of stemming on Arabic text classification: an empirical study
    Wahbeh, A; Al-Kabi, M; Al-Radaideh, Q; Al-Shawakfa, E; Alsmadi, I
  • Using rough sets with heuristics for feature selection
    Zhong, N; Dong, J; Ohsuga, S
  • Rough set methods in feature selection via submodular function
    Zhu, XZ; Zhu, W; Fan, XN

You’re reading a free preview. Subscribe to read the entire article.

Try 2 weeks free now

DeepDyve is your
personal research library

It’s your single place to instantly
discover and read the research
that matters to you.

Enjoy affordable access to
over 18 million articles from more than
15,000 peer-reviewed journals.

All for just $49/month

Explore the DeepDyve Library

or browse the journals available

Search

Query the DeepDyve database, plus search all of PubMed and Google Scholar seamlessly

Organize

Save any article or search result from DeepDyve, PubMed, and Google Scholar... all in one place.

Access

Get unlimited, online access to over 18 million full-text articles from more than 15,000 scientific journals.

Your journals are on DeepDyve

Read from thousands of the leading scholarly journals from SpringerNature, Elsevier, Wiley-Blackwell, Oxford University Press and more.

All the latest content is available, no embargo periods.

See the journals in your area

DeepDyve

Freelancer

DeepDyve

Pro

Price

FREE

$49/month
$360/year

Save searches from
Google Scholar,
PubMed

Create lists to
organize your research

Export lists, citations

Read DeepDyve articles

Abstract access only

Unlimited access to over
18 million full-text articles

Print

20 pages / month

PDF Discount

20% off

Sign up
for free
Start 14 day
Free Trial