Implementation of Evolution Strategies for Classifier Model Optimization

Authors

  • Mahmud Dwi Sulistiyo School of Computing, Telkom University
  • Rita Rismala School of Computing, Telkom University

DOI:

https://doi.org/10.21108/INDOJC.2016.1.2.43

Abstract

Classification becomes one of the classic problems that are often encountered in the field of artificial intelligence and data mining. The problem in classification is how to build a classifier model through training or learning process. Process in building the classifier model can be seen as an optimization problem. Therefore, optimization algorithms can be used as an alternative way to generate the classifier models. In this study, the process of learning is done by utilizing one of Evolutionary Algorithms (EAs), namely Evolution Strategies (ES). Observation and analysis conducted on several parameters that influence the ES, as well as how far the general classifier model used in this study solve the problem. The experiments and analyze results show that ES is pretty good in optimizing the linear classification model used. For Fisher’s Iris dataset, as the easiest to be classified, the test accuracy is best achieved by 94.4%; KK Selection dataset is 84%; and for SMK Major Election datasets which is the hardest to be classified reach only 49.2%.

Downloads

Download data is not yet available.

References

Bäck, T., & Schwefel, H. P. (1993). An Overview of Evolutionary Algorithms for Parameter Optimization. Evolutionary Computation, 1(1), 1-23. Crossref

Dianati, M., Song, I., & Treiber, M. (2002). An Introduction to Genetic Algorithms and Evolution Strategies. Technical report, University of Waterloo, Ontario, N2L 3G1, Canada.

Eiben, A. E., & Smith, J. E. (2003). Introduction to Evolutionary Computing. Springer Science & Business Media. Crossref

Go, A., Bhayani, R., & Huang, L. (2009). Twitter Sentiment Classification Using Distant Supervision. CS224N Project Report, Stanford, 1, 12.

Gottlieb, J., Marchiori, E., & Rossi, C. (2002). Evolutionary Algorithms for the Satisfiability Problem. Evolutionary Computation, 10(1), 35-50. Crossref

Greenwood, G. W., Gupta, A. K., & McSweeney, K. (1994, June). Scheduling Tasks in Multiprocessor Systems Using Evolutionary Strategies. In International Conference on Evolutionary Computation (pp. 345-349). Crossref

Hermawati, Fajar Astuti. (2013). Data Mining. Penerbit Andi.

Jones, G. (1998). Genetic and Evolutionary Algorithms. Encyclopedia of Computational Chemistry.

Louchet, J. (2000). Stereo Analysis Using Individual Evolution Strategy. In Pattern Recognition, 2000. Proceedings. 15th International Conference on (Vol. 1, pp. 908-911). IEEE. Crossref

Muhammad, L., Dayawati, R. N., & Rismala, R. (2014). Brain Tumor Detection and Classification In Magnetic Resonance Imaging (MRI) using Region Growing, Fuzzy Symmetric Measure, and Artificial Neural Network and Connected Component Labeling. International Journal on Information and Communication Technology| IJoICT, 1(1).

Nguyen, Danh V., and David M. Rocke. "Tumor classification by partial least squares using microarray gene expression data." Bioinformatics 18.1 (2002): 39-50. Crossref

Oliveto, P. S., He, J., & Yao, X. (2007, September). Evolutionary Algorithms and the Vertex Cover Problem. In Evolutionary Computation, 2007. CEC 2007. IEEE Congress on (pp. 1870-1877). IEEE. Crossref

Ostertag, M., & Kiencke, U. (1995, September). Optimization of Airbag Release Algorithms Using Evolutionary Strategies. In Control Applications, 1995., Proceedings of the 4th IEEE Conference on (pp. 275-280). IEEE. Crossref

Pennacchiotti, M., & Popescu, A. M. (2011). A Machine Learning Approach to Twitter User Classification. ICWSM, 11, 281-288.

Ragab, A. H. M., Noaman, A. Y., Al-Ghamdi, A. S., & Madbouly, A. I. (2014, June). A Comparative Analysis of Classification Algorithms for Students College Enrollment Approval Using Data Mining. In Proceedings of the 2014 Workshop on Interaction Design in Educational Environments (p. 106). ACM. Crossref

Rismala, R. (2015). Prediksi Time Series Tingkat Inflasi Indonesia Menggunakan Evolution Strategies. Jurnal Ilmiah Teknologi Informasi Terapan, 1(2).

Sulistiyo, Mahmud Dwi, Dayawati, R. N., Nurlasmaya. (2013, November). Evolution Strategies for Weight Optimization of Artificial Neural Network in Time Series Prediction. In Robotics, Biomimetics, and Intelligent Computational Systems (ROBIONETICS), 2013 IEEE International Conference on (pp. 143-147). IEEE.

Suyanto, ST., MSc. (2008). Evolutionary Computation: Komputasi Berbasis “Evolusi†dan “Genetikaâ€. Informatika.

Tsai, H. K., Yang, J. M., Tsai, Y. F., & Kao, C. Y. (2004). An Evolutionary Algorithm for Large Traveling Salesman Problems. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 34(4), 1718-1729. Crossref

Downloads

Published

2016-12-30

How to Cite

Sulistiyo, M. D., & Rismala, R. (2016). Implementation of Evolution Strategies for Classifier Model Optimization. Indonesian Journal on Computing (Indo-JC), 1(2), 13–26. https://doi.org/10.21108/INDOJC.2016.1.2.43

Issue

Vol. 1 No. 2 (2016): September, 2016

Section

Articles

License

  • Manuscript submitted to IndoJC has to be an original work of the author(s), contains no element of plagiarism, and has never been published or is not being considered for publication in other journals. 
  • Copyright on any article is retained by the author(s). Regarding copyright transfers please see below.
  • Authors grant IndoJC a license to publish the article and identify itself as the original publisher.
  • Authors grant IndoJC commercial rights to produce hardcopy volumes of the journal for sale to libraries and individuals.
  • Authors grant any third party the right to use the article freely as long as its original authors and citation details are identified.
  • The article and any associated published material is distributed under the Creative Commons Attribution 4.0License