BENCHMARKING MACHINE LEARNING MODELS FOR INDONESIAN E-COMMERCE SENTIMENT CLASSIFICATION
DOI:
https://doi.org/10.61677/jth.v4i1.891Keywords:
Sentiment analysis, e-commerce reviews, PRDECT-ID, TF-IDF, machine learning.Abstract
Indonesia's expanding e-commerce sector generates a growing volume of customer-written product reviews that can reveal both satisfaction and dissatisfaction. Automatically determining sentiment in these reviews is nevertheless difficult because marketplace language commonly includes informal wording, inconsistent spelling, brief statements, and domain-specific terms. This research benchmarks conventional machine learning methods for classifying the sentiment of Indonesian e-commerce reviews in the PRDECT-ID dataset. The data were obtained from Tokopedia and contain sentiment and emotion annotations. Following preprocessing, the experiment used 5,305 reviews, comprising 2,752 negative and 2,553 positive instances. The processing pipeline included case folding, text cleaning, normalization, tokenization, selective removal of stopwords, and Term Frequency-Inverse Document Frequency (TF-IDF) feature construction. Multinomial Naive Bayes, Support Vector Machine, and Random Forest were then evaluated under the same experimental configuration. The TF-IDF and Support Vector Machine combination produced the strongest results, reaching 0.9595 accuracy, 0.9594 macro-F1, and 0.9595 weighted-F1. These findings establish a reproducible reference point for sentiment classification in Indonesian e-commerce reviews.
References
Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297. https://doi.org/10.1007/BF00994018
Forman, G. (2003). An Extensive Empirical Study of Feature Selection Metrics for Text Classification. Journal of Machine Learning Research, 3, 1289–1305. https://doi.org/10.5555/944919.944974
Harmandini, K. P., & L, K. M. (2024). Analysis of {TF-IDF} and {TF-RF} Feature Extraction on Product Review Sentiment. Sinkron: Jurnal Dan Penelitian Teknik Informatika, 8(2), 929–937. https://doi.org/10.33395/sinkron.v8i2.13376
He, H., & Garcia, E. A. (2009). Learning from Imbalanced Data. IEEE Transactions on Knowledge and Data Engineering, 21(9), 1263–1284. https://doi.org/10.1109/TKDE.2008.239
Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L. E., & Brown, D. E. (2019). Text Classification Algorithms: A Survey. Information, 10(4), 150. https://doi.org/10.3390/info10040150
Li, J., Sun, A., Han, J., & Li, C. (2022). A Survey on Deep Learning for Named Entity Recognition. IEEE Transactions on Knowledge and Data Engineering, 34(1), 50–70. https://doi.org/10.1109/TKDE.2020.2981314
Li, Q., Peng, H., Li, J., Xia, C., Yang, R., Sun, L., Yu, P. S., & He, L. (2022). A Survey on Text Classification: From Traditional to Deep Learning. ACM Transactions on Intelligent Systems and Technology, 13(2), 1–41. https://doi.org/10.1145/3495162
Mao, Y., Liu, Q., & Zhang, Y. (2024). Sentiment Analysis Methods, Applications, and Challenges: A Systematic Literature Review. Journal of King Saud University - Computer and Information Sciences, 36(4), 102048. https://doi.org/10.1016/j.jksuci.2024.102048
Medhat, W., Hassan, A., & Korashy, H. (2014). Sentiment Analysis Algorithms and Applications: A Survey. Ain Shams Engineering Journal, 5(4), 1093–1113. https://doi.org/10.1016/j.asej.2014.04.011
Minaee, S., Kalchbrenner, N., Cambria, E., Nikzad, N., Chenaghlu, M., & Gao, J. (2021). Deep Learning-Based Text Classification: A Comprehensive Review. ACM Computing Surveys, 54(3), 1–40. https://doi.org/10.1145/3439726
Pang, B., & Lee, L. (2008). Opinion Mining and Sentiment Analysis. Foundations and Trends in Information Retrieval, 2(1-2), 1–135. https://doi.org/10.1561/1500000011
Saito, T., & Rehmsmeier, M. (2015). The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets. PLOS ONE, 10(3), e0118432. https://doi.org/10.1371/journal.pone.0118432
Salton, G., & Buckley, C. (1988). Term-Weighting Approaches in Automatic Text Retrieval. Information Processing & Management, 24(5), 513–523. https://doi.org/10.1016/0306-4573(88)90021-0
Sebastiani, F. (2002). Machine Learning in Automated Text Categorization. ACM Computing Surveys, 34(1), 1–47. https://doi.org/10.1145/505282.505283
Sokolova, M., & Lapalme, G. (2009). A systematic analysis of performance measures for classification tasks. Information Processing & Management, 45(4), 427–437. https://doi.org/10.1016/j.ipm.2009.03.002
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011). Lexicon-Based Methods for Sentiment Analysis. Computational Linguistics, 37(2), 267–307. https://doi.org/10.1162/COLI_a_00049
Uysal, A. K., & Gunal, S. (2014). The Impact of Preprocessing on Text Classification. Information Processing & Management, 50(1), 104–112. https://doi.org/10.1016/j.ipm.2013.08.006
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022). A survey on sentiment analysis methods, applications, and challenges. Artificial Intelligence Review, 55(7), 5731–5780. https://doi.org/10.1007/s10462-022-10144-1
Zhang, L., Wang, S., & Liu, B. (2018). Deep learning for sentiment analysis: A survey. WIREs Data Mining and Knowledge Discovery, 8(4), e1253. https://doi.org/10.1002/widm.1253
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 JTH: Journal of Technology and Health
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
