Sentiment Analysis of Indonesian Mobile Legends: Bang Bang Reviews Using Random Forest, KNN, TF-IDF, and SMOTE

Ahmad Alif Candra Selamet; Pratomo Setiaji; Wiwit Agus Triyanto

doi:10.36080/idealis.v9i2.3819

Authors

Ahmad Alif Candra Selamet Sistem Informasi, Fakultas Teknik, Universitas Muria Kudus, Kudus, Indonesia
Pratomo Setiaji Sistem Informasi, Fakultas Teknik, Universitas Muria Kudus, Kudus, Indonesia
Wiwit Agus Triyanto Sistem Informasi, Fakultas Teknik, Universitas Muria Kudus, Kudus, Indonesia

DOI:

https://doi.org/10.36080/idealis.v9i2.3819

Keywords:

K-Nearest Neighbors, Mobile Legends:Bang Bang, Random Forest, Sentiment Analysis, SMOTE

Abstract

Mobile Legends: Bang Bang (MLBB) is one of the most popular mobile games, generating a large number of user reviews on the Google Play Store. The large volume of reviews makes manual sentiment analysis impractical, requiring an automated machine learning approach. This study compares the performance of Random Forest and K-Nearest Neighbors (KNN) for classifying sentiment in Indonesian-language MLBB reviews. A total of 6,994 reviews were obtained through web scraping and preprocessing. The proposed framework includes text preprocessing, rating-based sentiment labeling, TF-IDF feature extraction, SMOTE-based class balancing, model training, and evaluation using Accuracy, Precision, Recall, F1-score, Macro-F1, Weighted-F1, and 5-fold cross-validation. Random Forest with SMOTE achieved the best performance, with an Accuracy of 84.0% and a Macro-F1 score of 80.8%, outperforming KNN with SMOTE, which achieved 73.8% Accuracy and 71.9% Macro-F1. The ablation study demonstrates that the effectiveness of SMOTE is model-dependent, improving Random Forest but degrading KNN performance. This study provides empirical evidence of SMOTE impact on different classifiers and employs cross-validation-based K selection to prevent test data leakage.

Downloads

Download data is not yet available.

References

[1] Kompas, “Transaksi ‘Game’ Rp 6,4 Miliar Per Hari, Siapa yang Menikmati?” Accessed: Jul. 14, 2026. [Online]. Available: https://www.kompas.id/artikel/transaksi-game-rp-64-miliar-per-hari-siapa-saja-yang-menikmati

[2] GoodStats, “Game Online Paling Sering Diakses Publik Indonesia 2025.” Accessed: Jun. 12, 2026. [Online]. Available: https://data.goodstats.id/statistic/game-online-paling-sering-diakses-publik-indonesia-2025-e3fGx

[3] Indotelko, “Lima pemain wakili Indonesia di ENC 2026 Mobile Legends.” Accessed: Jun. 12, 2026. [Online]. Available: https://www.indotelko.com/read/1781057622/lima-pemain-wakili-indonesia-di-enc-2026-mobile-legends

[4] S. S. Sanjaya, A. K. Jaya, R. Candra, and S. Zang, “Sentiment Analysis of Mobile Legends Game using Naïve Bayes, K-Nearest Neighbors and Support Vector Machine Algorithm,” Journal of Artificial Intelligence and Engineering Applications, vol. 5, no. 2, pp. 2252–2260, Feb. 2026, doi: 10.59934/jaiea.v5i2.1840.

[5] W. A. Ma’arif, Sarwido, and T. Tamrin, “Analisis Sentimen Terhadap Ulasan Game Mobile Legend di Playstore menggunakan Algoritma Logistic Regression,” JUKI : Jurnal Komputer dan Informatika, vol. 8, no. 1, pp. 43–49, May 2026, doi: 10.53842/juki.v8i1.2319.

[6] A. O. K. Adi, F. P. Gusti, and F. Wijaya, “Analisis Sentimen Ulasan Pengguna Aplikasi Mobile Legends Pada Google Playstore Menggunakan Naïve Bayes,” in Prosiding Seminar Nasional Teknologi dan Sains, Kediri, Indonesia, 2025, pp. 641–646, doi: 10.29407/avw8b190.

[7] A. P. Zai and S. Saleh, “Perbandingan Naive Bayes Dan Support Vector Machine Untuk Analisis Sentimen Pengguna Jobstreet,” IDEALIS, vol. 9, no. 1, pp. 30–38, Jan. 2026, doi: 10.36080/idealis.v9i1.3663.

[8] Handoko, D. Ramadhansyah, A. Asrofiq, Rahmaddeni, and Y. Yunefri, “Analisis Sentimen Ulasan Penumpang Maskapai Penerbangan di Indonesia dengan Algoritma Random Forest dan KNN,” ZONAsi: Jurnal Sistem Informasi, vol. 6, no. 2, pp. 287–297, May 2024, doi: 10.31849/zn.v6i2.19177.

[9] M. Ulfa, R. H. Kusumodestoni, and A. Sucipto, “Analisis Sentimen Review Aplikasi Identitas Kependudukan Digital di Google Play Store Menggunakan KNN,” Jurnal Informatika Teknologi dan Sains, vol. 6, no. 4, pp. 1155–1165, Nov. 2024, doi: 10.51401/jinteks.v6i4.4963.

[10] M. D. Rizkiyanto, M. D. Purbolaksono, and W. Astuti, “Sentiment Analysis Classification on PLN Mobile Application Reviews using Random Forest Method and TF-IDF Feature Extraction,” INTEK Jurnal Penelitian, vol. 11, no. 1, pp. 37–43, Apr. 2024, doi: 10.31963/intek.v11i1.4774.

[11] J. Kalyzta, M. A. Willdan, S. Halfiani, and Indra, “Penerapan Analisis Sentimen Ujaran Kebencian Terhadap Vaksinasi Covid-19 pada Tweet Berbahasa Indonesia Menggunakan Algoritme K-Nearest Neighbor,” IDEALIS, vol. 5, no. 2, pp. 87–97, Jul. 2022, doi: 10.36080/idealis.v5i2.2959.

[12] R. Maulana, A. Voutama, and T. Ridwan, “Analisis Sentimen Ulasan Aplikasi MyPertamina Pada Google Play Store Menggunakan Algoritma NBC,” Jurnal Teknologi Terpadu, vol. 9, no. 1, pp. 42–48, Jul. 2023, doi: 10.54914/jtt.v9i1.609.

[13] A. B. Muzayyanah, R. E. Pawening, and Z. Arifin, “Analisis Sentimen Pada Ulasan Aplikasi Ehadrah Di Google Playstore Menggunakan Support Vector Machine,” IDEALIS, vol. 7, no. 2, pp. 258–266, Jul. 2024, doi: 10.36080/idealis.v7i2.3250.

[14] R. Y. Hayuningtyas and R. Sari, “Analisis Sentimen Terhadap Pengguna Aplikasi Instagram di Google Play Store Menggunakan Support Vector Machine,” Journal of Accounting Information System, vol. 5, no. 1, pp. 33–43, Jun. 2025, doi: 10.31294/jais.v5i01.8823.

[15] M. R. F. Rahmatullah, P. N. Andono, Affandy, and M. A. Soeleman, “Improving Random Forest Performance for Sentiment Analysis on Unbalanced Data Using SMOTE and BoW Integration: PLN Mobile Application Case Study,” Scientific Journal of Informatics, vol. 12, no. 1, pp. 1–10, Apr. 2025, doi: 10.15294/sji.v12i1.19295.

[16] M. Fahrezi, Y. B. Pratama, and A. Pramudiyantoro, “Analisis Sentimen Debat Publik Pilpres 2024 Menggunakan Metode Algoritma LSTM dan IndoBERT Pada Platform Youtube,” JPIM: Jurnal Penelitian Ilmiah Multidisipliner, vol. 2, no. 3, pp. 1936–1961, Oct. 2025.

[17] A. Wijaya, M. A. Dwiyanto, Z. Muttaqin, and M. A. F. Haq, “Sentiment Analysis of Netflix Review on Goggle Play with Machine Learning,” Jurnal Kecerdasan Buatan, Komputasi dan Teknologi Informasi, vol. 6, no. 1, pp. 59–66, Jun. 2025, doi: 10.33650/coreai.v6i1.11731.

[18] A. I. Kamil, O. N. Pratiwi, and D. Witarsyah, “Analisis Sentimen dan Pemodelan Topik terhadap Aplikasi Pembelajaran Online pada Platform Google Play,” JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika), vol. 10, no. 2, pp. 836–849, Mar. 2025, doi: 10.29100/jipi.v10i2.6023.

[19] M. Z. Siregar, A. M. Elhanafi, and D. Irwan, “Analisis Sentimen Terhadap Ulasan Aplikasi Media Sosial Di Google Play Menggunakan Algoritma Naive Bayes,” Jurnal Mahasiswa Teknik Informatika, vol. 9, no. 2, pp. 3373–3381, Apr. 2025, doi: 10.36040/jati.v9i2.12841.

[20] I. Amal and Jayanta, “Perbandingan Pelabelan Otomatis Dan Manual Untuk Analisis Sentimen Terhadap Kenaikan Harga BBM Pertamina Pada Twitter Menggunakan Algoritma Support Vector Machine,” in Seminar Nasional Mahasiswa Ilmu Komputer dan Aplikasinya (SENAMIKA), Jakarta, Indonesia, Aug. 2023, pp. 473–487.

[21] J. Pardede and D. Darmawan, “Perbandingan Algoritma Stemming Porter, Sastrawi, Idris, dan Arifin & Setiono pada Dokumen Teks Bahasa Indonesia,” Jurnal Teknologi Informasi dan Ilmu Komputer (JTIIK), vol. 12, no. 1, pp. 69–76, Feb. 2025, doi: 10.25126/jtiik.2025128860.

[22] K. P. Harmandini and K. Muslim, “Analysis of TF-IDF and TF-RF Feature Extraction on Product Review Sentiment,” Sinkron : Jurnal dan Penelitian Teknik Informatika, vol. 8, no. 2, pp. 929–937, Mar. 2024, doi: 10.33395/v8i2.13376.

[23] A. Ichwani, R. I. Kesuma, A. Setiawan, E. I. Wicaksono, and R. Hanifah, “Preventing Data Leakage in Classification via Integrated Machine Learning Pipelines: Preprocessing, Feature Transformation, and Hyperparameter Tuning,” Jurnal Teknik Informatika (JUTIF), vol. 7, no. 1, pp. 391–410, Feb. 2026, doi: 10.52436/1.jutif.2026.7.1.5490.

[24] L. Hakim, A. Sobri, L. Sunardi, and D. Nurdiansyah, “Prediksi penyakit jantung berbasis mesin learning dengan menggunakan metode k-nn,” Jurnal Digital Teknologi Informasi, vol. 7, no. 2, pp. 14–20, Feb. 2025, doi: 10.32502/digital.v7i2.9429.