Perbandingan Kinerja IndoBERT, IndoRoBERTa dan NusaBERT dalam Analisis Sentimen Isu LGBT di Media Sosial X
DOI:
https://doi.org/10.32627/internal.v8i2.1451Keywords:
Analisis Sentimen, IndoBERT, IndoRoBERTa, LGBT, NusaBERTAbstract
The issue of lesbian, gay, bisexual, and transgender in Indonesia remain largely taboo and often provoke various public reactions, particularly on social media platforms. This phenomenon highlights the need to map public opinion through sentiment analysis. This study aims to compare the performance of three Indonesian-language transformer models IndoBERT, IndoRoBERTa, and NusaBERT in analyzing sentiment related to LGBT issues on platform X. The research methodology follows the Cross Industry Standard Process for Data Mining approach. Testing was conducted using 6,000 preprocessed and automatically labeled data points, showing that the IndoBERT model achieved the best performance with an accuracy of 90.50% and an F1-score of 56.88%. This best-performing model was then used to classify 12,804 tweets, revealing that 92.80% expressed negative sentiment, 6.71% neutral, and only 0.49% positive. These findings confirm that negative public perceptions of LGBT issues remain highly dominant in Indonesia’s digital space.
References
S. Kemp, “Digital 2024,” We Are Social. Accessed: Feb. 07, 2025. [Online]. Available: Https://Wearesocial.Com/Id/Blog/2024/01/Digital-2024/
S. Kemp, “Digital 2024: Indonesia,” Datareportal – Global Digital Insights. Accessed: Feb. 07, 2025. [Online]. Available: Https://Datareportal.Com/Reports/Digital-2024-Indonesia
M. Mustakim, M. Ridwan, And N. T. Luchia, “Implementasi Algoritma Support Vector Machine Untuk Analisis Sentimen Lgbt Di Indonesia,” Bull. Artif. Intell., Vol. 1, No. 2, Pp. 36–42, 2022, Doi: 10.62866/Buai.V1i2.31.
S. Safinah, “Dinamika Gender Dalam Kontroversi Lgbt Di Indonesia: Analisis Budaya, Agama, Dan Kebijakan,” Harakat An-Nisa J. Stud. Gend. Dan Anak, Vol. 8, No. 1, Pp. 1–10, 2024, Doi: 10.30631/81.1-10.
K. K. Verdianto, A. Ferdyanti, C. Liem, K. Nabila, And S. F. Pramono, “Analisis Kesetaraan Hak Warga Negara Kaum Lgbt Di Indonesia,” J. Huk. Dan Ham Wara Sains, Vol. 2, No. 05, Pp. 358–366, 2023, Doi: 10.58812/Jhhws.V2i05.311.
T. Oswari, M. Murniyati, T. Yusnitasari, N. Nurasiah, And S. Wijay, “Sentiment Analysis Of Indonesian Youtube Reviews About Lesbian, Guy, Bisexual And Transgender (Lgbt) Using Indobert Fine Tuning,” Lontar Komput. J. Ilm. Teknol. Inf., Vol. 15, No. 1, P. 26, 2024, Doi: 10.24843//Lkjiti.2024.V15.I01.P03.
A. Jaya, “Analisis Sentimen Pandangan Public Profesi Pns (Pegawai Negeri Sipil) Dari Twiter Menerapkan Indonesian Roberta Base Sentiment Classifier,” Indones. J. Data Sci., Vol. 4, No. 1, Pp. 38–44, 2023, Doi: 10.56705/Ijodas.V4i1.66.
N. A. R. Putri And Ardiansyah, “Analisis Sentimen Terhadap Kemajuan Kecerdasan Buatan Di Indonesia Menggunakan Bert Dan Roberta,” J. Sains Dan Inform., Vol. 9, No. 2, Pp. 136–145, 2023, Doi: 10.34128/Jsi.V9i2.649.
T. D. Purnomo And J. Sutopo, “Comparison Of Pre-Trained Bert-Based Transformer Models For Regional Language Text Sentiment Analysis In Indonesia,” Int. J. Sci. Technol., Vol. 3, No. 3, Pp. 11–21, 2024, Doi: Https://Doi.Org/10.56127/Ijst.V3i3.1739.
F. Indriani, R. A. Nugroho, M. R. Faisal, And D. Kartini, “Comparative Evaluation Of Indobert, Indobertweet, And Mbert For Multilabel Student Feedback Classification,” J. Resti, Vol. 8, No. 6, Pp. 748–757, 2024, Doi: 10.29207/Resti.V8i6.6100.
G. Z. Nabiilah, S. Y. Prasetyo, Z. N. Izdihar, And A. S. Girsang, “Bert Base Model For Toxic Comment Analysis On Indonesian Social Media,” Procedia Comput. Sci., Vol. 216, No. 2022, Pp. 714–721, 2022, Doi: 10.1016/J.Procs.2022.12.188.
W. Wongso, D. S. Setiawan, S. Limcorn, And A. Joyoadikusumo, “Nusabert: Teaching Indobert To Be Multilingual And Multicultural,” Pp. 10–26, 2024, Doi: Https://Doi.Org/10.48550/Arxiv.2403.01817.
J. W. Iskandar And Y. Nataliani, “Perbandingan Naïve Bayes, Svm, Dan K-Nn Untuk Analisis Sentimen Gadget Berbasis Aspek,” J. Resti (Rekayasa Sist. Dan Teknol. Informasi), Vol. 5, No. 6, Pp. 1120–1126, 2021, Doi: 10.29207/Resti.V5i6.3588.
S. L. Afyra Ar’bah Lailany, “Analisis Sentimen Publik Terhadap Penurunan Jumlah Pernikahan Di Indonesia Menggunakan Algoritma K-Nearest Neighbors (Knn),” J. Indones. Manaj. Inform. Dan Komun., Vol. 5, No. 3, Pp. 3043–3053, 2024, Doi: Https://Doi.Org/10.35870/Jimik.V5i3.1000.
A. Anjani, A. Chamid, And A. Murti, “Analisis Sentimen Kaum Lgbt Pada Media Sosial Twitter Menggunakan Algoritma Naïve Bayes,” Jtinfo J. Tek. Inform., Vol. 1, No. 2, Pp. 1–8, 2022, Doi: Https://Doi.Org/10.02220/Jtinfo.V1i2.259.
N. V. S. Sihombing, Yogie Oktavianus, “Prediksi Sentimen Pada Teks Media Sosial Corporate University Menggunakan Roberta,” Pros. Pitnas Widyaiswara, Vol. 1, Pp. 302–316, 2024, [Online]. Available: Https://Ejournal.Iwi.Or.Id/Ojs/Index.Php/Pitnas2024/Article/View/316
M. A. A, M. Alamsyah, And M. F. Arif, “Analisis Sentimen Twitter Tentang Pinjaman Online Di Indonesia Menggunakan Metode Random Forest,” Jutisi J. Ilm. Tek. Inform. Dan Sist. Inf., Vol. 13, No. 2, Pp. 1410–1421, 2024, Doi: 10.35889/Jutisi.V13i2.2215.
N. Smairi, H. Abadlia, H. Brahim, And W. L. Chaari, “Fine-Tune Bert Based On Machine Learning Models For Sentiment Analysis,” Procedia Comput. Sci., Vol. 246, No. C, Pp. 2390–2399, 2024, Doi: 10.1016/J.Procs.2024.09.531.
Merinda Lestandy, Abdurrahim Abdurrahim, And Lailis Syafa’ah, “Analisis Sentimen Tweet Vaksin Covid-19 Menggunakan Recurrent Neural Network Dan Naïve Bayes,” J. Resti (Rekayasa Sist. Dan Teknol. Informasi), Vol. 5, No. 4, Pp. 802–808, 2021, Doi: 10.29207/Resti.V5i4.3308.
N. L. P. M. Putu, Ahmad Zuli Amrullah, And Ismarmiaty, “Analisis Sentimen Dan Pemodelan Topik Pariwisata Lombok Menggunakan Algoritma Naive Bayes Dan Latent Dirichlet Allocation,” J. Resti (Rekayasa Sist. Dan Teknol. Informasi), Vol. 5, No. 1, Pp. 123–131, 2021, Doi: 10.29207/Resti.V5i1.2587.
B. Setiadi, E. Purwanto, And H. Permatasari, “Optimisasi Klasifikasi Sentimen Pada Review Hotel Bahasa Inggris Dengan Model Roberta Twitter,” Sintech (Science Inf. Technol. J., Vol. 7, No. 2, Pp. 70–79, 2024, Doi: 10.31598/Sintechjournal.V7i2.1547.
P. Arsi, R. Wahyudi, And R. Waluyo, “Optimasi Svm Berbasis Pso Pada Analisis Sentimen Wacana Pindah Ibu Kota Indonesia,” J. Resti (Rekayasa Sist. Dan Teknol. Informasi), Vol. 5, No. 2, Pp. 231–237, 2021, Doi: 10.29207/Resti.V5i2.2698.
A. Pratama And M. Rosyda, “Analisis Sentimen Dalam Aplikasi X Terhadap Pengungsi Rohingya Dengan Lstm,” Skanika Sist. Komput. Dan Tek. Inform., Vol. 8, No. 1, Pp. 95–105, 2025, Doi: Https://Doi.Org/10.36080/Skanika.V8i1.3329.
T. Sugihartono And R. R. C. Putra, “Penerapan Metode Support Vector Machine Dalam Classifikasi Ulasan Pengguna Aplikasi Mobile Jkn,” Skanika Sist. Komput. Dan Tek. Inform., Vol. 7, No. 2, Pp. 144–153, 2024, Doi: 10.36080/Skanika.V7i2.3193.
F. N. Salsabilla And A. Witanti, “Analisis Sentimen Akhir Masa Jabatan Presiden Jokowi Pada Media Sosial X Menggunakan Naïve Bayes,” Skanika Sist. Komput. Dan Tek. Inform., Vol. 8, No. 1, Pp. 106–115, 2025, Doi: Https://Doi.Org/10.36080/Skanika.V8i1.3331.
A. N. W. Zain, M. Muafi, And A. Tholib, “Klasifikasi Data Mining Di Tingkat Kepuasan Mahasiswa Terhadap Pelayanan Sistem Informasi Fakultas Teknik Universitas Nurul Jadid,” Skanika Sist. Komput. Dan Tek. Inform., Vol. 7, No. 2, Pp. 204–213, 2024, Doi: 10.36080/Skanika.V7i2.3200.
D. Normawati And S. A. Prayogi, “Implementasi Naïve Bayes Classifier Dan Confusion Matrix Pada Analisis Sentimen Berbasis Teks Pada Twitter,” J. Sains Komput. Inform. (J-Sakti, Vol. 5, No. 2, Pp. 697–711, 2021, Doi: Http://Dx.Doi.Org/10.30645/J-Sakti.V5i2.369.
N. Arifin, U. Enri, And N. Sulistiyowati, “Penerapan Algoritma Support Vector Machine (Svm) Dengan Tf-Idf N-Gram Untuk Text Classification,” String (Satuan Tulisan Ris. Dan Inov. Teknol., Vol. 6, No. 2, P. 129, 2021, Doi: 10.30998/String.V6i2.10133.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Dani Ramdani, Mohamad Irfan , Nur Lukman
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
