Performance Measurement Of Machine Learning (Support Vector Machine, K-Nearest Neighbors, And Naive Bayes) In Crypto Wallet Applications

Fikri Faisal Hibatullah; Cecep Warman

doi:10.55227/ijhet.v3i5.254

Authors

Fikri Faisal Hibatullah Information System Faculty of Computer Engineering and Design Nusa Putra University
Cecep Warman Information System Faculty of Computer Engineering and Design Nusa Putra University

DOI:

https://doi.org/10.55227/ijhet.v3i5.254

Abstract

This study aims to compare the performance of three classification algorithms, namely Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Naïve Bayes Classifier (NBC) in analyzing user review sentiment on crypto wallet applications available on the Google Play Store . The dataset used includes 1,500 reviews from three popular crypto wallet apps, namely Trust Wallet, MetaMask , and Bitget Wallet. Each review is grouped into three sentiment categories: positive, negative, and neutral. The results of the analysis show that Bitget Wallet got the most positive reviews, while MetaMask and Trust Wallet tended to get less favorable reviews. The study evaluated the performance of each algorithm based on several performance metrics, including accuracy, precision, recall, and F1 score. The results obtained show that the SVM algorithm provides the best performance with an accuracy of 90.5%, followed by KNN with an accuracy of 85.3%, and NBC with an accuracy of 82.1%. In addition, SVM also excels in other metrics, such as precision and recall, showing that SVM is more effective at classifying user review sentiment than the other two algorithms. Based on these results, it can be concluded that SVM is the most suitable algorithm for sentiment analysis in crypto wallet applications, which can provide deeper insights into user perceptions of these applications. This research makes an important contribution to the application of machine learning algorithms for sentiment analysis in the financial technology sector, especially for crypto wallet applications.

Downloads

Download data is not yet available.

References

Ahmadi, MI, F. Apriani, M. Kurniasari, S. Handayani, and D. Gustian, “Sentiment Analysis Online Shop on the Play Store Using Method Support Vector Machine (Svm,” Semin. Nas. …, vol. 2020, no. Semnasif, pp. 196–203, 2020, Online . Available: http://jurnal.upnyk.ac.id/index.php/semnasif/article/view/4101

Adhar, MN, Y. Prayudi, and E. Ramadhani, “Analysis of Digital Artifacts of Tokocrypto Cryptocurrency Wallet Application on Android,” JIIP - J. Ilm. Ilmu Pendidik., vol. 6, no. 5, pp. 3552–3559, 2023, doi: 10.54371/jiip.v6i5.2024.

Cholil, SR, T. Handayani, R. Prathivi, and T. Ardianita, “Implementation of K-Nearest Neighbor (KNN) Classification Algorithm for Scholarship Recipient Selection Classification,” IJCIT (Indonesian J. Comput. Inf. Technol., vol. 6, no. 2, pp. 118–127, 2021, doi: 10.31294/ijcit.v6i2.10438.

Deolika, A, K. Kusrini, and ET Luthfi, “Word Weighting Analysis in Text Mining Classification,” J. Teknol. Inf., vol. 3, no. 2, p. 179, 2019, doi: 10.36294/jurti.v3i2.1077.

Giovani, AP, A. Ardiansyah, T. Haryanti, L. Kurniawati, and W. Gata, “Sentiment Analysis of Ruang Guru Application on Twitter Using Classification Algorithm,” J. Teknoinfo, vol. 14, no. 2, p. 115, 2020, doi: 10.33365/jti.v14i2.679.

Hasani, MN, and Abstract:, “Jurnal ilmiah ekonomi bisnis,” Ilm. Ekon. Bisnis, vol. 8, no. 2, pp. 209–220, 2022, Online . Available: file:///C:/Users/acer/Downloads/764-Article Text-2220-1-10-20220705 (1).pdf

Idris, ISK, YA Mustofa, and IA Salihi, “Sentiment Analysis of Shopee Application Usage Using Support Vector Machine (SVM) Algorithm,” Jambura J. Electr. Electron. Eng., vol. 5, no. 1, pp. 32–35, 2023, doi: 10.37905/jjeee.v5i1.16830.

Miftahusalam, A, H. Pratiwi, and I. Slamet, “Comparison of Random Forest and Naive Bayes Methods in Sentiment Analysis of BCA Mobile Application Reviews,” SIPTEK Semin. Nas. Inov. and Pengemb. Teknol., vol. 1, no. 1, 2023, Online . Available: https://proceeding.unesa.ac.id/index.php/siptek/article/view/184.

Pussung, SS, and AW Utami, “Design and Construction of a Web-Based Crypto Tracking Application ‘Crypto Wallet’,” Jeisbi, vol. 03, no. 04, pp. 20–28, 2022, Online . Available: https://ejournal.unesa.ac.id/index.php/JEISBI/article/view/47750.

Siti Aisah, I, B. Irawan, and T. Suprapti, “Support Vector Machine (SVM) Algorithm for Sentiment Analysis of Digital Quran Application Reviews,” JATI (Jurnal Mhs. Tek. Inform., vol. 7, no. 6, pp. 3759–3765, 2024, doi: 10.36040/jati.v7i6.8263.

Tinaliah, T, and T. Elizabeth, “Sentiment Analysis of PrimaKu Application Reviews Using the Support Vector Machine Method,” JATISI (Jurnal of Information Technology and Information Systems), vol. 9, no. 4, pp. 3436–3442, 2022, doi: 10.35957/jatisi.v9i4.3586.

Tjikdaphia, NBB, and S. Sulastri, “Comparison of Nbc, Svm, Knn Classification Results in Sentiment Analysis of Mobile Jkn,” JURTEKSI (Jurnal Teknol. dan Sist. Informasi), vol. 9, no. 4, pp. 665–672, 2023, doi: 10.33330/jurteksi.v9i4.2539.

Watmah, S, S. Suryanto, and M. Martias, “Comparison of K-NN, Support Vector Machine and Random Forest Methods on Shopee E-Commerce,” INSANtek, vol. 2, no. 1, pp. 15–21, 2021, doi: 10.31294/instk.v2i1.419.

Wulandari, E, “CLASSIFICATION OF LUNG CANCER USING NAIVE BAYES METHOD,” Int. Res. Big-Data Comput. Technol. I-Robot, vol. 6, no. 2, 2022, doi: 10.53514/ir.v6i2.325.

Yunizar, A, T. Rismawan, and DM Midyanti, “APPLICATION OF RECURRENT NEURAL NETWORK MODEL GATED RECURRENT UNIT METHOD FOR CRYPTOCURRENCY PRICE PREDICTION,” Coding J. Comput. and Apl., vol. 11, no. 1, p. 32, May 2023, doi: 10.26418/coding.v11i1.58073.