Sentiment Analysis of Expedition Customer Satisfaction using BiGRU and BiLSTM

Salsabila Zahirah Pranida, Arrie Kurniawardhani

Abstract


The occurrence of a pandemic caused behavioral changes that occurred in Indonesian society, especially in increasing interest in online purchases. The increased purchases of goods increased the volume of four expeditions, namely: JNE, JNT Express, Sicepat, and Anteraja. To find out the customer satisfaction of the users of the four expeditions automatically, sentiment analysis was conducted based on the thousand tweet data from the opinions of expedition users in three-class categories, which are positive, negative, and neutral. Two deep learning methods were used to analyze the sentiment of expedition customer satisfaction: BiGRU and BiLSTM. The activities conducted during the sentiment analysis were crawling, preprocessing, data labeling, modeling, and evaluation. The performance evaluation results of the two methods use an accuracy matrix over 1,217 test data. The BiGRU method produces an accuracy performance of 71.5% and the BiLSTM method produces an accuracy performance of 66.5%.


Keywords


Sentiment Analysis; BiGRU; BiLSTM

Full Text:

PDF

References


A. D. Darmawan, “PPKM Darurat Mampu Tekan Penyebaran Covid-19 di Jakarta,” Jul. 21, 2021. https://databoks.katadata.co.id/datapublish/2021/07/21/ppkm-darurat-mampu-tekan-penyebaran-covid-19-di-jakarta (accessed Apr. 14, 2022).

S. Kemp, “Digital 2021: the latest insights into the ‘state of digital’ - We Are Social UK,” Jan. 27, 2021. https://wearesocial.com/uk/blog/2021/01/digital-2021-the-latest-insights-into-the-state-of-digital/ (accessed Apr. 14, 2022).

R. Yati, “80 Persen Pengiriman JNE Didominasi Pelanggan e-Commerce,” Jun. 12, 2021. https://ekonomi.bisnis.com/read/20210613/98/1404786/80-persen-pengiriman-jne-didominasi-pelanggan-e-commerce (accessed Apr. 14, 2022).

Tribunnews, “J&T Express Catat Pengiriman Tertinggi Pada Harbolnas 12.12, Total Hingga 25 Juta Paket,” Dec. 16, 2021. https://www.tribunnews.com/bisnis/2021/12/16/jt-express-catat-pengiriman-tertinggi-pada-harbolnas-1212-total-hingga-25-juta-paket (accessed Apr. 14, 2022).

E. Catriana, “SiCepat Ekspres Catatkan Pengiriman Paket Lebih dari 2,8 Juta Per Hari Selama 2021,” Dec. 21, 2021. https://money.kompas.com/read/2021/12/21/153000126/sicepat-ekspres-catatkan-pengiriman-paket-lebih-dari-28-juta-per-hari-selama (accessed Apr. 14, 2022).

K. Safitri, “Jelang Akhir Tahun, Pengiriman Harian Anteraja Naik Signifikan,” 2021. https://money.kompas.com/read/2020/12/30/161845026/jelang-akhir-tahun-pengiriman-harian-anteraja-naik-signifikan (accessed Mar. 10, 2022).

S. Samsir, A. Ambiyar, U. Verawardina, F. Edi, and R. Watrianthos, “Analisis Sentimen Pembelajaran Daring Pada Twitter di Masa Pandemi COVID-19 Menggunakan Metode Naïve Bayes,” stmik-budidarma.ac.id, vol. 5, no. 1, pp. 157–163, 2021, doi: 10.30865/mib.v5i1.2604.

D. Ramadhan and E. B. Setiawan, “Analisis Sentimen Program Acara di SCTV pada Twitter Menggunakan Metode Naive Bayes dan Support Vector Machine,” … .telkomuniversity.ac.id, vol. 6, no. 2, pp. 9736–9743, 2019, [Online]. Available: https://openlibrarypublications.telkomuniversity.ac.id/index.php/engineering/article/view/10708

N. Ika, P. Kalingara, O. N. Pratiwi, and H. D. Anggana, “Analisis Sentimen Review Customer Terhadap Layanan Ekspedisi Jne Dan J & T Express Menggunakan Metode Naïve Bayes Sentiment Analysis Review Customer of Jne and J & T Express Expedition Services Using Naïve Bayes Method,” vol. 8, no. 5, pp. 9035–9048, 2021.

F. Prasetiawan, S. Widiyanesti, and T. Widarmanti, “Analisis Sentimen Mengenai Kualitas Layanan Jasa Ekspedisi Barang Sicepat Di Media Sosial Twitter Sentiment Analysis Regarding Quality of Sicepat Expedition Services On Twitter Social Media,” vol. 9, no. 2, pp. 147–160, 2022.

W. Ali, Y. Yang, X. Qiu, Y. Ke, and Y. Wang, “Aspect-Level Sentiment Analysis Based on Bidirectional-GRU in SIoT,” IEEE Access, vol. 9, pp. 69938–69950, 2021, doi: 10.1109/ACCESS.2021.3078114.

Y. Han, M. Liu, and W. Jing, “Aspect-Level Drug Reviews Sentiment Analysis Based on Double BiGRU and Knowledge Transfer,” IEEE Access, vol. 8, pp. 21314–21325, 2020, doi: 10.1109/ACCESS.2020.2969473.

G. Xu, Y. Meng, X. Qiu, Z. Yu, and X. Wu, “Sentiment analysis of comment texts based on BiLSTM,” IEEE Access, vol. 7, pp. 51522–51532, 2019, doi: 10.1109/ACCESS.2019.2909919.

P. Chandrasekar and K. Qian, “The Impact of Data Preprocessing on the Performance of a Naïve Bayes Classifier,” Proc. - Int. Comput. Softw. Appl. Conf., vol. 2, pp. 618–619, Aug. 2016, doi: 10.1109/COMPSAC.2016.205.

Ramaprakoso, “Analisis Sentimen,” 2019. https://github.com/ramaprakoso/analisis-sentimen (accessed Mar. 25, 2022).

M. R. Raza, W. Hussain, and J. M. Merigo, “Cloud Sentiment Accuracy Comparison using RNN, LSTM and GRU,” Proc. - 2021 Innov. Intell. Syst. Appl. Conf. ASYU 2021, 2021, doi: 10.1109/ASYU52992.2021.9599044.

G. Lample, M. Ballesteros, S. Subramanian, K. Kawakami, and C. Dyer, “Neural Architectures for Named Entity Recognition”, Accessed: Mar. 21, 2022. [Online]. Available: https://arxiv.org/pdf/1603.01360.pdf

M. Zulqarnain, R. Ghazali, M. G. Ghouse, and M. F. Mushtaq, “Efficient processing of GRU based on word embedding for text classification,” Int. J. Informatics Vis., vol. 3, no. 4, pp. 377–383, 2019, doi: 10.30630/JOIV.3.4.289.




DOI: http://dx.doi.org/10.24014/ijaidm.v5i1.17361

Refbacks

  • There are currently no refbacks.


Office and Secretariat:

Big Data Research Centre
Puzzle Research Data Technology (Predatech)
Laboratory Building 1st Floor of Faculty of Science and Technology
UIN Sultan Syarif Kasim Riau

Jl. HR. Soebrantas KM. 18.5 No. 155 Pekanbaru Riau – 28293
Website: http://predatech.uin-suska.ac.id/ijaidm
Email: ijaidm@uin-suska.ac.id
e-Journal: http://ejournal.uin-suska.ac.id/index.php/ijaidm
Phone: 085275359942

Click Here for Information


Journal Indexing:

Google Scholar | ROAD | PKP Index | BASE | ESJI | General Impact Factor | Garuda | Moraref | One Search | Cite Factor | Crossref | WorldCat | Neliti  | SINTA | Dimensions | ICI Index Copernicus 

IJAIDM Stats