ADDITIONAL MENU
Hybrid Machine Learning Techniques for Comparative Opinion Mining
Abstract
Comparative opinion mining has lately gained traction among individuals and businesses due to its growing range of applications in brand reputation monitoring and consumer decision making among others. Past research in sub-field of opinion mining have mostly explored single-entity opinion mining models and the mining of comparative sentences suing single classifiers. Most of these studies relied on a limited number of comparative opinion labels and datasets while applying the techniques in limited domains. Consequently, the reported performances of the techniques might not be optimal in some cases like working with big data. In this study, however, we developed four hybrid machine learning techniques, with which we performed multi-class based comparative opinion mining using three datasets from different domains. From our results, the best-performing hybrid machine learning technique for comparative opinion mining using a multi-layer perceptron as the base estimator was the Multilayer Perceptron + Random Forest (MLP + RF). This technique had an average accuracy of 93.0% and an F1-score of 93.0%. These results show that our hybrid machine learning techniques could reliably be used for comparative opinion mining to support business needs like brand reputation monitoring.
Keywords
Machine Learning; Machine Learning Techniques; Comparative Opinion Mining; Hybrid Machine Learning Techniques; Deep Learning Techniques
References
B. Liu, Sentiment analysis and opinion mining. Cham, Switzerland: Springer, 2012.
K. D. Varathan, A. Giachanou, and F. Crestani, “Comparative opinion mining: A review,” Journal of the Association for Information Science and Technology, vol. 68, no. 4, pp. 811–829, Apr. 2017, doi: 10.1002/asi.23716.
M. M. Eldefrawi, D. S. Elzanfaly, M. S. Farhan, and A. S. Eldin, “Sentiment analysis of Arabic comparative opinions,” SN Appl. Sci., vol. 1, no. 5, p. 411, May 2019, doi: 10.1007/s42452-019-0402-y.
Y. Li, B. Jia, Y. Guo, and X. Chen, “Mining User Reviews for Mobile App Comparisons,” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 1, no. 3, pp. 1–15, Sep. 2017, doi: 10.1145/3130935.
S. Li et al., “Product comparison using comparative relations,” in Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, Beijing China: ACM, Jul. 2011, pp. 1151–1152. doi: 10.1145/2009916.2010094.
K. Xu, S. S. Liao, J. Li, and Y. Song, “Mining comparative opinions from customer reviews for Competitive Intelligence,” Decision Support Systems, vol. 50, no. 4, pp. 743–754, Mar. 2011, doi: 10.1016/j.dss.2010.08.021.
R. Feldman, M. Fresko, J. Goldenberg, O. Netzer, and L. Ungar, “Extracting Product Comparisons from Discussion Boards,” in Seventh IEEE International Conference on Data Mining (ICDM 2007), Omaha, NE: IEEE, Oct. 2007, pp. 469–474. doi: 10.1109/ICDM.2007.27.
T. Kurashima, K. Bessho, H. Toda, T. Uchiyama, and R. Kataoka, “Ranking Entities Using Comparative Relations,” in Database and Expert Systems Applications, S. S. Bhowmick, J. Küng, and R. Wagner, Eds., in Lecture Notes in Computer Science, vol. 5181. Berlin, Heidelberg: Springer Berlin Heidelberg, 2008, pp. 124–133. doi: 10.1007/978-3-540-85654-2_15.
J. Sun, C. Long, X. Zhu, and M. Huang, “Mining Reviews for Product Comparison and Recommendation,” Polibits, vol. 39, pp. 33–40, Jun. 2009, doi: 10.17562/PB-39-5.
U. Younis, M. Z. Asghar, A. Khan, A. Khan, J. Iqbal, and N. Jillani, “Applying Machine Learning Techniques for Performing Comparative Opinion Mining,” Open Computer Science, vol. 10, no. 1, pp. 461–477, Dec. 2020, doi: 10.1515/comp-2020-0148.
B. Pang and L. Lee, “Opinion Mining and Sentiment Analysis,” FNT in Information Retrieval, vol. 2, no. 1–2, pp. 1–135, 2008, doi: 10.1561/1500000011.
M. Sun, X. Huang, H. Ji, Z. Liu, and Y. Liu, Eds., Chinese computational linguistics: 18th China National Conference, CCL 2019, Kunming, China, October 18-20, 2019: proceedings. in Lecture notes in computer science Lecture notes in artificial intelligence, no. 11856. Cham, Switzerland: Springer, 2019.
H. Wang, Y. Lu, and C. Zhai, “Latent aspect rating analysis without aspect keyword supervision,” in Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, San Diego California USA: ACM, Aug. 2011, pp. 618–626. doi: 10.1145/2020408.2020505.
A. U. R. Khan, M. Khan, and M. B. Khan, “Naïve Multi-label Classification of YouTube Comments Using Comparative Opinion Mining,” Procedia Computer Science, vol. 82, pp. 57–64, 2016, doi: 10.1016/j.procs.2016.04.009.
S. Banihashemi, G. Ding, and J. Wang, “Developing a Hybrid Model of Prediction and Classification Algorithms for Building Energy Consumption,” Energy Procedia, vol. 110, pp. 371–376, Mar. 2017, doi: 10.1016/j.egypro.2017.03.155.
A. Ligthart, C. Catal, and B. Tekinerdogan, “Systematic reviews in sentiment analysis: a tertiary study,” Artif Intell Rev, vol. 54, no. 7, pp. 4997–5053, Oct. 2021, doi: 10.1007/s10462-021-09973-3.
S. Yildirim, “Comparing Deep Neural Networks to Traditional Models for Sentiment Analysis in Turkish Language,” in Deep Learning-Based Approaches for Sentiment Analysis, B. Agarwal, R. Nayak, N. Mittal, and S. Patnaik, Eds., in Algorithms for Intelligent Systems. Singapore: Springer Singapore, 2020, pp. 311–319. doi: 10.1007/978-981-15-1216-2_12.
H. Lu, L. Ehwerhemuepha, and C. Rakovski, “A comparative study on deep learning models for text classification of unstructured medical notes with various levels of class imbalance,” BMC Med Res Methodol, vol. 22, no. 1, p. 181, Dec. 2022, doi: 10.1186/s12874-022-01665-y.
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proceedings of the 2019 Conference of the North, Minneapolis, Minnesota: Association for Computational Linguistics, 2019, pp. 4171–4186. doi: 10.18653/v1/N19-1423.
A. Addiga and S. Bagui, “Sentiment Analysis on Twitter Data Using Term Frequency-Inverse Document Frequency,” JCC, vol. 10, no. 08, pp. 117–128, 2022, doi: 10.4236/jcc.2022.108008.
J. Yan, “Text Mining with R: A Tidy Approach, by Julia Silge and David Robinson. Sebastopol, CA: O’Reilly Media, 2017. ISBN 978-1-491-98165-8. XI + 184 pages.,” Nat. Lang. Eng., vol. 28, no. 1, pp. 137–139, Jan. 2022, doi: 10.1017/S1351324920000649.
J. Jin, P. Ji, and R. Gu, “Identifying comparative customer requirements from product online reviews for competitor analysis,” Engineering Applications of Artificial Intelligence, vol. 49, pp. 61–73, Mar. 2016, doi: 10.1016/j.engappai.2015.12.005.
S. Rana and A. Singh, “Comparative analysis of sentiment orientation using SVM and Naive Bayes techniques,” in 2016 2nd International Conference on Next Generation Computing Technologies (NGCT), Dehradun, India: IEEE, Oct. 2016, pp. 106–111. doi: 10.1109/NGCT.2016.7877399.
H. M. Ismail, S. Harous, and B. Belkhouche, “A Comparative Analysis of Machine Learning Classifiers for Twitter Sentiment Analysis,” RCS, vol. 110, no. 1, pp. 71–83, Dec. 2016, doi: 10.13053/rcs-110-1-6.
R. Joshi and R. Tekchandani, “Comparative analysis of Twitter data using supervised classifiers,” in 2016 International Conference on Inventive Computation Technologies (ICICT), Coimbatore, India: IEEE, Aug. 2016, pp. 1–6. doi: 10.1109/INVENTIVE.2016.7830089.
A. Ejaz, Z. Turabee, M. Rahim, and S. Khoja, “Opinion mining approaches on Amazon product reviews: A comparative study,” in 2017 International Conference on Information and Communication Technologies (ICICT), Karachi: IEEE, Dec. 2017, pp. 173–179. doi: 10.1109/ICICT.2017.8320185.
L. Zhang, S. Wang, and B. Liu, “Deep learning for sentiment analysis: A survey,” WIREs Data Mining Knowl Discov, vol. 8, no. 4, Jul. 2018, doi: 10.1002/widm.1253.
K. Abu Kwaik, M. Saad, S. Chatzikyriakidis, and S. Dobnik, “LSTM-CNN Deep Learning Model for Sentiment Analysis of Dialectal Arabic,” in Arabic Language Processing: From Theory to Practice, K. Smaïli, Ed., in Communications in Computer and Information Science, vol. 1108. Cham: Springer International Publishing, 2019, pp. 108–121. doi: 10.1007/978-3-030-32959-4_8.
N. Al-Twairesh, H. Al-Khalifa, and A. Al-Salman, “Subjectivity and sentiment analysis of Arabic: Trends and challenges,” in 2014 IEEE/ACS 11th International Conference on Computer Systems and Applications (AICCSA), Doha, Qatar: IEEE, Nov. 2014, pp. 148–155. doi: 10.1109/AICCSA.2014.7073192.
M. Tkachenko and H. W. Lauw, “Generative Modeling of Entity Comparisons in Text,” in Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, Shanghai China: ACM, Nov. 2014, pp. 859–868. doi: 10.1145/2661829.2662016.
X. Fan, C.-H. Lung, and S. A. Ajila, “Using Hybrid and Diversity-Based Adaptive Ensemble Method for Binary Classification,” IJIS, vol. 08, no. 03, pp. 43–74, 2018, doi: 10.4236/ijis.2018.83003.
J. J. Salazar, L. Garland, J. Ochoa, and M. J. Pyrcz, “Fair train-test split in machine learning: Mitigating spatial autocorrelation for improved prediction accuracy,” Journal of Petroleum Science and Engineering, vol. 209, p. 109885, Feb. 2022, doi: 10.1016/j.petrol.2021.109885.
D. Effrosynidis, G. Peikos, S. Symeonidis, and A. Arampatzis, “DUTH at SemEval-2018 Task 2: Emoji Prediction in Tweets,” in Proceedings of The 12th International Workshop on Semantic Evaluation, New Orleans, Louisiana: Association for Computational Linguistics, 2018, pp. 466–469. doi: 10.18653/v1/S18-1074.
N. I. Khairi, A. Mohamed, and N. N. Yusof, “Feature Selection Methods in Sentiment Analysis: A Review,” in Proceedings of the 3rd International Conference on Networking, Information Systems & Security, Marrakech Morocco: ACM, Mar. 2020, pp. 1–7. doi: 10.1145/3386723.3387840.
A. Sharifi and K. Alizadeh, “A Novel Classification Method Based on Multilayer Perceptron-Artificial Neural Network Technique for Diagnosis of Chronic Kidney Disease,” Ann Mil Health Sci Res, vol. 18, no. 1, May 2020, doi: 10.5812/amh.101585.
S. Diab, “Optimizing Stochastic Gradient Descent in Text Classification Based on Fine-Tuning Hyper-Parameters Approach. A Case Study on Automatic Classification of Global Terrorist Attacks,” 2019, doi: 10.48550/ARXIV.1902.06542.
M. Wankhade, A. C. S. Rao, and C. Kulkarni, “A survey on sentiment analysis methods, applications, and challenges,” Artif Intell Rev, vol. 55, no. 7, pp. 5731–5780, Oct. 2022, doi: 10.1007/s10462-022-10144-1.
C. Ferri, J. Hernández-Orallo, and R. Modroiu, “An experimental comparison of performance measures for classification,” Pattern Recognition Letters, vol. 30, no. 1, pp. 27–38, Jan. 2009, doi: 10.1016/j.patrec.2008.08.010.
D. Silva-Palacios, C. Ferri, and M. J. Ramírez-Quintana, “Improving Performance of Multiclass Classification by Inducing Class Hierarchies,” Procedia Computer Science, vol. 108, pp. 1692–1701, 2017, doi: 10.1016/j.procs.2017.05.218.
DOI: http://dx.doi.org/10.24014/ijaidm.v6i2.22644
Refbacks
- There are currently no refbacks.
Office and Secretariat:
Big Data Research Centre
Puzzle Research Data Technology (Predatech)
Laboratory Building 1st Floor of Faculty of Science and Technology
UIN Sultan Syarif Kasim Riau
Jl. HR. Soebrantas KM. 18.5 No. 155 Pekanbaru Riau – 28293
Website: http://predatech.uin-suska.ac.id/ijaidm
Email: ijaidm@uin-suska.ac.id
e-Journal: http://ejournal.uin-suska.ac.id/index.php/ijaidm
Phone: 085275359942
Journal Indexing:
Google Scholar | ROAD | PKP Index | BASE | ESJI | General Impact Factor | Garuda | Moraref | One Search | Cite Factor | Crossref | WorldCat | Neliti | SINTA | Dimensions | ICI Index Copernicus
IJAIDM Stats