Big Data Processing with Neural Networks on RESTful API for Product Recommendation Using Python
Abstract
The exponential growth of e-commerce data has created an urgent need for efficient and scalable systems that provide personalized product recommendations. This study addresses that challenge by integrating big data processing with neural networks and delivering recommendations via RESTful APIs. The primary objective is to develop a system capable of handling large datasets and providing real-time recommendations to enhance user engagement.
The methodology involves using Apache Spark for distributed big data processing and feature engineering, followed by the implementation of neural networks in Python using TensorFlow to generate recommendations. The system integrates the model with a RESTful API to support seamless interaction with external applications. Extensive testing was conducted on a dataset containing over a million user-item interactions to evaluate performance and scalability.
The results show that the proposed system achieves better recommendation accuracy compared to traditional machine learning approaches. It processes high-dimensional data efficiently and maintains latency below 200 milliseconds per API request, making it suitable for real-time applications.
The novelty of this research lies in the end-to-end design that combines a big data framework with neural networks and RESTful APIs for practical implementation. This research provides a scalable and adaptive solution for e-commerce platforms and serves as a foundation for the advancement of real-time recommendation systems in the future.
Keywords
Full Text:
PDFReferences
J. Su, T. Liu, and Z. Chen, “Collaborative Filtering in Personalized Recommendations,” J. Data Sci., vol. 18, no. 3, pp. 245–257, 2020.
A. Kumar, P. Gupta, and R. Singh, “Content-Based Recommendation for E-commerce Platforms,” IEEE Trans. Big Data, vol. 7, no. 4, pp. 632–645, 2019.
X. Li and Y. Zhang, “Enhancing Recommendation Systems Using Traditional Machine Learning Approaches,” Int. J. Mach. Learn. Appl., vol. 5, no. 2, pp. 78–92, 2018.
W. Cheng, Y. Sun, and F. Zhao, “Leveraging Convolutional Neural Networks for Product Recommendations,” ACM Trans. Intell. Syst. Technol., vol. 12, no. 6, pp. 1–20, 2021.
H. Wang, L. Xu, and M. Yu, “Recurrent Neural Networks in Real-Time Recommendation
Systems,” in Proceedings of the IEEE International Conference on Big Data, 2020, vol. 45, no. 8,
pp. 789–800.
P. Zhang, X. Zhao, and Y. Li, “Distributed Big Data Processing with Apache Spark,” Big Data Res., vol. 9, no. 3, pp. 15–25, 2021.
K. Patel, R. Desai, and N. Shah, “Feature Engineering in Recommendation Systems Using Machine Learning,” Data Eng. J., vol. 4, no. 1, pp. 112–129, 2019.
I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. MIT Press, 2016.
K. Lee, J. Park, and H. Kim, “Overcoming Overfitting in Deep Neural Networks for Big Data,”
AI Data Sci. Rev., vol. 3, no. 5, pp. 58–70, 2020.
J. Miller, “Building Scalable RESTful APIs for Recommendation Systems,” J. Softw. Archit., vol. 8, no. 2, pp. 102–118, 2019.
D. Singh, V. Kumar, and M. Gupta, “End-to-End Integration of Big Data and Deep Learning for E-commerce Recommendations,” in Proceedings of the International Conference on Big Data Analytics, 2022, vol. 20, no. 7, pp. 231–242.
A. Rahman and S. Jamil, “Optimizing Data Pipeline for Integration of Big Data and Neural Networks,” Int. J. Data Sci. Anal., vol. 12, no. 4, pp. 198–210, 2021.
T. Huang, C. Lin, and S. Feng, “Addressing Cold-Start Problems in Recommendation Systems Using Transfer Learning,” J. Artif. Intell. Res., vol. 12, no. 4, pp. 50–67, 2020.
DOI: http://dx.doi.org/10.24014/coreit.v11i1.34704
Refbacks
- There are currently no refbacks.
 | |  |
| Jurnal CoreIT by http://ejournal.uin-suska.ac.id/index.php/coreit/ is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. | ||