An Adaptive Temporal-Concept Drift Model for Sequential Recommendation
Article Sidebar
Main Article Content
Abstract
Recently, owing to the great advances in Web 2.0 and mobile devices, various online commercial services have emerged. Recommendation systems play an important role in dealing with abundant product information from massive numbers of online e-commerce transactions. Providing an accurate recommendation at the correct time to customers can contribute to a surge in business success. In this paper, an adaptive temporal-concept drift learning-based recommendation system, ATCRec, is developed for precisely tackling the sequential recommendation problem. We embed sequences of items into the latent spaces and learn both general preferences and sequential patterns concurrently via a recurrent neural network. Specifically, ATCRec captures dynamic changes in the temporal and concept drift contexts by modifying the gate units in a traditional recurrent neural network. The proposed model provides a unified and flexible network structure to learn and reveal the opaque variation of user preferences over time. We evaluate the robustness and performance of ATCRec on two real-world datasets, and the experimental results demonstrate that ATCRec consistently outperforms existing sequential recommendation approaches on various metrics. This indicates that integrating users' temporal information and concept drift variation through time are indispensable in improving the performance of recommendation systems.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
S. Rendle, C. Freudenthaler, and L. Schmidt Thieme, Factorizing personalized Markov chains for next-basket recommendation, Proceedings of the 19th international conference on World wide web, pp.811–820, 2010.
S. Zhao, M. R. Lyu, and I. King, STEL- LAR: Spatial-Temporal Latent Ranking Model for Successive POI Recommendation, Springer Briefs in Computer Science Point-of-Interest Recommendation in Location-Based Social Net- works, pp.79–94, 2018.
B. Hidasi and A. Karatzoglou, Recurrent Neural Networks with Top-k Gains for Session based Recommendations, Proceedings of the 27th ACM International Conference on Information and Knowledge Management, pp.843–852, 2018.
Z. Yu, L. Hao, L. Yikang, W. Beidou, G. Ziyu, L. Haifeng and C. Deng, What to Do Next: Modeling User Behaviors by Time-LSTM, Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, pp.3602– 3608, 2017.
B. Sarwar, G, Karypis, J. Konstan, and J. Reidl, Item-based collaborative filtering recommendation algorithms, Proceedings of the tenth international conference on World Wide Web, pp.285– 295, 2001.
F. Ricci, L. Rokach, and B. Shapira, Introduction to Recommender Systems Handbook, Recommender Systems Handbook, pp.1–35, 2010.
Z. Zhang, Y. Liu, Z. Jin, and R. Zhang, A dynamic trust based two-layer neighbor selection scheme towards online recommender systems, Neurocomputing, pp.94–103, 2018.
J. Gupta and J. Gadge, Performance analysis of recommendation system based on collaborative filtering and demographics, International Conference on Communication, Information Computing Technology (ICCICT), pp.1–6, 2015.
P. Melville, R. J. Mooney, and R. Nagarajan, Content-boosted collaborative filtering for improved recommendations, American Association for Artificial Intelligence, pp.187–192, 2002.
Z.L. Zhao, C.D. Wang, Y. Wan, Z. Huang, and J. Lai, Pipeline Item-Based Collaborative Filtering Based on MapReduce, IEEE Fifth International Conference on Big Data and Cloud Computing, pp.9–14, 2015.
R. Mehta and K. Rana, A review on matrix factorization techniques in recommender systems, International Conference on Communication Systems, Computing and IT Applications (CSCITA), pp.269–274, 2017.
Y. Koren, R. Bell, and C. Volinsky, Matrix Factorization Techniques for Recommender Systems. Computer, IEEE Transactions on Auto- matic Control, pp.30–37, 2009.
N. Thai-Nghe, L. Drumond, T. Horva ́th, A. Krohn-Grimberghe, A. Nanopoulos, and L. Schmidt-Thieme, Factorization Techniques for Predicting Student Performance, Educational Recommender Systems and, Technologies, pp.129–153, 2012.
M. Abdi, G. Okeyo, and R. Mwangi, Matrix Factorization Techniques for Context-Aware Collaborative Filtering Recommender Systems: A Survey, Computer and Information Science, pp.2– 11, 2018.
L. Xiong, X. Chen, T. Huang, J. Schneider, and J. G. Carbonell, Temporal Collaborative Filtering with Bayesian Probabilistic Tensor Factorizatio, Proceedings of the 2010 SIAM International Conference on Data Mining, pp.211–222, 2010.
Y. Shi, M. Larson, and A. Hanjalic, Collaborative Filtering beyond the User-Item Matrix, ACM Computing Surveys, pp.1–45, 2014.
M. Jamali and M. Ester, A matrix factorization technique with trust propagation for recommendation in social networks, Proceedings of the fourth ACM conference on Recommender systems, Vol.29, pp.831–832, 2010.
D. Liang, J. Altosaar, L. Charlin, and D. M. Blei, Factorization Meets the Item Embedding, Proceedings of the 10th ACM Conference on Recommender Systems, pp.59–66, 2016.
Y. Ding and X. Li, Time weight collaborative filtering, Proceedings of the 14th ACM international conference on Information and knowledge management, pp.485–492, 2005.
Y. Koren, Collaborative filtering with temporal dynamics, Communications of the ACM, pp.89, 2010.
J. Tang and K. Wang, Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding, Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp.565–573, 2018.
Y. Lo, W. Liao, C. Chang, and Y. Lee, Temporal Matrix Factorization for Tracking Concept Drift in Individual User Preferences, IEEE Transactions on Computational Social Systems, pp.156– 168, 2018.
S. Cheng and Y. Liu, Time-Aware and Grey Incidence Theory Based User Interest Modeling for Document Recommendation, Cybernetics and Information Technologies, pp.36–52, 2015.
T. Jiang and W. Lu, Improved Slope One Algorithm Based on Time Weight, Applied Mechanics and Materials, pp.2365–2368, 2013.
Y. Cai, H. Leung, Q. Li, J. Tang, and J. Li, TyCo: Towards Typicality-based Collaborative
Filtering Recommendation, IEEE International Conference on Tools with Artificial Intelligence, pp.766–779, 2010.
F. Yu, Q. Liu, S. Wu, L. Wang, and T. Tan, A Dynamic Recurrent Model for Next Basket Recommendation, Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, pp.729– 732, 2016.
R. He, W. Kang, and J. Mcauley, Translation based Recommendation: A Scalable Method for Modeling Sequential Behavior, Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, pp.161–169, 2018.
R. He and J. Mcauley, Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation, IEEE 16th International Conference on Data Mining (ICDM), pp.300–311, 2016.
X. Rong, word2vec Parameter Learning Explained, arXiv, 2016.
F. Harper and J.A. Konstan, The MovieLens Datasets, ACM Transactions on Interactive Intelligent Systems, pp.1–19, 2015.
V. Akila and G. Zayaraz, A brief survey on concept drift, Advances in Intelligent Systems and Computing, pp. 293–302, 2014.
I. zliobaite, M. Pechenizkiy, and J. Gama, An overview of concept drift applications, Studies in Big Data, pp. 91–114, 2015.
M. Roveri, Learning discrete-time markov chains under concept drift, IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 9, pp. 2570–2582, 2019.
T. Neammanee and S. Maneeroj, Time-Aware recommendation based on user Preference driven, 2018 IEEE 42nd Annual Computer Soft- ware and Applications Conference (COMPSAC), 2018.
R. Xu, Y. Cheng, Z. Liu, Y. Xie, and Y. Yang, Improved long short-term memory based anomaly detection with concept drift adaptive method for supporting iot services”, Future Generation Computer Systems, vol. 112, pp. 228–242, 2020.
V. M. dos Santos, R. F. de Mello, T. Nogueira, and R. A. Rios, Quantifying temporal novelty in social networks Using TIME-VARYING graphs and Concept Drift detection, Intelligent Systems, pp. 650–664, 2020.
Y. Zhu, H. Li, Y. Liao, B. Wang, Z. Guan, H. Liu, and D. Cai, What to do Next: Modeling user behaviors by time-lstm, Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, 2017.
J. Tang and K. Wang, Personalized top-n Sequential recommendation via CONVOLUTIONAL Sequence Embedding, Proceedings ofthe Eleventh ACM International Conference on Web Search and Data Mining, 2018.
W.-C. Kang and J. McAuley, Self-Attentive sequential Recommendation, 2018 IEEE International Conference on Data Mining (ICDM), 2018.
T. Silveira, M. Zhang, X. Lin, Y. Liu, and S. Ma, How good your recommender system is? A survey on evaluations in recommendation, International Journal of Machine Learning and Cybernetics, vol. 10, no. 5, pp. 813–831, 2017.