With the popularity of mobile devices in recent years, users can share their check-in behavior on social networks at any time or anywhere. This also makes it difficult for users to find the information they need. To solve the problem of information overload, many studies have proposed Point-of-Interest (POI) recommendation systems to predict POIs that users may be interested in the future; some of which analyze the POI tags, categories, geographic locations, and check-in times that users have visited to make recommendations. However, these features are too specific to precisely represent the characteristics of users and POIs. Therefore, this study proposes a POI recommendation method based on user reviews and geographic area features (PRRG) to predict the POIs that users may be interested in. The research framework is divided into two main parts: (1) review analysis and (2) POI area analysis. The review analysis extracts the topic, sentiment, and semantic features from user reviews to represent user preferences and POI features. The POI area analysis first divides the POI into areas, and then calculates the POI area weights according to the users’ movement trajectory. Finally, the weighted matrix factorization method is used to predict the ratings of POIs. The proposed method can extract various features to represent user preferences and POI features, and analyze the importance of POI area to users based on their movement patterns to enhance the recommendation accuracy. The experimental results show that the proposed method outperforms other methods and effectively improves the recommendation performance.
目錄
摘要 I
Abstract II
致謝 III
目錄 IV
圖目錄 VI
第1章 緒論 1
1.1 研究背景與動機 1
1.2 研究目的 3
1.3 研究貢獻 5
第2章 文獻探討 6
2.1 POI推薦系統 6
2.1.1 內容因素 6
2.1.2 地理因素 7
2.1.3 時間因素 8
2.1.4 以深度學習為基礎之POI推薦方法 8
2.3 深度學習 9
2.3.1 BERT模型 9
2.3.2 卷積神經網路 11
2.3.3 遞迴神經網路 11
2.4 主題模型 12
2.5 小結 13
第3章 研究方法 14
3.1 研究概述 14
3.2 主題分析 16
3.3 情感與語意分析 17
3.3.1 情感語意分析模型 17
3.3.2 建立情感語意向量 18
3.4 使用者喜好分析 19
3.5 POI分群 20
3.6 區域權重分析 21
3.6.1 使用者區域移動軌跡 21
3.6.2 區域權重分析 22
3.7 預測評分 23
第4章 實驗評估 25
4.1 資料蒐集與前處理 25
4.2 評估指標 26
4.3 實驗方法說明 27
4.4 實驗結果 28
4.4.1決定最佳主題數量 28
4.4.2 比較不同特徵對PRRG之影響 29
4.4.3比較不同的區域權重分析方法 31
4.4.4不同特徵對PRRG模型之影響 31
4.4.5 相關POI推薦方法之比較 32
第5章 結論與未來研究方向 34
5.1 結論 34
5.2 未來研究方向 35
參考文獻 36
圖目錄
圖1 POI推薦影響因素圖 6
Agrawal, S., Roy, D., & Mitra, M. (2021). Tag Embedding Based Personalized Point of Interest Recommendation System. Information Processing & Management, 58(6), 102690.
Albawi, S., Mohammed, T. A., & Al-Zawi, S. (2017). Understanding of a Convolutional Neural Network. International Conference on Engineering and Technology (ICET), Antalya, Turkey. 1-6.
Alorf, A. (2017). K-Means, Mean Shift, and Slic Clustering Algorithms: A Comparison of Performance in Color-Based Skin Segmentation [Master's Thesis, Doctoral Dissertation, University of Pittsburgh]. Electronic Theses and Dissertations.
Bahdanau, D., Cho, K., & Bengio, Y. (2015). Neural Machine Translation by Jointly Learning to Align and Translate. arXiv preprint arXiv: 1409.0473.
Baral, R., Zhu, X., Iyengar, S., & Li, T. (2018). Reel: Review Aware Explanation of Location Recommendation. Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization, 23-32.
Batmaz, Z., Yurekli, A., Bilge, A., & Kaleli, C. (2019). A Review on Deep Learning for Recommender Systems: Challenges and Remedies. Artificial Intelligence Review, 52(1), 1-37.
Bengio, Y., Simard, P., & Frasconi, P. (1994). Learning Long-Term Dependencies with Gradient Descent Is Difficult. IEEE Transactions on Neural Networks, 5(2), 157-166.
Blei, D. M., & McAuliffe, J. D. (2010). Supervised Topic Models. arXiv preprint arXiv:1003.0783.
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993-1022.
Chang, B., Park, Y., Park, D., Kim, S., & Kang, J. (2018). Content-Aware Hierarchical Point-of-Interest Embedding Model for Successive POI Recommendation. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, 3301-3307.
Chen, F., Yuan, Z., & Huang, Y. (2020). Multi-Source Data Fusion for Aspect-Level Sentiment Classification. Knowledge-Based Systems, 187, 104831.
Cheng, G., Peddinti, V., Povey, D., Manohar, V., Khudanpur, S., & Yan, Y. (2017). An Exploration of Dropout with LSTMs. Interspeech, 1586-1590.
Cho, K., Van Merriënboer, B., Bahdanau, D., & Bengio, Y. (2014). On the Properties of Neural Machine Translation: Encoder-Decoder Approaches. arXiv preprint arXiv:1409.1259.
Clark, K., Khandelwal, U., Levy, O., & Manning, C. D. (2019). What Does BERT Look At? An Analysis of BERT's Attention. arXiv preprint arXiv:1906.04341.
Comaniciu, D., & Meer, P. (2002). Mean Shift: A Robust Approach toward Feature Space Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5), 603-619.
Cui, Q., Wu, S., Huang, Y., & Wang, L. (2019). A Hierarchical Contextual Attention-Based Network for Sequential Recommendation. Neurocomputing, 358, 141-149.
Demirović, D. (2019). An Implementation of the Mean Shift Algorithm. Image Processing On Line, 9, 251-268.
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota, USA. 4171–4186.
Dumais, S. T. (2004). Latent Semantic Analysis. Annual Review of Information Science and Technology, 38(1), 188-230.
Gal, Y., & Ghahramani, Z. (2016). A Theoretically Grounded Application of Dropout in Recurrent Neural Networks. arXiv preprint arXiv: arxiv.1512.05287.
Gan, J., & Qi, Y. (2021). Selection of the Optimal Number of Topics for LDA Topic Model—Taking Patent Policy Analysis as an Example. Entropy, 23(10), 1301.
Gao, R., Li, J., Du, B., Li, X., Chang, J., Song, C., & Liu, D. (2018). Exploiting Geo-Social Correlations to Improve Pairwise Ranking for Point-of-Interest Recommendation. China Communications, 15(7), 180-201.
Hao, P.-Y., Cheang, W.-H., & Chiang, J.-H. (2019). Real-Time Event Embedding for POI Recommendation. Neurocomputing, 349, 1-11.
He, X., Zhang, H., Kan, M.-Y., & Chua, T.-S. (2016). Fast Matrix Factorization for Online Recommendation with Implicit Feedback. Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 549-558.
Hochreiter, S., & Schmidhuber, J. (1997). Long Short-Term Memory. Neural computation, 9(8), 1735-1780.
Hu, Y., Koren, Y., & Volinsky, C. (2008). Collaborative Filtering for Implicit Feedback Datasets. 2008 Eighth IEEE international conference on data mining, 263-272.
Hyndman, R. J., & Koehler, A. B. (2006). Another Look at Measures of Forecast Accuracy. International journal of forecasting, 22(4), 679-688.
Islam, M. A., Mohammad, M. M., Das, S. S. S., & Ali, M. E. (2022). A Survey on Deep Learning Based Point-of-Interest (POI) Recommendations. Neurocomputing, 472, 306-325.
Jelodar, H., Wang, Y., Yuan, C., Feng, X., Jiang, X., Li, Y., & Zhao, L. (2019). Latent Dirichlet Allocation (LDA) and Topic Modeling: Models, Applications, a Survey. Multimedia Tools and Applications, 78(11), 15169-15211.
Jiang, S., Qian, X., Shen, J., Fu, Y., & Mei, T. (2015). Author Topic Model-Based Collaborative Filtering for Personalized POI Recommendations. IEEE Transactions on Multimedia, 17(6), 907-918.
Jiao, X., Xiao, Y., Zheng, W., Wang, H., & Jin, Y. (2019). R2SIGTP: A Novel Real-Time Recommendation System with Integration of Geography and Temporal Preference for Next Point-of-Interest. The World Wide Web Conference, 3560-3563.
Jo, Y., & Oh, A. H. (2011). Aspect and Sentiment Unification Model for Online Review Analysis. Proceedings of the Fourth ACM International Conference on Web Search and Data Mining, Hong Kong, China. 815-824.
Khan, Z. Y., Niu, Z., Sandiwarno, S., & Prince, R. (2021). Deep Learning Techniques for Rating Prediction: A Survey of the State-of-the-Art. Artificial Intelligence Review, 54(1), 95-135.
Koç, C. K. (1995). Analysis of Sliding Window Techniques for Exponentiation. Computers & Mathematics with Applications, 30(10), 17-24.
Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix Factorization Techniques for Recommender Systems. Computer, 42(8), 30-37.
Labach, A., Salehinejad, H., & Valaee, S. (2019). Survey of Dropout Methods for Deep Neural Networks. arXiv preprint arXiv:1904.13310.
LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep Learning. Nature, 521(7553), 436-444.
LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., & Jackel, L. (1989). Handwritten Digit Recognition with a Back-Propagation Network. Advances in Neural Information Processing Systems, 2, 396-404.
Lee, C.-H., Lin, C.-R., & Chen, M.-S. (2001). Sliding-Window Filtering: An Efficient Algorithm for Incremental Mining. Proceedings of the tenth international conference on Information and knowledge management, 263-270.
Li, D., Gong, Z., & Zhang, D. (2018). A Common Topic Transfer Learning Model for Crossing City POI Recommendations. IEEE Transactions on Cybernetics, 49(12), 4282-4295.
Li, G., Chen, Q., Zheng, B., Yin, H., Nguyen, Q. V. H., & Zhou, X. (2020). Group-Based Recurrent Neural Networks for POI Recommendation. ACM Transactions on Data Science, 1(1), 1-18.
Li, M., Zheng, W., Xiao, Y., Zhu, K., & Huang, W. (2021). Exploring Temporal and Spatial Features for Next POI Recommendation in LBSNs. IEEE Access, 9, 35997-36007.
Lin, T.-H., Gao, C., & Li, Y. (2019). Cross: Cross-Platform Recommendation for Social E-Commerce. Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 515-524.
Liu, W., Lin, Z., Zhu, H., Wang, J., & Sangaiah, A. K. (2020). Attention-Based Adaptive Memory Network for Recommendation with Review and Rating. IEEE Access, 8, 113953-113966.
Lu, X., & Zhang, H. (2020). A Content-Aware POI Recommendation Method in Location-Based Social Networks Based on Deep CNN and Multi-Objective Immune Optimization. Journal of Internet Technology, 21(6), 1761-1772.
Lu, Y.-S., Shih, W.-Y., Gau, H.-Y., Chung, K.-C., & Huang, J.-L. (2019). On Successive Point-of-Interest Recommendation. World Wide Web, 22(3), 1151-1173.
Mnih, A., & Salakhutdinov, R. R. (2007). Probabilistic Matrix Factorization. Advances in Neural Information Processing Systems, 20.
Ozyurt, B., & Akcayol, M. A. (2021). A New Topic Modeling Based Approach for Aspect Extraction in Aspect Based Sentiment Analysis: SS-LDA. Expert Systems with Applications, 168, 114231.
Pan, R., Zhou, Y., Cao, B., Liu, N. N., Lukose, R., Scholz, M., & Yang, Q. (2008). One-Class Collaborative Filtering. 2008 Eighth IEEE International Conference on Data Mining, 502-511.
Pan, Z., Cui, L., Wu, X., Zhang, Z., Li, X., & Chen, G. (2019). Deep Potential Geo-Social Relationship Mining for Point-of-Interest Recommendation. IEEE Access, 7, 99496-99507.
Pennington, J., Socher, R., & Manning, C. D. (2014). Glove: Global Vectors for Word Representation. Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 1532-1543.
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning Representations by Back-Propagating Errors. Nature, 323(6088), 533-536.
Sang, Y., Sun, H., Li, C., & Yin, L. (2021). LSVP: A Visual Based Deep Neural Direction Learning Model for Point-of-Interest Recommendation on Sparse Check-in Data. Neurocomputing, 446, 204-210.
Saraswat, M. (2022). Leveraging Genre Classification with RNN for Book Recommendation. International Journal of Information Technology, 1-6.
Schuster, M., & Paliwal, K. K. (1997). Bidirectional Recurrent Neural Networks. IEEE Transactions on Signal Processing, 45(11), 2673-2681.
Seo, S., Huang, J., Yang, H., & Liu, Y. (2017). Representation Learning of Users and Items for Review Rating Prediction Using Attention-Based Convolutional Neural Network. International Workshop on Machine Learning Methods for Recommender Systems., University of Southern California.
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: A Simple Way to Prevent Neural Networks from Overfitting. The journal of machine learning research, 15(1), 1929-1958.
Surendiran, B. (2020). Location Based Recommender Systems (Lbrs)–a Review. International Conference on Computational Intelligence in Data Science, 320-328.
Suresh, V., Janik, P., Rezmer, J., & Leonowicz, Z. (2020). Forecasting Solar Pv Output Using Convolutional Neural Networks with a Sliding Window Algorithm. Energies, 13(3), 723.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention Is All You Need. Advances in Neural Information Processing Systems, Long Beach, CA, USA. 5998-6008.
Villegas, D. S., & Aletras, N. (2021). Point-of-Interest Type Prediction Using Text and Images. arXiv preprint arXiv:2109.00602.
Wall, M. E., Rechtsteiner, A., & Rocha, L. M. (2003). Singular Value Decomposition and Principal Component Analysis. In A Practical Approach to Microarray Data Analysis (pp. 91-109). Springer.
Wang, H., Shen, H., & Cheng, X. (2020). Modeling POI-Specific Spatial-Temporal Context for Point-of-Interest Recommendation. Advances in Knowledge Discovery and Data Mining, 12084, 130-141.
Wang, J., Yu, L.-C., Lai, K. R., & Zhang, X. (2016). Dimensional Sentiment Analysis Using a Regional CNN-LSTM Model. Proceedings of the 54th annual meeting of the association for computational linguistics (volume 2: Short papers), 225-230.
Wang, S., Wang, Y., Tang, J., Shu, K., Ranganath, S., & Liu, H. (2017). What Your Images Reveal: Exploiting Visual Contents for Point-of-Interest Recommendation. Proceedings of the 26th International Conference on World Wide Web, 391-400.
Wang, W., Chen, J., Wang, J., Chen, J., & Gong, Z. (2019). Geography-Aware Inductive Matrix Completion for Personalized Point-of-Interest Recommendation in Smart Cities. IEEE Internet of Things Journal, 7(5), 4361-4370.
Wei, Y., Wang, X., Nie, L., He, X., Hong, R., & Chua, T.-S. (2019). MMGCN: Multi-Modal Graph Convolution Network for Personalized Recommendation of Micro-Video. Proceedings of the 27th ACM International Conference on Multimedia, 1437-1445.
Willmott, C. J., & Matsuura, K. (2005). Advantages of the Mean Absolute Error (MAE) over the Root Mean Square Error (RMSE) in Assessing Average Model Performance. Climate research, 30(1), 79-82.
Wu, C.-H., Lu, C.-C., Ma, Y.-F., & Lu, R.-S. (2018). A New Forecasting Framework for Bitcoin Price with LSTM. 2018 IEEE International Conference on Data Mining Workshops (ICDMW), 168-175.
Xin, M., & Wan, C. (2021). POI Recommendation Algorithm for Mobile Social Network Based on User Preference Tracking. The 2nd International Conference on Computing and Data Science, 1-7.
Xu, L., Liu, J., & Gu, Y. (2018). A Recommendation System Based on Extreme Gradient Boosting Classifier. 10th International Conference on Modelling, Identification and Control (ICMIC), 1-5.
Xu, Z., Chen, L., Dai, Y., & Chen, G. (2017). A Dynamic Topic Model and Matrix Factorization-Based Travel Recommendation Method Exploiting Ubiquitous Data. IEEE Transactions on Multimedia, 19(8), 1933-1945.
Yang, Y.-T., Feng, L., & Dai, L.-C. (2021). A BERT-Based Interactive Attention Network for Aspect Sentiment Analysis. Journal of Computers, 32(3), 30-42.
Zhang, H., Ganchev, I., Nikolov, N. S., Ji, Z., & O'Droma, M. (2017). Weighted Matrix Factorization with Bayesian Personalized Ranking. Computing Conference, London, UK. 307-311.
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2019). Deep Learning Based Recommender System: A Survey and New Perspectives. ACM Computing Surveys (CSUR), 52(1), 1-38.
Zhang, T. (2021). Product Feature Sentiment Classification Algorithm Based on BERT Model. Frontiers in Economics and Management, 2(3), 391-402.
Zhang, Z., Zou, C., Ding, R., & Chen, Z. (2019). VCG: Exploiting Visual Contents and Geographical Influence for Point-of-Interest Recommendation. Neurocomputing, 357, 53-65.
Zhao, P., Luo, A., Liu, Y., Zhuang, F., Xu, J., Li, Z., Sheng, V. S., & Zhou, X. (2020). Where to Go Next: A Spatio-Temporal Gated Network for Next POI Recommendation. IEEE Transactions on Knowledge and Data Engineering, 34, 2512-2524.
Zheng, L., Noroozi, V., & Yu, P. S. (2017). Joint Deep Modeling of Users and Items Using Reviews for Recommendation. Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, Cambridge, United Kingdom. 425-434.
電子全文
(
網際網路公開日期:20270906
)