期刊文献+
共找到2篇文章
< 1 >
每页显示 20 50 100
Design and Implementation of Log Data Analysis Management System Based on Hadoop 被引量:2
1
作者 dunhong yao Yu Chen 《Journal of Information Hiding and Privacy Protection》 2020年第2期59-65,共7页
With the rapid development of the Internet,many enterprises have launched their network platforms.When users browse,search,and click the products of these platforms,most platforms will keep records of these network be... With the rapid development of the Internet,many enterprises have launched their network platforms.When users browse,search,and click the products of these platforms,most platforms will keep records of these network behaviors,these records are often heterogeneous,and it is called log data.To effectively to analyze and manage these heterogeneous log data,so that enterprises can grasp the behavior characteristics of their platform users in time,to realize targeted recommendation of users,increase the sales volume of enterprises’products,and accelerate the development of enterprises.Firstly,we follow the process of big data collection,storage,analysis,and visualization to design the system,then,we adopt HDFS storage technology,Yarn resource management technology,and gink load balancing technology to build a Hadoop cluster to process the log data,and adopt MapReduce processing technology and data warehouse hive technology analyze the log data to obtain the results.Finally,the obtained results are displayed visually,and a log data analysis system is successfully constructed.It has been proved by practice that the system effectively realizes the collection,analysis and visualization of log data,and can accurately realize the recommendation of products by enterprises.The system is stable and effective. 展开更多
关键词 Log data HADOOP data analysis data visualization
下载PDF
A Recommendation Method for Highly Sparse Dataset Based on Teaching Recommendation Factorization Machines
2
作者 dunhong yao Shijun Li +1 位作者 Ang Li Yu Chen 《Computers, Materials & Continua》 SCIE EI 2020年第9期1959-1975,共17页
There is no reasonable scientific basis for selecting the excellent teachers of the school’s courses.To solve the practical problem,we firstly give a series of normalization models for defining the key attributes of ... There is no reasonable scientific basis for selecting the excellent teachers of the school’s courses.To solve the practical problem,we firstly give a series of normalization models for defining the key attributes of teachers’professional foundation,course difficulty coefficient,and comprehensive evaluation of teaching.Then,we define a partial weight function to calculate the key attributes,and obtain the partial recommendation values.Next,we construct a highly sparse Teaching Recommendation Factorization Machines(TRFMs)model,which takes the 5-tuples relation including teacher,course,teachers’professional foundation,course difficulty,teaching evaluation as the feature vector,and take partial recommendation value as the recommendation label.Finally,we design a novel Top-N excellent teacher recommendation algorithm based on TRFMs by course classification on the highly sparse dataset.Experimental results show that the proposed TRFMs and recommendation algorithm can accurately realize the recommendation of excellent teachers on a highly sparse historical teaching dataset.The recommendation accuracy is superior to that of the three-dimensional tensor decomposition model algorithm which also solves sparse datasets.The proposed method can be used as a new recommendation method applied to the teaching arrangements in all kinds of schools,which can effectively improve the teaching quality. 展开更多
关键词 Highly sparse dataset normalized models teaching recommendation factorization machines excellent teacher recommendation
下载PDF
上一页 1 下一页 到第
使用帮助 返回顶部