摘要
在这个信息量爆炸性增长的时代,网络不良信息充斥在日常生活当中。为了构建洁净的网络环境,实现对网络维吾尔文中敏感信息的检测与过滤,通过分析维吾尔文的特点,将维吾尔文进行词干提取和编码化处理,再结合DFA和决策树提出了针对维吾尔文敏感信息过滤的相应方法。维吾尔文经过词干提取、编码化处理解决了维吾尔文书写顺序和形式多样、存储易出现乱码等问题。再结合决策树的特点,将转码后的维吾尔文信息存储于决策树节点上,将决策树的子节点按照特定编码进行顺序排列。这样维吾尔文文本信息进行敏感信息过滤时可以缩小检测范围,提高算法效率。
In this era of information explosion, bad information of the network is full of daily life. In order to build a clean network environment and realize the Uyghur web page detection and filtering of sensitive information, by analyzing the characteristics of the Uyghur, the Uyghur is done stemming and encoding processing. Combining the DFA and the decision tree, it puts forward the corresponding method for Uyghur sensitive information filtering. After stemming and encoding processing, it solves the Uyghur writing sequence, form of diversity, and storage with garbled words easily problems, etc.And then combining the characteristics of the decision tree, the transcoding Uyghur is stored on the decision tree node,and the child nodes of the decision tree are arranged in order in accordance with the specific code. So the information of Uyghur text can narrow the detection range when the information is filtered, and improve the efficiency of algorithm.
出处
《计算机工程与应用》
CSCD
北大核心
2018年第5期236-241,246,共7页
Computer Engineering and Applications
基金
国家自然科学基金(No.61163052
No.61303231
No.61433012)
关键词
敏感信息过滤
确定性自动机
维吾尔文过滤
决策树
sensitive information filtering
deterministic finite automaton
Uyghur filter
decision tree
