基于关联规则的网络信息内容安全事件发现及其Map-Reduce实现
doi: 10.3724/SP.J.1146.2013.01272
Discovery of Network Information Content Security Incidents Based on Association Rules and Its Implementation in Map-Reduce
-
摘要: 针对网络中信息内容安全事件的发现问题,该文提出一种基于关联规则的多维度用户行为特征关联分析法;对于存在的虚警问题,提出了基于邦弗朗尼校正的检验准则;为满足在海量数据中的应用需求,提出了一种Map-Reduce框架下的分布式幂集Apriori算法。实验结果表明,该文提出的方法及相应算法,并行运算能力强,在低虚警率和漏检率的情况下,具有较好的检测率,且运行时间短,收敛速度快。Abstract: A multi-dimension association analysis method of users behavioral characteristics based on association rules is proposed for the discovery of information content security incidents in network. The users multi- dimension data which generate in communication can be mined. An inspection standard based on Bonferronis correction is put forward to deal with the problem of false alarm. In order to meet the demand for the implementation of the method in a massive database, a distributed power set Apriori algorithm in Map-Reduce framework is proposed. Experimental results demonstrate that the proposed method and its corresponding algorithm have strong ability in parallel computing. The algorithm has a great detection rate in the case of low false alarm rate and missing detection rate. The running time is short and it can achieve a fast convergences rate.
计量
- 文章访问数: 2501
- HTML全文浏览量: 105
- PDF下载量: 1463
- 被引次数: 0