摘要
为了能够实时处理海量AIS数据并从中提取所需的信息,以供后续的数据挖掘和规律提取,重点研究了两种海量AIS处理技术:利用分布式存储构架结合Matlab软件的MDCS工具箱进行AIS数据的处理和分析;利用弹性数据集构建分布式数据库进行AIS数据的实时查询和分析。在此基础上,通过全球AIS数据分析了全球船舶密度情况,并通过军舰AIS信号分析了军舰的行为特征和规律。以上应用的测试结果验证了海量AIS数据处理技术。
For the purpose of extracting the regular pattern and data mining in real time from the mass AIS data,two kinds of technology for processing massive AIS data are proposed.The framework of distributed storage combined with the MDCS toolbox of MATLAB software is employed for this goal,and real time query and analysis of AIS data based on resilient distributed dataset(RDD)are realized by the distributed database.Based on these two kinds of technology,the global AIS data are used to analyze the global ship density,as well as the characteristics and rules of warship.By these applications,the two kinds of technology for processing the mass AIS data are verified.
出处
《海军工程大学学报》
CAS
北大核心
2017年第4期98-102,112,共6页
Journal of Naval University of Engineering
关键词
AIS数据
大数据
分布式存储结构
弹性数据集
AIS data
bigdata
distributed storage structure
resilient distributed dataset