摘要
随着TB级乃至PB级地质矿产大数据时代的到来,地质大数据的存储难题一直困扰着地质界,传统的地质数据存储与服务模式面临诸多难题。结合Hadoop提出了一种新的基于云计算环境的地质矿产数据存储方法,将该方法与传统Oracle数据库存储方法进行了数据存储实验对比。实验结果表明,该存储方法比传统方法更高效,同时有效地解决了Hhadoop存储中出现的小文件存储问题。研究成果为地质矿产数据的存储与管理提供了一种新的管理方法。
With the advent of the era of big data of geology and mineral resources of terabytes and petabytes grades,geological large data storage problem has been bothering geologists.The traditional pattern of geological data storage and service faces many problems.In this paper,based on Hadoop,the authors put forward a new kind of geological and mineral resources data storage method based on cloud computing environment,and a comparative study of this method and the traditional storage method of the Oracle database data storage experiment was carried out.The experimental results show that the method proposed in this paper is more efficient than the traditional method and can effectively solve the problem of small file storage in Hadoop storage.The research results provide a new management method for the storage and management of geological and mineral data.
作者
赵亚楠
李朝奎
肖克炎
范建福
ZHAO Ya’nan;LI Chaokui;XIAO Keyan;FAN Jianfu(National- Local Joint Engineering Laboratory of Geospatial Information Technology/Hu'nan University of Science and Technology,Xiangtan 411201,Hu'nan,China;Key Laboratory of Geological Information Technology of Ministry of Natural Resources,Beijing 100037,China;Institute of Mineral Resources,Chinese Academy of Geological Sciences,Beijing 100037,China)
出处
《地质通报》
CAS
CSCD
北大核心
2019年第2期462-470,共9页
Geological Bulletin of China
基金
国土资源部公益性行业科研专项<地质大数据技术研究与应用试点>(编号:201511079-04)
国家自然科学基金项目<大范围三维城市模型快速构建方法及其泛在应用建模>(批准号:41571374)
国家重点研发计划项目<基于"地质云"平台的深部找矿知识挖掘>(编号:2016YFC0600510)
湖南省教育厅重点科技项目<城市三维复杂场景泛在感知建模与应用>(编号:16A070)
