摘要
HBase列式非关系型数据库行键设计决定了海量数据存储与查询效率。针对目前存在的数据存储问题及检索效率问题,对现有5种主流方法进行数据测试后,选择了相对较优的哈希前缀法,并在原有基础上根据智慧水务系统中的数据结构特性,使用重要字段提升法结合逆序行键方法进行设计。验证结果显示,该行键组合法针对智慧水务中的时序性数据,在存储方面解决了写入热点与存储分散相矛盾的问题,检索效率在原有哈希前缀法基础上也有了一定提升。
The design of row keys in HBase column-type non-relational database determines the efficiency of mass data storage and query.In view of the current hot issues in storage and retrieval efficiency,after data testing of the five existing mainstream methods,a relatively good Hash prefix method was selected.On the original basis,according to the characteristics of data structure in the smart water system,an important field lifting method was used and the reverse row key method was combined to design.Verification results show that this kind of line key combination method solves the contradiction between hot spots and distributed storage in the storage of sequential data in smart water,and the retrieval efficiency is improved on the basis of the original Hash prefix method.
作者
李兴菊
赵建军
聂红梅
王迎
LI Xing-ju;ZHAO Jian-jun;NIE Hong-mei;WANG Ying(College of Science,Kunming University of Science and Technology,Kunming 650500,China)
出处
《软件导刊》
2019年第10期178-181,185,共5页
Software Guide
基金
国家自然科学基金青年科学基金项目(11103069)
