摘要
目前多数云存储文件系统为保证其系统可靠性和性能所采用的静态完全副本冗余机制存在存储效率低、负载均衡能力差等缺点,为了提高云存储效率以及优化云存储的负载均衡能力,该文根据应用HDFS的经验,提出一种基于RS纠删码的云存储动态副本的冗余策略-SeaMaiden。SeaMaiden引入了副本调整模块和纠删码编解码模块,通过周期性的计算文件的热度,进而动态调整文件的副本数。当文件的副本数低于3时,则调用纠删码编解码模块对文件进行编码,提升文件的可靠性。当文件的热度级别上升时,则动态增加文件副本数,提升HDFS的负载均衡能力。通过实验证明SeaMaiden能有效提高HDFS的存储效率、可靠性及响应速度。
At present,in order to ensure reliability and performance of the storage file system,most cloud storage file systems used static redundancy mechanism.Its storage efficiency is low,and load balancing capability is poor.In order to improve the efficiency of cloud storage and to optimize the load balancing capability,based on the experience of HDFS,this paper presented SeaMaiden strategy which is a cloud storage dynamic replication strategy based on RS erasure code.SeaMaiden introduced the adjust copy module and erasure codes encoding and decoding module.By calculating the heat of the file periodically,HDFS can adjust the number of copies of documents.HDFS would call the encoding and decoding module to encode the file when the number of copies less than 3 to improve the reliability of the file.When the heat level of the file rose,HDFS would dynamically increase the number of the copies to improve the the load balancing capability.Finally,proved by experiments SeaMaiden can effectively improve the storage efficiency of HDFS,reliability and speed of response.
出处
《科技创新导报》
2013年第17期29-31,共3页
Science and Technology Innovation Herald
关键词
RS纠删码
动态副本策略
HDFS
Hadoop Distributed File System(HDFS) Dynamic Replica Strategy RS
