摘要
传统FTP下载只有一个客户端和一个服务器,存在单点故障和性能瓶颈,且下载以交互式为主,对文件名不固定的文件不能自动下载。针对此问题,基于分布式调度技术提出多源分布式下载技术,实现多个下载客户端同时从多个FTP服务器下载相同的资料,提高FTP下载性能和可靠性;提出定时下载、延迟下载、文件名时间变量替换、按规则改名、二次分发等技术,实现任意文件的自动下载;使用bash开发了多源分布式下载软件,在测试环境和实际生产环境中的应用表明,多源分布式下载具有下载速度快、可靠性高的特点,每增加一个新的C/S下载链接,下载性能可以提升30%,增加一个客户端或一个服务器,可靠性提升一倍。
Traditional FTP download has only one client and one server,which has single point of failure and performance bottlenecks.In addition,the download is mainly interactive,and files with variable file names cannot be automatically downloaded.To solve this problem,the distributed scheduling technology is used to put forward the multi⁃server distributed download technology,which enables multiple download clients to download the same kind of data from multiple FTP servers at the same time,and improves the performance and reliability of FTP download.It proposes technologies such as timed download,delayed download,file name time variable substitution,renaming according to rules,and secondary distribution to realize automatic download of any file.The multi⁃server distributed download software was developed using bash.The application in the test environment and the actual production environment shows that the multi⁃server distributed download has the characteristics of fast download speed and high reliability.The download performance can be improved by 30%when a new C/S link is added,and the reliability can be doubled by adding a client or a server.
作者
陈旭辉
刘洋
徐娟
孔小怡
CHEN Xuhui;LIU Yang;XU Juan;KONG Xiaoyi(Gansu Meteorological Information and Equipment Technical Support Center,Lanzhou 730020,China)
出处
《电子设计工程》
2023年第7期42-46,共5页
Electronic Design Engineering
基金
2019年甘肃省雷达数据共享平台省级信息基础设施建设项目资助(GC-HG4190824)。
