期刊文献+

基于大数据平台的数据分发机制研究 被引量:3

The Data Distribution Mechanism Based on Big Data Platform
下载PDF
导出
摘要 大数据平台具有很好的扩展性,如何与传统的数据仓库结合并发挥其优势成为研究的热门方向。文章重点研究传统数据仓库架构中接口机承担的数据分发机制,完成功能架构和技术架构设计,开发并进行了应用推广。通过引入大数据平台,使之具有良好的扩展性,同时解决了性能问题。该方案不仅解决了接口机的时效性问题,还可以作为混搭的大数据融合平台架构的一部分,为基础电信运营商数据仓库的建设积累了一些宝贵的经验。 Big data has become a hot topic to study how to combine big data with the traditional data warehouse and bring their own advantages into full play due to the excellent extensibility of it. This thesis analyzes the data distrbution mechanism of interfaces in the data warehouse architecture, designs the functional and technical architecture, develops an applicaiton and conducts the application promotions. With the big data platform, the application obtains excellent extensibility and thus betters its performance. This solution not only makes interfaces more time-efficient, but also can integrate with the big data convergent platform. In general, this thesis has gained some valuable experience of data warehouse construction for teiecom operators.
出处 《信息通信技术》 2015年第6期17-23,共7页 Information and communications Technologies
关键词 大数据平台 数据仓库 数据分发机制 Big Data Platform Data Warehouse Data Distribution Mechanism
  • 相关文献

参考文献7

二级参考文献217

  • 1黄野,常歌.基于多分辨率模型的地形实时显示[J].测绘科学技术学报,2001,22(2):121-123. 被引量:5
  • 2刘俊.基于大数据流的Multi-Agent系统模型研究[J].计算机技术与发展,2007,17(5):166-169. 被引量:10
  • 3Mauricio Hernandez, Salvatore Stolfo. The merge/purge problem for large databases. In: ACM SIGMOD Record. New York:ACM Press, 1995. 127- 138.
  • 4Alvaro Monge, Charles Elkan. An efficient domain-independent algorithm for detecting approximately duplicate database records.Workshop on Research Issues on Data Mining and Knowledge Discovery (DMKD'97), Tucson, AZ, 1997.
  • 5Karen Kukich. Techniques for automatically correcting words in text. ACM Computing Surveys, 1992, 24(4): 377-439.
  • 6Liang Jin, Chen Li, Sharad Mehrotra. Efficient record linkage in large data sets. The 8th Int'l Conf. Database Systems for Advanced Applications, Kyoto, Japan, 2003.
  • 7Surajit Chaudhuri, Kris Ganjam, Venkatesh Ganti, et al. Robust and efficient fuzzy match for online data cleaning. In: Proc. 2003 ACM SIGMOD Int'l Conf. Management of Data. New York:ACM Press, 2003. 313-324.
  • 8Sunita Sarawagi, Anuradha Bhamidipaty. Interactive deduplication using active learning. In: Proc. 8th ACM SIGKDD Int'l Conf.Knowledge Discovery and Data Mining. New York: ACM Press,2002. 269- 278.
  • 9Wai Lup Low, Mong Li Lee, Tok Wang Ling. A knowledgebased approach for duplicate elimination in data cleaning.Information Systems, 2001, 26(8): 585-606.
  • 10Rohit Ananthakrishna, Surajit Chaudhuri, Venkatesh Ganti.Eliminating fuzzy duplicates in data warehouses. In: Proc. 28th VLDB. San Francisco: Morgan Kaufmann, 2002. 586-597.

共引文献4565

同被引文献25

引证文献3

二级引证文献10

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部