期刊文献+

ODS中增量ETL过程的CSP模型研究

ODS in incremental ETL process of CSP model
下载PDF
导出
摘要 增量ETL过程的并行化是提高ODS数据实时性的有效途径。结合通信顺序进程理论研究了增量ETL过程模型,形式化分析了增量ETL过程事件在并行环境下执行状态的变换过程,提出了增量ETL过程并行调度算法,解决了增量ETL过程在并行环境下调度策略的问题。应用及实践表明,模型及算法具有源系统负载小、数据的实时性高等特点。 Parallel incremental ETL process is to improve the ODS data real-time effective way.Combine with communicating sequential processes theory of the incremental ETL process models,formal analysis of the incremental ETL process events in parallel execution environment,and the state of transformation process,this paper proposed the incremental ETL process proposed parallel scheduling algorithm to solve the incremental ETL process a parallel scheduling policy environment in question.Application and practice show that the model and algorithm with the source system load is small,and high real-time data
出处 《计算机应用研究》 CSCD 北大核心 2012年第9期3330-3333,共4页 Application Research of Computers
基金 国家自然科学基金资助项目(61003247)
关键词 通信顺序进程 操作数据存储 增量ETL 并行调度 CSP ODS incremental ETL parallel scheduling
  • 相关文献

参考文献9

  • 1张磊,钟勇.一种新型数据仓库体系的实现[J].计算机应用,2003,23(10):111-113. 被引量:3
  • 2徐俊刚,裴莹.数据ETL研究综述[J].计算机科学,2011,38(4):15-20. 被引量:106
  • 3许力,牟晓光,马云存.并行ETL过程的研究与实现[J].计算机工程与应用,2009,45(13):170-172. 被引量:15
  • 4SIMITSIS A,GUPTA C,WANG Song, et al. Partitioning real-time ETL workflows [ C ] //Proc of the 26th Intemationai Conference on Data Engineering Workshops. Washington DC: Computer Society, 2010: 159-162.
  • 5张旭峰,孙未未,汪卫,冯雅慧,施伯乐.增量ETL过程自动化产生方法的研究[J].计算机研究与发展,2006,43(6):1097-1103. 被引量:19
  • 6BEHREND A, BEHREND A. Optimized incremental ETL jobs for maintaining data warehouses [ C ] //Proc of the 14th Intemationai Database Engineering & Applications Symposium. New York: ACM, 2010: 216-224.
  • 7HOARE CAR, Communicating sequential processes [ M ]. London : Prentice- Hall Intemationai, 1985.
  • 8谷长勇.事务处理服务器的性能评价研究[D].北京:中国科学院 研究生院(计算技术研究所),2006.
  • 9STRANGE K H. ETL was the key to this data warehouse * s success, CS-15-3143 [ R]. Stamford:Gartner,2002.

二级参考文献72

  • 1鲍玉斌,孙焕良,冷芳玲,王大玲,于戈.数据仓库环境下以用户为中心的数据清洗过程模型[J].计算机科学,2004,31(5):52-55. 被引量:15
  • 2钟华,冯文澜,谭红星,黄涛.面向数据集成的ETL系统设计与实现[J].计算机科学,2004,31(9):87-89. 被引量:21
  • 3沈军,满家巨,聂作先.高性能集群管理与优化[J].计算机与现代化,2007(2):84-88. 被引量:7
  • 4HanJ KamberM 范明 孟小峰 等译.数据挖掘概念和技术[M].北京:机械工业出版社,2001..
  • 5Inmon W H.Building the data warehouse[M].New York:Wiley &Sons,1993.
  • 6Giacomoni J,Moseley T,Vachharajani M,Fast forward for efficient pipeline parallehsm,Technical Report CU-CS-1028-07[R].University of Colorado at Boulder:2007-04.
  • 7Vassiliadis P, Simitsis A, Skiadopoulos S. Conceptual Modeling for ETI. Processes [C].//Proceedings of the 5th ACM International Workshop on Data Warehousing and OLAP. New York.. ACM, 2002 : 14-21.
  • 8Simitsis A. Mapping Conceptual to Logical Models for ETL Processes[C] .// Proceedings of the 8th ACM International Workshop on Data Warehousing and OI.AP. New York: ACM, 2005: 67-76.
  • 9Inmon W H. The Data Warehouse Budget [J/OL]. DM Review Magazine. http://www, datawarehouse, inf. br/Papers/inmon% 20budget 1. pdf, 2010-4-12.
  • 10Shilakes C,Tylman J. Enterprise Information Portals [R]. New York:Merrill Lynch, 1998.

共引文献137

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部