期刊文献+

基于ETL的金融数据集成过程模型 被引量:5

ETL-based solution for integrating data in financial domain
下载PDF
导出
摘要 为了将频繁产生的分布在世界各地的金融数据按需地高性能集成,提出了基于ETL(extract-transform-load)的金融数据集成过程模型。对规则引擎原理进行了研究,建立了基于业务转换规则的插件式扩展实现可复用可定制的业务转换过程。利用事件驱动的交互模型和元数据映射保证非结构化和半结构化数据之间无差异集成,采用增量式数据处理解决数据集成中棘手的性能问题。通过实践项目的验证,对比传统数据集成方法和该过程模型,验证了该过程模型的有效性。 In order to integrate the distributed data frequently with high performance, an ETL (extract-transform-load) based data integration model is proposed. Business rule has been studied and integrate into this model to get business rule as plug-in transform solution. On demand request and Meta data mapping can shield the difference between the structured data and un-structured data. Performance issue has been analyzed and the incremental integration is introduced to extract data source in an incremental way. Based on practical project, traditional point to point integration is compared to this model to illustrate this model can have high performance and easy to be implemented.
作者 苌程 李善平
出处 《计算机工程与设计》 CSCD 北大核心 2010年第9期2070-2072,2104,共4页 Computer Engineering and Design
关键词 数据抽取转换装载 数据集成 元数据映射 业务规则转换 按需交互 ETL data integration metadata mapping business rule transform on demand request
  • 相关文献

参考文献8

  • 1国际银行同业间的国际合作组织[EB/OL].SWIFT.httP://www.swift.com/.
  • 2陈桦,麻风梅,韩艳艳.基于XML的异构数据集成模式的研究[J].微电子学与计算机,2009,26(1):137-139. 被引量:14
  • 3Wing L.Venky S.Enterprise architecture and integration:methods,implementation and technologies[M].United States:IGI Publishing,2007.
  • 4Vassiliadis P,Simitis A,Skiadopoulos S.Conceptual modeling for ETL processes[C].Virgina,USA:DOLAP'02,2002.
  • 5钟华,冯文澜,谭红星,黄涛.面向数据集成的ETL系统设计与实现[J].计算机科学,2004,31(9):87-89. 被引量:21
  • 6Erich Gamma,Richard Helm,Ralph Johnson,et al.Design patterns:elements of reusable object-oriented software[M].United States:Addison-Wesley,2002.
  • 7Ralph K.The data warehouse lifecycle toolkit[M].2nd ed.United States:John Wiley & Sons,2008.
  • 8陶晓俊,朱敏.基于规则引擎的企业服务开发模式[J].计算机技术与发展,2008,18(2):115-118. 被引量:19

二级参考文献18

  • 1顾天竺,沈洁,陈晓红,李慧,张舒,吴颜.基于XML的异构数据集成模式的研究[J].计算机应用研究,2007,24(4):94-96. 被引量:40
  • 2姚全珠,赵朋飞.发布关系数据为XML文档[J].计算机工程与应用,2007,43(15):160-162. 被引量:2
  • 3Dietz P F. Maintaining order in a linked list[C]//Proceedings of the 14th Annual ACM Symposium on Theory of Computing (STOC' 82). USA. New York: ACM Pros, 1982:122 - 127.
  • 4Bohannon P, Xin Luna Dong, Ganguly S, et al. ROLEX: relational on- line exchange with XML[ C]//International Conference on Management of Data Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data. San Diego, California, New York: ACM Press, 2003: 673.
  • 5[1]Vassiliadis P,Simitsis A,Skiadopoulos S.Conceptual Modeling for ETL Processes,DOLAP'02,Virginia,USA,2002
  • 6[2]Vassiliadis P,et al.ARKTOS:Towards the modeling,design,control and execution of ETL processes.Information Systems,2001,26(8)
  • 7[3]Calvanese D,et al.Information integration:Conceptual modeling and reasoning support.In:Proc.COOPIS'98,New York,USA,1998
  • 8[4]Galhardas H,et al,Ajax:An Extensible Data Cleaning Tool. In:Proc.ACM SIGMOD,Dallas,Texas,2000
  • 9[5]Raman V,Hellerstein J.Potter's Wheel:An Interactive Data Cleaning System.In:Proc VLDB,Roma,Italy,2001
  • 10[6]Microsoft Corp.MS Data Transformation Services.www.microsoft.com/sq

共引文献51

同被引文献28

引证文献5

二级引证文献18

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部