摘要
为激励大众参与公开数据的开发利用,各领域纷纷举办开放数据竞赛活动,并引发了社会各界的广泛关注。近年来数字人文项目的兴起一方面产生了大量的开放数据,另一方面由于其跨领域和学科交叉等特性,也给开放数据竞赛带来了新的契机,特别是针对数字人文项目开展相关的创意类开放数据竞赛,其影响力和社会价值不容小觑。随着数字人文领域创意类开放数据竞赛的推动和发展,对于作品的评价是确保开放数据竞赛公平公正的有效途径,也是项目后期孵化和推广的重要依据。目前国内外在这方面的实践还处于摸索起步阶段,理论研究方面更是鲜有关注,因此有必要对创意类开放数据竞赛中的竞选作品构建一套科学系统的评价指标体系。本文以"全评价"分析框架和D&M模型为基础,结合创意类开放数据竞赛的目的和数字人文领域的特色,初步确立了评价指标体系。在此基础上运用德尔菲法征询专家意见,完善指标体系并获取指标重要性得分,选用基于指数标度的层次分析法计算各指标权重;以上海图书馆举办的创意类开放数据竞赛为例,采用逼近理想解排序法和评价指标体系对部分竞选项目进行评估,从而完成指标体系的最终测定;最后对数字人文领域创意类开放数据竞赛的参赛项目评审和数字人文类互联网应用的开发提出若干建议。
In order to encourage the public to participate in the development and utilization of open data,open data competitions have been launched in various fields and have attracted wide attention from the academia and industry.On the one hand,the rise of digital humanities projects have produced a large amount of open data in recent years.On the other hand,due to the cross-disciplinary and interdisciplinary characteristics of digital humanities,some new opportunities have been brought to the open data competitions.The influence and social value of creative open data competitions supporting digital humanities projects should not be underestimated.With the promotion and development of the creative open data competitions in the field of digital humanities,to evaluate the entries is not only an effective way to ensure the fairness and justice of open data competitions but also an important basis for the incubation and promotion of the projects in the later stage.At present,the practice of creative open data competition in the field of digital humanities at home and abroad is still in the initial stage,and theoretical investigation on this realm is rarely concerned.In this regard,there is a pressing-need to construct a scientific and systematic evaluation index system for the creative open data competition in the field of digital humanities.To begin with,we review the relevant literature about creative open data competition,the evaluation of internet application in the field of digital humanities,and analytical framework and application of"all-round evaluation".Then,based on the"all-round evaluation"analytical framework and D&M model,this paper preliminarily establishes the evaluation index system by combining the purpose of the creative open data competition and the domain characteristics of digital humanities.Then,we use Delphi method to determine the final evaluation index system which consists of 6 first-level indexes,18 second-level indexes and 39 third-level indexes.This paper also uses the analytic hierarchy process method(AHP)based on the index scale to calculate the weight of each index.The weight of six first-level indices,namely,the development and utilization of open data,the compliance degree of competition rules,information content,system performance,function design and interface design,gradually decreases.Next,taking the creative open data competition held by Shanghai Library as an example,we use the approximation ideal sorting method and the evaluation index system to evaluate some entries,thereby completing the final determination of the index system.Finally,we put forward some suggestions for the evaluation and development of the creative open data competition in the field of digital humanities.In terms of the theoretical contribution of this work,the paper constructs a scientific and feasible evaluation index system,enriching our understanding of the important components of the creative open data competition in the field of digital humanities.In terms of practical implications,this study provides important guidance for the creative open data competition organizers and participants,especially for the designing and operation of the open data contest in the digital humanities domain.This study also has some limitations.Firstly,the evaluation system lacks the quantitative indices,which may have some biases in judging the comprehensive scale of the evaluation.Secondly,restricted by realistic conditions,this study cannot fully reflect the supervision mechanism and feedback mechanism that are advocated in the"all-round evaluation"analytical framework.In the future,we will further explore the quantitative data to measure the index and improve the evaluation system by more field methods(e.g.,action research).
作者
赵宇翔
刘周颖
刘炜
高胜寒
张磊
ZHAO Yuxiang;LIU Zhouying;LIU Wei;GAO Shenghan;ZHANG Lei
出处
《中国图书馆学报》
CSSCI
北大核心
2020年第2期75-95,共21页
Journal of Library Science in China
基金
国家社会科学基金重大项目“面向大数据的数字图书馆移动视觉搜索机制及应用研究”(编号:15ZDB126)
国家社会科学基金一般项目“面向数字人文研究的图书馆开放数据体系构建与服务模式设计”(编号:18BTQ027)的研究成果之一。
关键词
开放数据竞赛
数字人文
“全评价”分析框架
评价指标体系
德尔菲法
层次分析法
Open data competition
Digital humanities
All-round evaluation framework
Evaluation index system
Delphi method
Analytic hierarchy process
