This paper proposes a holistic framework for the development of models for the assessment of research activities and their impacts. It distinguishes three dimensions, including in an original way, data as a main dimen...This paper proposes a holistic framework for the development of models for the assessment of research activities and their impacts. It distinguishes three dimensions, including in an original way, data as a main dimension, together with theory and methodology. Each dimension of the framework is further characterized by three main building blocks： education, research, and innovation （theory）; efficiency, effectiveness, and impact （methodology）; and availability, interoperability, and ＂unit-free＂ property （data）. The different dimensions and their nine constituent building blocks are attributes of an overarching concept, denoted as ＂quality.＂ Three additional quality attributes are identified as implementation factors （tailorability, transparency, and openness） and three ＂enabling＂ conditions （convergence, mixed methods, and knowledge infrastructures） complete the fi-amework. A framework is required to develop models of metrics. Models of metrics are necessary to assess the meaning, validity, and robustness of metrics. The proposed framework can be a useful reference for the development of the ethics of research evaluation. It can act as a common denominator for different analytical levels and relevant aspects and is able to embrace many different and heterogeneous streams of literature. Directions for future research are provided.展开更多
基金financial support of the Italian Ministry of Education and Research(through the PRIN Project N.2015RJARX7)Sapienza University of Rome(through the Sapienza Awards no.6H15XNFS)the Lazio Region(through the Project FILAS-RU-2014-1186)
文摘This paper proposes a holistic framework for the development of models for the assessment of research activities and their impacts. It distinguishes three dimensions, including in an original way, data as a main dimension, together with theory and methodology. Each dimension of the framework is further characterized by three main building blocks： education, research, and innovation （theory）; efficiency, effectiveness, and impact （methodology）; and availability, interoperability, and ＂unit-free＂ property （data）. The different dimensions and their nine constituent building blocks are attributes of an overarching concept, denoted as ＂quality.＂ Three additional quality attributes are identified as implementation factors （tailorability, transparency, and openness） and three ＂enabling＂ conditions （convergence, mixed methods, and knowledge infrastructures） complete the fi-amework. A framework is required to develop models of metrics. Models of metrics are necessary to assess the meaning, validity, and robustness of metrics. The proposed framework can be a useful reference for the development of the ethics of research evaluation. It can act as a common denominator for different analytical levels and relevant aspects and is able to embrace many different and heterogeneous streams of literature. Directions for future research are provided.
