Purpose:To uncover the evaluation information on the academic contribution of research papers cited by peers based on the content cited by citing papers,and to provide an evidencebased tool for evaluating the academic...Purpose:To uncover the evaluation information on the academic contribution of research papers cited by peers based on the content cited by citing papers,and to provide an evidencebased tool for evaluating the academic value of cited papers.Design/methodology/approach:CiteOpinion uses a deep learning model to automatically extract citing sentences from representative citing papers;it starts with an analysis on the citing sentences,then it identifies major academic contribution points of the cited paper,positive/negative evaluations from citing authors and the changes in the subjects of subsequent citing authors by means of Recognizing Categories of Moves(problems,methods,conclusions,etc.),and sentiment analysis and topic clustering.Findings:Citing sentences in a citing paper contain substantial evidences useful for academic evaluation.They can also be used to objectively and authentically reveal the nature and degree of contribution of the cited paper reflected by citation,beyond simple citation statistics.Practical implications:The evidence-based evaluation tool CiteOpinion can provide an objective and in-depth academic value evaluation basis for the representative papers of scientific researchers,research teams,and institutions.Originality/value:No other similar practical tool is found in papers retrieved.Research limitations:There are difficulties in acquiring full text of citing papers.There is a need to refine the calculation based on the sentiment scores of citing sentences.Currently,the tool is only used for academic contribution evaluation,while its value in policy studies,technical application,and promotion of science is not yet tested.展开更多
Purpose:The 5th Plenary Session of the 19th Communist Party of China(CPC)Central Committee clearly states that developing science and technology through self-reliance and self-strengthening provides the strategic unde...Purpose:The 5th Plenary Session of the 19th Communist Party of China(CPC)Central Committee clearly states that developing science and technology through self-reliance and self-strengthening provides the strategic underpinning for China’s development.Based on this background,this paper explores a metric model for assessing national scientific research strength through collaboration on research papers.Design/methodology/approach:We propose a novel metric model for assessing national scientific research strength,which sets two indicators,national scientific self-reliance(SR)and national academic contribution(CT),to reflect“self-reliance”and“self-strengthening”respectively.Taking the research papers in quantum technology as an example,this study analyzes the scientific research strength of various countries around the world,especially China in quantum technology.Findings:The results show that the research of quantum technology in China has always been relatively independent with fewer international collaboration papers and located in a more marginal position in cooperation networks.China’s academic contribution(CT)to global quantum technology research is increasing and has been greater than that of the United States in 2020.Combining the two indicators,CT and SR,China’s research strength in the quantum field closely follows the United States,and the United States is the most powerful with high research autonomy.Research limitations:This paper only reflects China’s scientific research strength in quantum technology from collaboration on research papers and doesn’t consider the segmentation of quantum technology and the industrial upstream and downstream aspects,which need further study.Practical implications:The model is helpful to better understand the national scientific research strength in a certain field from“self-reliance”and“self-strengthening”.ScienceOriginality/value:We propose a novel metric model to measure the national scientific research strength from the perspective of“self-reliance”and“self-strengthening”,which provides a solid basis for the assessment of the strength level of scientific research in countries/regions and institutions.展开更多
文摘Purpose:To uncover the evaluation information on the academic contribution of research papers cited by peers based on the content cited by citing papers,and to provide an evidencebased tool for evaluating the academic value of cited papers.Design/methodology/approach:CiteOpinion uses a deep learning model to automatically extract citing sentences from representative citing papers;it starts with an analysis on the citing sentences,then it identifies major academic contribution points of the cited paper,positive/negative evaluations from citing authors and the changes in the subjects of subsequent citing authors by means of Recognizing Categories of Moves(problems,methods,conclusions,etc.),and sentiment analysis and topic clustering.Findings:Citing sentences in a citing paper contain substantial evidences useful for academic evaluation.They can also be used to objectively and authentically reveal the nature and degree of contribution of the cited paper reflected by citation,beyond simple citation statistics.Practical implications:The evidence-based evaluation tool CiteOpinion can provide an objective and in-depth academic value evaluation basis for the representative papers of scientific researchers,research teams,and institutions.Originality/value:No other similar practical tool is found in papers retrieved.Research limitations:There are difficulties in acquiring full text of citing papers.There is a need to refine the calculation based on the sentiment scores of citing sentences.Currently,the tool is only used for academic contribution evaluation,while its value in policy studies,technical application,and promotion of science is not yet tested.
基金supported by National Key R&D Program of China(Grant No.2019YFA0707201)the open fund of ISTIC-Springer Nature Joint Lab for Open Science(Grant No.HX20211292).
文摘Purpose:The 5th Plenary Session of the 19th Communist Party of China(CPC)Central Committee clearly states that developing science and technology through self-reliance and self-strengthening provides the strategic underpinning for China’s development.Based on this background,this paper explores a metric model for assessing national scientific research strength through collaboration on research papers.Design/methodology/approach:We propose a novel metric model for assessing national scientific research strength,which sets two indicators,national scientific self-reliance(SR)and national academic contribution(CT),to reflect“self-reliance”and“self-strengthening”respectively.Taking the research papers in quantum technology as an example,this study analyzes the scientific research strength of various countries around the world,especially China in quantum technology.Findings:The results show that the research of quantum technology in China has always been relatively independent with fewer international collaboration papers and located in a more marginal position in cooperation networks.China’s academic contribution(CT)to global quantum technology research is increasing and has been greater than that of the United States in 2020.Combining the two indicators,CT and SR,China’s research strength in the quantum field closely follows the United States,and the United States is the most powerful with high research autonomy.Research limitations:This paper only reflects China’s scientific research strength in quantum technology from collaboration on research papers and doesn’t consider the segmentation of quantum technology and the industrial upstream and downstream aspects,which need further study.Practical implications:The model is helpful to better understand the national scientific research strength in a certain field from“self-reliance”and“self-strengthening”.ScienceOriginality/value:We propose a novel metric model to measure the national scientific research strength from the perspective of“self-reliance”and“self-strengthening”,which provides a solid basis for the assessment of the strength level of scientific research in countries/regions and institutions.
