摘要
[目的/意义]为保障国家预印本平台论文质量,需引入同行评议。近年来自组织同行评议逐渐受到关注。为达到国家预印本平台管理机构预期的性能表现,需要研究自组织同行评议关键参数优化设计。[方法/过程]以论文评议完成率(CR)、评议人任务分配均衡度(TBD)、论文平均评议时间(A_r_time)为自组织同行评议性能评价的3个因变量,评议人休息时间、评议人拒审率、作者人数、评议资格比例4个关键参数为自变量,对Box-Behnken抽样设计得到数据进行响应面分析,得到性能评价因变量与关键参数自变量的量化表达关系式。[结果/结论]通过4个关键参数自变量取值不同组合,国家预印本论文平台可以调整自组织同行评议的3个性能参数表现,保障国家预印本平台发布论文平均质量。
[Purpose/Significance]The National Preprint Publishing Platform of China had been put into operation by the end of 2022.In order to ensure the quality of papers posted on the Platform and encourage a large number of researchers to submit articles to the Platform,it is necessary to introduce a paper quality assurance mechanism into the Platform.There are deficiencies in existing quality assurance mechanism for a preprint publishing platform.Self-organizing peer review has gradually attracted attention in recent years.In order to achieve the performance expected by the management agency of the National Preprint Publishing Platform,it is necessary to study the optimization design of key parameters of self-organizing peer review.[Method/Process]Design-expert software has been used for Box Behnken experimental design.The number of papers submitted by authors within a year,the distribution of review time,and the parameters of article review time are randomly set.The total number of papers is calculated according to the parameters of Lotka's law,and is not included in the Box-Behnken experimental sampling.We selected four key parameters of rest time,rejection rate,number of researchers,and review qualification ratio as independent variables,took three levels for each variable,and used-1,0,+1 for coding,representing three levels of low,medium,and high,respectively.The three dependent variables for self-organizing peer review performance evaluation are the completion rate of paper review(CR),the balance of reviewer task allocation(TBD),and the average review time of the paper(A_r_time).A Box-Behnken experiment table was designed separately for each Lotka's law parameter,three repeated experiments were conducted on each key parameter combination in the table,and the summary()function and mean()function in R language were used to calculate the average performance indicators of each key parameter combination.Then,the response surface analysis was carried out on the Box-Behnken sampling data,and the quantitative relationship expression between the dependent variable of performance evaluation and the independent variable of key parameters was obtained.[Results/Conclusions]The ratio of review qualifications and reviewer rest time have greater impact on the performance of self-organized peer review,especially the ratio of review qualifications is much more important than other three key parameters.By combining different values of key parameter independent variables,the National Preprint Publishing Platform can achieve the expected self-organized peer review performance,ensuring the average quality of papers published by the Platform.In addition,because of our limited knowledge of computational resources,there is still room for improvement in simulation accuracy.If equipped with more powerful computational resources,more precise simulation calculation can be carried out based on the methods and parameters proposed in this paper.
作者
王凌峰
王申鹏
WNAG Lingfeng;WANG Shenpeng(Business School,Guilin University of Electronic Technology,Guilin 541004)
出处
《农业图书情报学报》
2023年第7期75-84,共10页
Journal of Library and Information Science in Agriculture
基金
国家自然科学基金项目“预印本数据库环境下开放同行评议机制研究”(71563007)
桂林电子科技大学研究生教育创新计划基金项目“预印本2.0与期刊评议速度差异定量建模分析”(2022YCXS120)。
