期刊文献+

标准参照测验决策一致性指标研究的总结与展望 被引量:10

A Review of Decision Consistency Indices of Criteria-Reference Test
原文传递
导出
摘要 决策一致性指考生在两次平行测验中被一致归类的程度,是衡量标准参照测验质量的重要指标。到目前为止,基于经典测量模型和项目反应模型,研究者已经提出了数十种估计决策一致性指标的方法,并对这些方法的优劣进行了比较。由于模型基础和对分数分布的假设不同,各种方法适用于不同的测验情境。未来的研究应当对已有方法进行验证,并探讨决策一致性在教育测量中的应用途径,为教育和心理测量工作者估计测验的决策一致性指标提供凭据。 This paper presented an overview of various procedures for estimating single-administration decision consistency index which is an important quality standard of criterion-referenced test.Researchers have proposed dozens of estimation methods based on classical test theory or item response theory,and have made some comparisons among them.Future studies should focus on validating these methods and exploring its application in educational measurement,providing psychometricians with a basis for choosing the appropriate estimation method for decision consistency in particular situation.
出处 《心理发展与教育》 CSSCI 北大核心 2011年第2期210-215,共6页 Psychological Development and Education
基金 教育部新世纪优秀人才支持计划(NCET-07-0097) 全国教育科学规划考试专项(GFA097004)
关键词 决策一致性 信度 p系数 Kappa系数 decision consistency reliability index p index Kappa
  • 相关文献

参考文献17

  • 1AERA, APA, & NCME ( 1999 ). Standards for educational and psycho- logical testing. Washington, DC : Author. 35 - 36.
  • 2Brennan, R.L. (2003). Coefficients and indices in generalizability theo- ry(CASMA Research Report No. 1). Iowa City, IA: Center for Ad- vanced Studies in Measurement and Assessment, The University of lo4 wa. (Available on http://www, education, uiowa, edu/easma).
  • 3Brennan, R. L. , & Wan, L. ( 2004 ). A bootstrap procedure for estima- ting decision consistency for single-administration complex assessments (CASMA Research Report No. 17). Iowa City, IA: Center for Ad- vanced Studies in Measurement and Assessment, The University of Io- wa. (Available on http://www, education, uiowa, edn/casma).
  • 4Crocker, L. M., & Algina, J. (1986). Introduction to classical and modern test theory. Belmont in USA : Thomson Learning Academic Re- source Center, 192 - 211.
  • 5Hanson, B. A. ,& Brennan, R. L. (1990). An investigation of classifi- cation consistency indexes estimated under alternative strong true score models. Journal of Educational Measurement, 27 (4) ,345 - 359.
  • 6Lee, W. C. , et al. (2002). Estimating consistency and accuracy indi- ces for multiple classifications. Applied Psychological Measurement, 26 (4),412-432.
  • 7Lee, W. C. ( 2005 ). Classification consistency under the compound multt] nomial model( CASMA Research Report No, 13). Iowa City, IA: Ce~ ter for Advanced Studies in Measurement and Assessment, The Unive1 sity of Iowa. (Available on http://www, education, uiowa, edu/casI ma). /.
  • 8Lee, W. C. (2005a). Classification consistency and accuracy for com- plex assessments using item response theory ( CASMA Research Report No. 27). Iowa City, IA : Center for Advanced Studies in Measurement and Assessment, The University of Iowa. (Available on http://www. education, uiowa, edu/casma).
  • 9Lee, W. , & Kolen, M. J. (2008b). IRT CLASS: A computer program for item response theory classification consistency and accuracy ( Version 2.0) [ Computer software]. Iowa City, IA : University of Iowa, Center for Advanced Studies in Measurement and Assessment. ( Available on http ://www. education, uiowa, edu/casma)..
  • 10Li, S. 1t. (2006). Evaluating the consistency and accuracy of proficiency classifications using Item Response Theory. Unpublished doctoral disser-tation, University of Massachusetts Amherst.

二级参考文献18

  • 1American Educational Research Association,American Psychological Association,& National Council on Measurement in Education.Standards for educational and psychological testing[]..1999
  • 2Glaser,R.Instructional technology and the measurement of learning outcomes[].American Psychologist.1963
  • 3Hambleton,R.K,,& Novick,M.Toward anintegration of theory and method for criterion-referenced tests[].Journal of Educational Measurement.1973
  • 4Hanson,B.A,& Brennan,R.L.An investigation of classifi- cation consistency indexes estimated under alternative strong true score models[]..1990
  • 5Livingston,S.A,& Lewis,C.Estimating the consistency and accuracy of classifications based on teat scores[].Journal of Educational Measurement.1995
  • 6Rudner,L.M.Computing the expected proportions of misclas- sifted examinees[].Practical AssessmentResearch & Evaluation.2001
  • 7Rudner,L.M.Expected classification accuracy[].the annual meeting of the National council on Measurement in Education.2004
  • 8Subkoviak,M.J.Estimating reliability from a single adminis- tration of a criterion-referenced test[].Journal of Educational Measure- ment.1976
  • 9Swaminathan,H,Hambleton,R.K,& Algina,J.Reliability of criterion-referenced tests:a decision-theoretic formulation[].Journal of Educational Measurement.1974
  • 10Huynh,H.On the reliability of decision in domain-referenced testing[].Journal of Educational Measurement.1976

共引文献9

同被引文献78

引证文献10

二级引证文献58

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部