从多元概化理论看高考综合能力测试的改进被引量：27

MULTIVARIATE GENERALIZABILITY ANALYSIS OF THE CHINESE COLLEGE ENTRANCE COMPREHENSIVE EXAMINATION

下载PDF

导出

摘要通过多元概化理论的研究发现 ,高考综合能力测试 (2 0 0 1,广东 )的总体信度达到了可以接受的水平(0 .784 )。但测验中各部分对总方差的贡献程度与预定的赋分比例有较大差距。其中 ,地理和政治的贡献度偏低 ,化学和历史的贡献度偏高。这表明有 (历史和化学 )偏科特点的考生得到了较高的综合分数。又经决策 (D)研究发现 ,增加地理部分的题量会反常地降低测验的总体信度 ,这说明有不少高分考生答错或主动放弃了地理科题目。因此 ,如何有效控制各部分的实际贡献程度、避免负面导向效应是当前高考综合能力测试亟待解决的问题。 The Chinese College Entrance Comprehensive Examination (CCECE), which consists of Geography, History, Political Studies, Biology, Chemistry and Physics, is a comprehensive achievement test to measure an examinee's academic readiness for tertiary education. This study used multivariate generalizability theory to estimate generalizability (reliability) coefficients of the CCECE. The G-study and D-study results suggested that the generalizability coefficient of the whole test was 0.78, which was considered moderate but acceptable. Doubling the items for all the subtests would increase generalizability coefficient to 0.88. Except for geography and political studies, reliability estimates for the subtests were acceptable. However, a composite universe score approach was not ideal both because variance distributions among subtests were inconsistent with the planned score weighting and because correlations among some subtests were low. For example, chemistry and history accounted for more variance than other subtests combined. Among the problematic subtests, geography contributed negatively to reliability of the whole test.

作者杨志明张雷马世晔

机构地区湖南师范大学心理学系 PMG 香港中文大学教育心理学系中华人民共和国教育部考试中心信息科研处

出处《心理学报》 CSSCI CSCD 北大核心 2004年第2期195-200,共6页 Acta Psychologica Sinica

基金教育部考试中心十五科研课题

关键词测量信度多元概化理论高考综合能力测试 Multivariate Generalizability Theory, reliability, College Entrance Comprehensive Examination.

分类号 B841 [哲学宗教—基础心理学] G44 [哲学宗教—发展与教育心理学]

引文网络
相关文献

参考文献13

1[1]Brennan R L. Generalizability theory. New York: Springer-Verlag, 2001
2[3]Brennan R L. An essay on the history and future of reliability from the perspective of replications. Journal of Educational Measurement, 2001, 38(4): 295～317
3[4]Brennan R L, Xiaohong G, Colton D A. Generalizability analyses of work keys listening and writing tests. Educational and Psychological Measurement, 1995, 55(2): 157～176
4[7]Cronbach L J, Gleser G C, Nanda H, Rajaratnam N. The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley, 1972
5[8]George W J, Wordword J A. Some developments in multivariate generalizability. Psychometrika, 1976, 41(2): 205～217
6[9]Nubbaum A. Multivariate generalizability theory in educational measurement: An empirical study. Applied Psychological Measurement, 1984, 8(2): 219～230
7[10]Rajaratnam N, Cronbach L J, Gleser G C. Generalizability of stratified-parallel Tests. Psychometrika, 1965, 30(1): 39～56
8[11]Shavelson R J, Webb N M. Generalizability theory: 1973-1980. British Journal of Mathematical and Statistical Psychology, 1981, 34: 133～166
9[12]Shavelson R J, Webb N M. Generalizability theory: A Primer, Newbury Park, CA: Sage, 1991
10[13]Webb N M, Shavelson R J, Maddahian E. Multivariate generalizability theory. In: L J Fyans ed. New directions for testing and measurement: Generalizability theory: Inferences and practical application (No. 18). San Francisco: Jossey-Bass, 1983