한국어 작문 평가 채점의 타당도 검증: 다국면 Rasch 측정 모형 활용

서지정보

· 발행기관 : 한국외국어교육학회
· 수록지 정보 : 외국어교육 / 21권 / 3호
· 저자명 : 이영식

목차

I. 서론
II. 다국면 Rasch 측정 모형의 이론적 배경과 최근의 Facets 프로그램
III. 다국면적 Rasch 측정 모형을 이용한 선행 연구
IV. 연구방법
1. 수험자
2. 시험문제
3. 채점자 및 채점
V. 분석결과
1. 데이터 요약(Data Summary)
2. 모든 국면의 분석 결과(All Facet Vertical “Rulers”)
2. 채점의 부적합(misfit) 및 과적합(overfit)
3. 사용된 단계의 적합성(Category Statistics)
4. 채점결과 비신뢰성의 검증(Unexpected Responses)
VI. 결론
참고문헌
<부록> 한국어 서술문 시험 채점 기준표

영어초록

This paper aims to analyze the scores assigned to compositions of Korean as a foreign language (KFL) in terms of the many-facet Rasch measurement (MFRM) model. The MFRM computer program Facets has recently been updated and this research uses it in order to investigate the scoring reliability of KFL writing test. For the research data the Korean compositions written by 270 KFL learners were collected and rated by eleven Korean raters. At first a brief theoretical basis for the Facets is introduced based on the MFRM model. Then focusing on the raters’ characteristics such as rating consistency and fitness in terms of the rating scheme of content/organization and language, the collected scores of KFL compositions are analyzed and the analysis results are interpreted. As a result, a few cases of unreliable scoring of Korean raters are identified, but it appears that the ratings of Korean raters for a standardized KFL writing test are generally reliable. Finally it is suggested that the Facets program of MFRM offer many potential advantages for validating the scoring reliability of Korean writing assessment.

참고자료

· 없음