National Taiwan Normal University
教育心理學報  回首頁
Apycom jQuery Menus
39S publication date:Feb, 2008
The Reliability of Information Literacy Portfolio Assessment in the Primary Grades
    Author:張郁雯 Yuwen Chang
Research Article

   This article reports on the reliability of information literacy portfolio assessment in the primary grades. Three central questions were examined: (1) how reliable are total scores of information portfolio? (2) how reliable are scores of big six skills? and (3) what are probable sources of unreliability? Do teachers who rate their own students’ work systematically score differently than do outside raters? The framework of information portfolio was based on the big six skills approach. This assessment was based on a sample of approximately 70 portfolios integrated three learning areas for students in Grades 3 and 5: language arts, mathematics, and science and technology. The teachers were required to collect each student’s portfolio for 3 semesters. The products of portfolios in each learning areas were rated by 3 raters: the student’s classroom teacher, a teacher of the same primary school, and an external reviewer. Results indicated that most of the generalizability coefficients for total scores were above 0.75 across learning areas and semesters with a single rater. The dependability coefficients revealed a similar pattern with slightly lower size. Variance in scores of each processing dimension was attributed to individual difference, processing dimension, interaction of individual difference and dimension, and interaction of individual difference, dimension, and rater. The generalizability coefficients for the six-dimensional task were around 0.5 to 0.6. The results indicated that instructional planning based on scores of specific information skill should be questioned. In general, the correlations between classroom teachers were higher than those between classroom teachers and external raters. Classroom teachers tended to rate student portfolios higher than did external raters; however, these differences were small. This study showed that given a solidly structured portfolio, teachers can reliably rate their students’ work.


 

下載


關鍵詞: dependability coefficient, generalizability coefficient, information literacy, portfolio assessment, reliability


Survey Mode Effect Analyzed by Item Response Theory on the Center for Epidemiological Studies Depression (CES-D) Scale

Copyright © 2024 Bulletin of Educational Psychology
Address: No. 162 Hoping E. Rd. Sec. 1, Taipei 10610, Taiwan, R.O.C.
Tel: (02) 77493757, Fax: (02) 23413865, Email: t05002@ntnu.edu.tw
All rights reserved. BEISU Design