The development and validation of a three-tier diagnostic test measuring pre-service elementary education and secondary science teachers' understanding of the water cycle

Abstract

The main goal of this research study was to develop and validate a three-tier diagnostic test to determine pre-service teachers' (PSTs) conceptual knowledge of the water cycle. For a three-tier diagnostic test, the first tier assesses content knowledge; in the second tier, a reason is selected for the content answer; and the third tier allows test-takers to select how confident they are in their answers for the first two tiers. The second goal of this study was to diagnose any alternative conceptions PSTs might have about the water cycle. The Water Cycle Diagnostic Test (WCDT) was developed using the theoretical framework by Treagust (1986, 1988, and 1995), and in similar studies that developed diagnostic tests (e.g., Calean & Subramaniam, 2010a; Odom & Barrow, 2007). The final instrument consisted of 15 items along with a demographic survey that examined PSTs' weather-related experiences that may or may not have affected the PSTs' understanding of the water cycle. The WCDT was administered to 77 PSTs enrolled in science methods courses. Using exploratory factor analysis, five categories were factored out for the WCDT. Analysis of the PSTs' responses demonstrated acceptable reliability, difficulty indices, and discrimination indices. In addition, the analysis of the PSTs' responses revealed 49 potential alternative conceptions and areas where PSTs' lack of knowledge was revealed from the WCDT.