professional: z -scores: no reliable differences (for relevance, web > professional with marginal significance) z -scores with removal of questions with high inter-rater variability: no reliable differences on pedagogy and depth Medians: for fluency and ambiguity, web > professional If these ratings from 12 biology students can be trusted as proxies for the pedagogical quality of the questions, it appears that all three sources are equally beneficial on the whole.
1
—
—