A student approached me after the Western Civilization quiz today, a little upset because she felt that the quiz relied on information contained in the assigned readings for next week--not this week. I was briefly dismayed and chagrined, because I had two weeks notice to pull this class together, moving from quizzes, lectures, and a syllabus written around the previous Western Civ textbook to a new textbook--with a somewhat different organization.
I just spent the last half hour going through the quiz, and trying to find where the students could have expected to find the information. Except for one question, every question had a slide from lectures (visible to the students throughout this week) or a set of pages in the assigned reading that directly answered the question.
One question asked the students to distinguish Egyptian and Mesopotamian beliefs in an afterlife. The new textbook has a good discussion of Egyptian afterlife ideas but was silent about Mesopotamian afterlife beliefs (unlike the old textbook). I'll take a look to see how many students gave the wrong answer on that question, but overall, I feel pretty good about the traceability of the quiz. I may add citations to future quizzes so that students know where they should have been able to find this information--and just like good software has traceability from requirements all the way through final delivery to the customer, college tests should do so as well.