Assessments and Learning Progressions

While grading an exam, in a basement with a handful of fellow teaching assistants, I had a debate with a TA about a student’s response and whether it is worth a certain number of points, I argued against the points, this person argued for them. After asking the instructor, our boss, the points where not rewarded to the student. This person expressed dissatisfaction about the outcome. I, attempting to help them understand why such outcome was reached, asked them to consider the response as an argument from evidence, and the question we must answer is do we have enough evidence to make the claim that this student understand the concept the test question is attempting to assess. This person agreed with my statement but affirmed that this student had shown they understand. This was the end of the conversation, but I wish I could have asked them what concept they thought this question was assessing, maybe that would have helped them understand. Isn’t it funny that we relive moments that we want to change, for some preferable outcome.

Learning is a latent variable; we must observe and measure it indirectly using some form of assessment. What are we observing through these assessments if not learning? That depends on the purpose of the assessment. This is where learning objectives enter the picture. I see learning objectives and assessments intertwined. Any educational endeavors should have an objective. Learning objectives are things that, after the educational endeavor, educators want students know and can do. Learning objectives can be facts or skills, or more preferably they are things students can do with their knowledge. Why use of knowledge? Well, memorization is a terrible way to learn and with what reliable data we do have in education research, using knowledge to predict and explain is better at helping students to build an explanatory framework of how the world works (Crandell et al., 2020; Houchlei et al., 2021). If this use of knowledge is structured to promote expert-like reasoning, students are engaging in three-dimensional learning.
In an assessment aligned with the three dimensions, the assessment has the potential to elicit evidence of student engagement with those three dimensions (Laverty et al., 2016). Therefore, we hope to observe knowledge in use. Many questions remain, such as what knowledge, how is it being used to what end? But nevertheless, this is a proxy for learning, students’ ability to use knowledge to predict, explain, describe, model, etc. How do students learn to use their knowledge, or rather, how do students enter and leave a course gaining such abilities?

A proposed mechanism is learning progressions, in which a class goes through topics that build on one another in a way which students require the previous knowledge from an early topic to understand a future topic within the same learning progression. While reading Paulo Freire’s Pedagogy of the Oppressed (Freire, 1968), a thought occurred to me, does the idea of learning progressions negate the ability to use student knowledge, to get them to recognize they know things? Learning progressions follow a lineage of topics which assume a linear path of knowing, using only knowledge gained from the course. How might this negate my ability to incorporate student voices in a course?

References

Crandell, O. M., Lockhart, M. A., & Cooper, M. M. (2020). Arrows on the Page Are Not a Good Gauge: Evidence for the Importance of Causal Mechanistic Explanations about Nucleophilic Substitution in Organic Chemistry. Journal of Chemical Education, 97(2), 313–327. https://doi.org/10.1021/acs.jchemed.9b00815

Freire, Paulo. (1968). Pedagogy of the Oppressed. Seabury Press.

Houchlei, S. K., Bloch, R. R., & Cooper, M. M. (2021). Mechanisms, Models, and Explanations: Analyzing the Mechanistic Paths Students Take to Reach a Product for Familiar and Unfamiliar Organic Reactions. Journal of Chemical Education, 98(9), 2751–2764. https://doi.org/10.1021/acs.jchemed.1c00099

Laverty, J. T., Underwood, S. M., Matz, R. L., Posey, L. A., Carmel, J. H., Caballero, M. D., Fata-Hartley, C. L., Ebert-May, D., Jardeleza, S. E., & Cooper, M. M. (2016). Characterizing College Science Assessments: The Three-Dimensional Learning Assessment Protocol. PLOS ONE, 11(9), e0162333. https://doi.org/10.1371/journal.pone.0162333