How helpful is cold-calling?
One of the initiatives introduced this semester is cold calling each student at some point. This way, we can sample understanding across the classroom, including students who may not volunteer. Calling only on students who volunteer may skew the instructor’s perception of students’ understanding.
[Instructor’s note: I experienced this technique as a student in Josh Angrist’s econometrics lecture, MIT 14.387, in Spring of 2017. SK]
What we tried
To begin the cold-calling, Shiro begins at a randomly chosen point in the room and then moves through students in seating order. Most exchanges are brief, but he sometimes stays with a student, offering follow-up questions and prompts to help them develop an answer. The aim is both to understand students’ thinking and to scaffold their reasoning toward a clearer explanation. In the age of AI, Shiro wants students to practice their oral fluency and thinking-on-their-feet (hence why we also introduced oral exams).
What we noticed
Since this is the first time our class is trying out the cold-calling, we learned a few insights. Before even starting with the questions, sharing an example of how to approach the problem guides students to attempt the problem on their own. It is very important to ask clear questions. When students are not sure how to respond, they will say they don’t know or their body language will show their confusion. Being quick to move onto the next student helps not bog down the momentum for the class; it’s a skill to discern when to engage more with a student on a particular question and when to move on. If several students are not sure (and, especially after calling on voluntary student responses that are mistaken), the instructor should step in with presenting the right solution. In the times when Shiro and the student engage in a back-and-forth, a recap for the rest of the class to follow is helpful, especially when it is rewritten on the board.
When I interviewed one of the students about their experience in the class, especially how they feel about the cold-calling, they mentioned they appreciated the supportive approach to cold calling since they feel like it’s okay if they don’t know. Still, they suggested that concepts should be fully explained before students were asked to apply them.
What we would change
To streamline the questions, it could help to prepare a sequence of cold-call questions based on the lecture problems during lesson preparation. Since coming up with the questions on the spot could create more confusion if it is not a clear question or building up in logical sequence.
For a key concept, give students a moment to think individually, then open the class to the turn-and-talk with a neighbor before calling on students to share. This gives everyone an opportunity to attempt the reasoning, compare their approaches, and rehearse an explanation.
Trying to scaffold a student’s response by asking pointed questions helps. As their answers get warmer, other students could be inspired with the correct answer.
Participation in the class
From sitting in the class, I observe substantial engagement from students during lectures, as they asked questions, contributed their experiences, and responded to one another’s ideas. In future posts, I will share some of the pedagogical strategies used in the course to promote engagement, such as pre-class quizzes.