EngageCSEduThe beautiful noise of peer instruction

OPINION by Beth A. Quinn, University of Colorado at Boulder EngageCSEdu The Beautiful Noise of Peer Instruction: An Interview with Beth Simon T he National Center for Women & Information Technology (NCWIT) recommends three general ways to retain women and underrepresented minorities in computing through improved pedagogy and content. We call them “Engagement Principles.” One that we’ve been focusing on in recent columns—and that you can explore on NCWIT’s EngageCSEdu platform [4]—is “Grow Inclusive Student Community.” A key way to do this is by using well-structured collaborative learning techniques. In this issue, we explore Peer Instruction, a technique with a large body of research in STEM education. We asked Professor Beth Simon from the University of California, San Diego, who both uses and researches Peer Instruction, to give us an introduction. (The following interview has been edited for clarity and length.) tions. These are not graded—and this is important—so students just have to participate to get points. I pose a question on a slide and individuals vote. Then, they discuss with their partners. Meanwhile, TAs are running around listening to the discussions and answering any questions. At the end of the discussion period, students re-vote and we discuss as a group. (See Figure 1.) Out of an 80-minute class there usually will be 45-50 minutes where students are talking! Another thing that I do between the first and second vote is talk about maintaining a growth mindset [2,5]. I say, “Not everybody gets it right the first time. Computer science is about being able to figure it out. That’s the skill that we’re developing.” WHY SHOULD FACULTY CONSIDER ADOPTING PEER INSTRUCTION? Consider your own best learning experiences. Ask any faculty member and usually they’ll talk about collaborating with other people in graduate school. So, if that’s your most successful learning experience, why wouldn’t you want to have that with your students? But we’re not using open-ended collaborative projects like in graduate school. We’re going to give students a taste of this kind of experience with these teeny, little collaborative things: the clicker questions. They won’t go off topic because you’re only giving them two minutes. I was hesitant at first to use Peer Instruction because I didn’t think it was going to The Interview WHAT DOES PEER INSTRUCTION LOOK LIKE IN AN INTRODUCTORY COMPUTER SCIENCE CLASSROOM AT UCSD? First, I have students do the reading outside of class. Then, I start class by giving them a few graded quiz questions via clickers [9]. I make sure the questions cover just the basic content students need know to engage in the discussion. And because I give it with clickers, I get immediate feedback. If they’re having trouble with anything, I can address it then. For the rest of class, students work through Peer Instruction “clicker” ques- Figure 1: The PI Process (from B. Simon) acm Inroads • inroads.acm.org 19 OPINION The Beautiful Noise of Peer Instruction: An Interview with Beth Simon HOW CAN FACULTY GET STARTED? A beginner’s way to start is by using a method called the “two-minute pause.” You don’t have to have the questions yet or the clickers. You simply set your phone to go off every ten minutes or so throughout the class. You stop when it goes off—I don’t care if you’re in mid-sentence—and you tell students that they have two minutes to catch up with the person next to them and to fix their notes. During this two-minute pause, you wander around, listen, and answer questions. Honestly, your teaching evaluations are going to go up 5-10% by just doing that. You’re telling students: I’m stopping to listen to you, to help you catch up, and to clear things up. Then, when you teach this class the next time, think about what you could ask students during these two-minute pauses. Do they know this or that? What misconceptions are coming up? That knowledge will make up the core of the clicker questions. SAY MORE ABOUT WRITING ‘CLICKER QUESTIONS’ Writing the clicker questions is the magic sauce. Absolutely. With the Peer Instruction model, I put my knowledge of what students tend to struggle with and put it into clicker questions. For example, most kids have trouble with ‘for loops’ because of these four things. So, I try to encapsulate that in my questions (see Figure 2). One issue I’ve seen is that faculty tend to write questions that are too easy. But if it’s a good Figure 3: Student groups in a lecture hall setting 20 acm Inroads 2018 June • Vol. 9 • No. 2 clicker question, only 30-65% of students should get it on the first vote. There should be something to learn from discussion. But you don’t have to do it all by yourself. We’ve got a website with a whole range of things you can adopt or adapt [6]. Figure 2: Example of a “clicker question” HOW CAN YOU IMPLEMENT PEER INSTRUCTION TO SUPPORT WOMEN STUDENTS? The first time I did Peer Instruction I happened to have a postdoc interviewing my students for another reason. And some women reported that the guys wouldn’t talk with them during discussions. I’m like, “What have I done?!” So first, you MUST assign groups. In a lecture hall, that requires that all of your seats are numbered so you can assign seats. We didn’t, so I got the head of UCSD’s educational technology group on board, and told him, “I need to have numbered seats.” And he did it. Also, really, you need to make groups of all women. 100%. After the first course, it’s not as important, PHOTO: ©WWW.ISTOCKPHOTO.COM/SKYNESHER change my class much. I have a really engaging classroom! But because of Carl Wieman and all the research, e.g., [1], I gave it a try. So, the first time, when I said to the students, “Okay, everybody, turn and discuss with the person next to you,” the classroom exploded with noise! I didn’t think a classroom could be like that. It was shocking! I literally texted Carl right then: “You were right.” Another story: My advisor from graduate school was going to retire in a year but, surprisingly, she came to me and said, “Beth, I want to use Peer Instruction. Your data says that we should do this.” A few years later, her husband tells me, “You know, Beth, Jeanne taught for three more years because she was really enjoying it.” It really changed the teaching part of her job. I think a lot of faculty imagine that this is what teaching is going to be like: engaging with students around difficult, interesting questions. But they end up standing up there lecturing and feeling like they don’t know if students are understanding. I tell people that it’s okay because they don’t teach mind reading in graduate school! But with clickers, you don’t have to; you have their votes. You have the data [11]. but for the first one, you really do. Another thing you can do is pick a set of icons. I usually have a triton (for UCSD), a coffee cup (for Java), and a bug. Then, have each individual in a group pick one. Then every day I pick one and say, “All the coffee cups, raise your hand. Okay, you all are starting discussion today.” It gives authority to that person to step up and start the discussion when it’s time. Beth Quinn: Absolutely, using named roles empowers those individuals to speak. And your TAs, with a little training, can help facilitate good communication within the teams. They can learn to watch for people being closed out and the body language that comes with it. Final thoughts? Peer Instruction is absolutely the number one recommendation I give to faculty. It’s closest to their natural practice. It gets the least kickback from students. You can do it in a lecture hall. And when you try it, stop for a moment and listen during the student discussions. They’re talking. All the way to the back! I had no idea you could have a classroom like that. And guess what? They’re learning [7,8]! “… stop for a moment and listen during the student discussions. They’re talking. All the way to the back! I had no idea you could have a classroom like that. And guess what? They’re learning!” Next steps • Check out more of the interview with Beth Simon on NCWIT’s website [9]. Learn more about Peer Instruction on • the website created by Beth Simon and her colleagues [6]. • Explore a full range of collaborative learning techniques, like Peer Instruction, on EngageCSEdu [3,4] and find peer-reviewed introductory computer science course materials using these techniques.  Acknowledgments The author would like to thank Beth Simon for her time and her insight, the social science team at NCWIT for jointly crafting the evidence-based Engagement Practices Framework which serves as the backbone of EngageCSEdu, and to Google for providing funding for development of the EngageCSEdu platform. References 1. Crouch, C. H. and Mazur, E. Peer Instruction: Ten years of experience and results. American Journal of Physics 69, 9 (2001), 970–977. 2. Dweck, Carol. What Having a “Growth Mindset” Actually Means. Harvard Business Review (January 13, 2016); http://thebusinessleadership.academy/wpcontent/uploads/2017/03/What-Having-a-GrowthMindset-Means.pdf. Accessed 2018 January 15. 3. EngageCSEdu, Collaborative Learning; https://www. engage-csedu.org/engagement/grow-positivestudentcommunity/collaborative-learning. Accessed 2018 February 15. 4. EngageCSEdu; https://www.engage-csedu.org. Accessed 2018 March 07. 5. National Center for Women & Information Technology. NCWIT Tips: 8 Ways to Give Students More Effective Feedback Using a Growth Mindset (2014); www.ncwit.org/feedbackstudent. Accessed 2018 January 15. 6. Peer Instruction for Computer Science; http://www. peerinstruction4cs.org. Accessed 2018 February 1. 7. Porter, L., Bailey-Lee, C. and Simon, B. Halving Fail Rates using Peer Instruction: A Study of Four Computer Science Courses. Proceedings of the Special Interest Group on Computer Science Education (SIGCSE) Technical Symposium, March (2013), 177–182. 8. Porter, L., Bouvier, D., Cutts, Q., Grissom, S. Lee, C. McCartney, R., Zingaro, D. and Simon, B. A MultiInstitutional Study of Peer Instruction in Introductory Computing. Proceedings of the Special Interest Group on Computer Science Education (SIGCSE) Technical Symposium, March (2016), 358–363. 9. Quinn, B.A. More from the 2018 Interview with Beth Simon on Peer Instruction; https://www.ncwit.org/ MoreBethSimonInterview. Accessed 2018 April 15. 10. University of Colorado Science Education Initiative and the UBC Carl Wieman Science Education Institute. Clicker Resource Guide: An Instructor’s Guide to the Effective Use of Personal Response Systems (Clickers) in Teaching; https://www. colorado.edu/sei/fac-resources/files/Clicker_guide_ CWSEI_CU-SEI.pdf. Accessed 2018 February 10. 11. Wieman, C. and Gilbert, S. Taking a Scientific Approach to Science Education, Part I. Microbe, 10, 4 (2015), 152–156. Beth A. Quinn University of Colorado at Boulder National Center for Women & Information Technology [email protected] DOI: 10.1145/3194243 COMMUNICATIONSAPPS OPINION Access the latest issue, past issues, BLOG@CACM, News, and more. Available for iPad, iPhone, and Android Available for iOS, Android, and Windows http://cacm.acm.org/ about-communications/ mobile-apps Copyright held by authors. acm Inroads • inroads.acm.org 21