A New (to Me!) Way of Using Graduate Students in an Apprenticeship Model

Within our department, there are graduate students who are interested in enhancing their teaching credentials either because they believe that such enhanced credentials will give them a leg up on the traditional academic job market, or because they see themselves ultimately pursuing a teaching focused career. Moreover, due to sabbaticals etc., our department sometimes needs graduate students to serve as the instructor of record for courses both during the standard fall and spring academic semesters, as well as during our summer and winter online sessions. While the 691G course I created for incoming for graduate students provides some introduction to the principles of active learning via the physics education research literature, there is no mechanism currently in place at UMass for such students to get additional formal training in teaching. To help meet this need, I shifted my TA usage, from primarily serving as a student resource in class and during office hours, to more of an apprenticeship model giving GTAs both an under-the-hood look at running a large-enrollment introductory course and experience in front of such a classroom. I specifically want GTAs to get experience in this particular environment as such courses are both generally part of the workload for instructional faculty and an experience that most early-career research-focused faculty lack. In this model, the GTA still serves as an in-class assistant, but instead of out-of-class office hours, they meet with me for two hours after each class to help with the logistics of running such a course and planning the next day’s lesson.

When graduate students have served as primary instructors for our department in the past, they often do excellently in front of the classroom. Their lectures are well thought out, the figures well designed, the problems carefully considered, and the exams fair and well built. Some of our graduate students have even explored some active learning and alternative grading techniques in their own courses. I believe this expertise comes from their many years both as a student and as serving as in class GTAs for courses at UMass Amherst.

However, almost all our graduate students serving as primary instructors have also stumbled with what I call under-the-hood management of such horses. For example, one postdoctoral scholar serving as a primary instructor a few years ago scheduled his night exams 4/6 PM to 8:00 PM. His rationale for this time slot was that the more common 7:00 to 9:00 PM was a bit late; he said he would not have liked to take an exam that late at night, and so it seems unreasonable to ask his students to do so as well. While I fundamentally agree with this reasoning, such a choice greatly increased the difficulty that this postdoctoral scholar had to deal with regards to exam administration. At UMass Amherst, the 7:00 to 9:00 PM slot is reserved for night exams. Consequently, exams scheduled during this time slot take precedence over most other university activities classes labs etcetera. In contrast, exams scheduled outside of this window have a lower priority than other university activities requiring the instructor who scheduled such an exam to give the makeup. While giving makeup exams in a small class of approximately 20 or so is not a significant challenge, the logistical complexity increases dramatically with class sizes of several hundred. If this postdoctoral scholar had engaged in some sort of deeper, more formal training with regards to teaching, then he would have known about this rule and could have made at least a more informed decision.

Another challenge many of our graduate students in teaching roles have come across, and one that I myself came across as a new instructor, is familiarity with the slew of active learning techniques that can be employed in a classroom of several hundred. While I discuss the importance of active learning in 691G, and demonstrate some techniques, many instructors, both new and experienced, are more reluctant to attempt such techniques in a large classroom format due to logistical concerns. Moreover, novice instructors who do attempt active learning techniques in the large lecture setting often give up after negative experiences. My own experience as an instructor shows that these negative experiences are often the result of issues with either: implementation, choice of activity, or trying to “shoehorn” an activity or technique with inadequate consideration of the instructional context. By observing class, GTAs learn the techniques of each technique. Through our two-hour after-class meetings, they are encouraged to ask questions about what they have observed to be better prepared to implement them in their own classrooms in the future.

To add further complexity, many, though certainly not all, active learning techniques in a large classroom environment require some application of technology. Flipped classrooms require an online homework system to help students be prepared and some sort of classroom response system for quizzing. Moreover, many aspects of running a large-enrollment class are much smoother with technology: effective LMS usage helps students navigate the course, asynchronous communication platforms help build community, and tools like 3-D printing can help create an equitable learning environment.

The apprenticeship model I have developed over the past year provides an excellent opportunity for GTAs to gain a deeper familiarity with these tools. GTAs in this new approach complete tasks such as writing quizzes in the Edfinity online homework system, managing LMS content, creating and facilitating teams in CATME, using the VEVOX audience response system, using mail merges to provide feedback to students, as well as using Excel to facilitate communication between these tools. While I do not expect my GTAs to ultimately use all these technologies in their future classes, at least not at first, I do hope that exposure to them all will give them confidence to address pedagogical challenges in their future courses with technology.

In addition to these technical details of active learning implementation and technological familiarity, I strive to teach the GTAs in this apprenticeship model the fundamentals of instructional design: both at the micro class level and at the macro course level. With regards to individual classes, my role as a member of the executive board of the MSP (our faculty union), requires me to miss a few classes a semester. After observing several weeks of class, the apprentice GTAs are in a great position to gain experience in front of a class covering for me. I work very closely with the GTAs in helping them prepare for their sessions. Not only do I work with them to prepare their slides and notes, but we also do a “dress rehearsal” in the room to ensure that they are comfortable both operating the room’s technology, and demonstrations, and to ensure that they are comfortable with the performance aspect. After their lecture, I ask the GTA to review the recording of class and use a protocol from Harvard (https://cepr.harvard.edu/files/cepr/files/l1a_teacher_video_selfie.pdf) to reflect on their performance and how they will improve in the future. I also provide feedback on their instruction based on the video recording.

At the macro course level, we discuss the basic principles of course design such as backward design and essential questions. The goal of the backward design discussion is to help GTAs see the utility of this approach and to convince them that one of the first tasks is to write exams. The literature is very clear on the effectiveness of this approach. However, many novice instructors, and even some experienced ones, approach course development from slides: the first thing they do after writing a syllabus is begin writing slides. While this is an understandable approach, going into the semester with a few weeks ready to go definitely provides a sense of relief, almost any instructor will, at some point in the semester, catch up to what they had developed prior to the semester’s start. The subsequent writing as one goes is generally sustainable unless there are other significant instructional tasks to complete, such as writing and administering exams. This argument provides a practical reason to backward design supplementing the best-practices argument.

Ultimately, I have been very pleased with this change in GTA usage from student-resource to apprentice. Not only does the apprentice model help our graduate students become better instructors in the future, but it also is more engaging. The student-resource model, by contrast, has always yielded mixed results: some GTAs are highly committed to the role, while others feel pulled towards other obligations. This model also has a benefit for the department of requiring fewer graduate TAs, a benefit particularly salient in the current funding situation. If GTAs are the primary source of office hours etc., then many GTAs are required. The apprenticeship model, by contrast, uses a single GTA per section with the student-resource aspect of office hours etc. served, often more effectively, by cheaper undergraduate TAs. In short, I definitely plan to continue using this approach I the future.

How to manage groups more efficiently – from “Get Better Faster”

I am currently reading a book entitled Get Better Faster: A 90-Day Plan for Coaching New Teachers by Paul Bambrick-Santoyo. While a more detailed review will come later, there is one point that is of particular interest. The author suggests that, when monitoring student work, the monitors (in my case myself and the TAs) should go to the fastest groups first. At first glance, this seems counterintuitive: shouldn’t the in-class assistants spend the most time with those groups who struggle the most? Bambrick-Santoyo, however, points out that going to the fastest groups first has two benefits:

  1. The in-class assistants get a good sense of where the students are likely to struggle and what alternative conceptions students have. While I always encourage my TAs to work the problems in advance and while we discuss them in our weekly meetings, these efforts are not always sufficient. By attending to the fastest groups first, TAs in particular get a in-the-trenches sense of where students are likely to stumble.
  2. Attending to the fastest groups first gives those groups who need a little more time the time they need to progress to the point where they are in a position to ask a question or get feedback.

Again, I am sure there will be more to come from this book, but I wanted to share that out.

Reflections on Physics 132 Spring ’22 Part I – Updates on the use of TAs in large-enrollment Introductory Physics for Life Sciences courses

Another semester is in the bag, and, if all goes according to plan, this will be the last time I teach physics 132 for quite a while. As such, I think a deep reflection on the semester is particularly warranted. While some changes/additions such as a fully remote option, there were several attributes added or revamped for this semester’s course. These, and existing features, all need consideration for their successes and areas for improvement. This is the first post in a series taking that deep dive into reflecting on Physics 132 Spring 22.

The teaching of large enrollment courses is always a team effort: requiring not only the instructor but also support staff such as lecture prep as well as both graduate and undergraduate teaching assistants (TAs). During the Spring 2022 semester, Physics 132 had two graduate and seven undergraduate TAs. In order to optimally support student learning, I feel that, as leader of this team, my critical roles include: forming a team with diverse experiences and knowledge; leveraging each team member’s unique knowledge, skills, and perspective; promoting a culture wherein each TA feels their expertise is acknowledged; ensuring everyone feels comfortable in their role and empowered to do their best to support students.

 A successful TA team begins at its formation. When I started at UMass in 2015, I used graduate TAs exclusively as that was my prior experience. As time went on, and the level support I felt was necessary increased, I began to hire undergraduate TAs to help fill the gaps using exclusively upper-division physics majors. This preference for physics majors was not carefully considered. I am somewhat ashamed to admit this preference arose from a sort of “physics chauvinism.” I assumed that majors in their third and fourth years, with their presumably deeper knowledge of the content, would make the best TAs.

I have since discovered what, in retrospect, should have been obvious: that a more diverse teaching team that mixes in life-science majors who had previously been successful in the class was superior. While my assumption regarding the deeper knowledge of upper-division physics majors has turned out to be true, life-science majors bring several other important attributes which strengthen the team as a whole.  

The undergraduate Physics 132 alums not only bring their valuable perspective as former students in the course to the TA role, but also their life science knowledge and disciplinary mode of thinking are useful to share with the physicists on the team. Physics 132 is very much an introductory physics for life sciences course. In addition to biological applications sprinkled throughout the material, each unit has a central biologically- or chemically-authentic motivating context [link to talk]. Having biologists on the teaching team can help make these examples more authentic and can ensure that I am using the language with which my life-science students will be familiar. For example, I was using the term van der Waals interactions. However, thanks to my undergraduate TAs, I learned that the term London dispersion forces is more common. Thus, I switched to primarily using London dispersion forces while still mentioning van der Waals for those who may be more familiar with that term.

To further empower my team members, I adopted a new format for my weekly team meetings taken wholesale from Prof. Guy Blaylock in our department. In past semesters, I struggled with promoting engagement during these planning and preparation sessions. TAs would often remain quiet while I presented information about upcoming topics and would even remain reticent when I explicitly solicited their feedback on student challenges they had observed. Prof. Blaylock’s practice for these meetings involves assigning one teaching team member each week to present on the upcoming material with an emphasis on the particular challenges that they think students might face along with suggestions on how they themselves learned the material. To ensure that the presenting member was fully prepared for this role, they were notified a week in advance and had access to the prior semester’s materials.

This meeting format has, in my opinion, been a wildly successful switch. All my TAs were more engaged throughout the meeting process – not just when it was their turn to present. These presentations resulted in more feedback from the TAs on student difficulties, their own struggles with the material. I feel that giving officially dedicated space for TA insights gave them all permission to contribute as full members of the teaching team.

My role in these discussions was often became that of “translator:” explaining biological concepts to the physicist members of the teaching team and physics concepts to the biologists. This role forced me to grapple more deeply with the disciplinary differences between biology and physics resulting in, I feel, a better understanding for myself and thus a better course.

These observations are not just my own. The TAs themselves shared similar opinions in an end-of-semester evaluation of me. In the words of one TA, “I thought the structure of the team meetings each week was quite beneficial. Specifically, having each TA lead a brief discussion on the current and/or upcoming topic being taught in class often provided the rest of the team with tips on how to explain concepts students often struggle with using different approaches and perspectives that are conducive to a more wholesome understanding. Overall, the team meetings were more involved than those I attended the previous semester, which I felt made a difference in the way I engaged with students taking the course both during class and in the physics help room; there were numerous times were I employed suggestions taken from the team meetings and found that the concepts clicked with students after doing so.”

Beyond ensuring that the TAs were prepared for the material, I feel that giving the TAs the potential for ownership helped them feel more comfortable sharing other challenges with me. For example, two young women on my teaching team were comfortable enough to share some personal difficulties they were having with some students in the help room. I am very glad that I was able to create a sufficiently trusting environment that these two young women felt comfortable sharing this with me and that we were able to work together to find a solution to address the issue.   The fundamental philosophy of these meetings is, I think, beneficial to leadership in general: allow the team to have a substantial and empowered leadership role (as opposed to simply explaining their importance as I used to do). While I know that this is not at all a new idea, as a faculty member moving in to more roles of leadership, such insights are of critical importance. Perhaps a similar philosophy could be, at least partially, implemented in 691G?

Graduate Students’ Teaching Experiences Improve Their Methodological Research Skills

Feldon, David F., James Peugh, Briana E. Timmerman, Michelle A. Maher, Melissa Hurst, Denise Strickland, Joanna A. Gilmore, and Cindy Stiegelmeyer. “Graduate Students’ Teaching Experiences Improve Their Methodological Research Skills.” Science 333, no. 6045 (2011): 1037–39.

I was meeting with Colleen Kuusinen, a new member of our Center for Teaching and Learning on a new project I am pursing as an Honors Thesis mentor. During our conversation, she mentioned this paper from 2011 which indicates that teaching experiences are beneficial to developing graduate students’ research skills. In this paper 95 graduate students’ research proposals were graded in accordance with a peer-reviewed “‘universal’ rubric for assessing undergraduates’ scientific reasoning skills using scientific writing” from B. Timmerman et al., Assess. Eval. High. Educ. 36, 509 (2011). The results were quite impressive as shown in the figures below. I think that these results only further the importance of developing good TA training.

Admitting humanity in this year’s Nobel Prize in Physics

One-half of this year’s Nobel Prize for Physics went to Michel Mayor and Didier Queloz for their discovery of 51 Pegasi B – the first planet observed to orbit a sun-like star other than our own. While the work marked a turning point in our understanding of the Universe, more than 4,000 such extrasolar planets have now been discovered, I think that some honest comments about a common experience in science made by Dr. Queloz deserve some attention as well.

The discovery of 51 Pegasi B was during Dr. Queloz’s Ph.D. work, Dr. Mayor was his advisor. At the time, 1992, the only planet outside of our solar system that had been found was around a pulsar: the rapidly spinning ember of a dead large star. The wobble caused by the planet in the otherwise regular radiation emissions of the pulsar made it comparatively easy to detect. However, the probability of life as we know it on such a planet is exceptionally low. One common attitude in the community at that time, according to Dr. Fischer of Yale, was that “Maybe most stars don’t form with planets and our solar system is unusual and life is incredibly rare.”

It was pretty clear I had no hope

Dr. Queloz describing beginning his Ph.D. work which ultimately won the 2019 Nobel Physics Prize

Thus, while starting a Ph.D. to search for extrasolar planets, Dr. Queloz was not expecting to find any, “It was pretty clear, I had no hope,” he said to the New York Times. Part of this hopelessness was rooted in the expectations of the time that any planets whose effects would be large enough to detect would orbit at such a distance that many years would be required to detect them. For example, Jupiter’s impact on our star has a period of over 11 years.

However, I know that these feelings of hopelessness are actually a quite common expectation of many students at the beginning of their Ph.D.’s independent of the particular field of physics. I know I had them. Here you are, joining this community of brilliant, and exceptionally hard working people, and you think to yourself, “what are the odds that I will find something that these other people, who have been working at this potentially their entire lives have not?” These feelings can be quite daunting.

Even when Dr. Queloz did find evidence for 51 Pegasi B in 1994, he was reluctant to show the results to Dr. Mayor, his Ph.D. advisor who was at the time on sabbatical half-way around the world. The evidence pointed to a planet unlike anything in our solar system: a huge Jupiter sized planet that is so close to its parent star that it orbits in only 4 days (Mercury, in inner-most planet in our solar system by comparison, takes about 88 days). Furthermore, the models of planet formation prevalent at the time suggested that forming such a large planet so close to a star should be impossible.

Again, doubt crept into Dr. Queloz’s mind. Which was more likely, that he had found something completely new far faster than anyone had predicted, or that, as a new student he had made a mistake? According to the New York Times:

Dr. Queloz did not feel ecstatic, but rather ashamed, certain that something was wrong with the instrument or his software.

“I really panicked at that time,” Dr. Queloz said. “I didn’t talk to [Dr. Mayor] at all.”

Chang, K., & Specia, M. (2019, October 8). Nobel Prize in Physics Awarded for Studies of Earth’s Place in the Universe. The New York Times. Retrieved from https://www.nytimes.com/2019/10/08/science/nobel-physics.html

I really feel that this is a set of emotions that all students have at some point: “I must be wrong,” “my advisor is the expert,” “who am I to…” Getting over these feelings is I guess part of maturing into an independent scientist.

In this case, the results were real and 24 years after their announcement in 1995, resulted in a Nobel Prize. I think acknowledging that most most Ph.D. theses don’t follow such a trajectory is important. Instead, we as Ph.D. students add our small bit to the cumulative knowledge of humanity and, perhaps more importantly, learn to become independent scientists along the way. However, the feelings expressed publicly by Dr. Queloz are, I think, common, and I hope that through expressing them we can further debunk the “super-brillant professor” stereotype, which can exacerbate equity issues in science according to Leslie, S.-J., Cimpian, A., Meyer, M., & Freeland, E. (2015). Expectations of brilliance underlie gender distributions across academic disciplines. Science, 347(6219), 262–265. https://doi.org/10.1126/science.1261375.