Tag Archives: instruction sessions

RIOT–May 17, 2016

Instruction for graduate students

Janelle and I will discuss our experiences with instruction for graduate students. This sort of sharing is important, since there isn’t a lot of how-to literature out there for guidance (though we can highlight a couple of articles). The discussion will address the differences between instruction for undergraduates versus graduate students, especially focusing on systematic reviews, scholarly communication, and data management.

 

We hope this RIOT will be like a Reddit AMA on instruction for graduate students. Please submit your questions by leaving a comment.

CC Kati Fleming, July 4, 2013. https://commons.wikimedia.org/wiki/File:Horned_Lark,_Eremophila_alpestris,_nestlings_begging,_baby_birds,_gape_colors,_leaping_in_nest_Alberta_Canada_(1).jpg
CC Kati Fleming, July 4, 2013.
https://commons.wikimedia.org/wiki/File:Horned_Lark,_Eremophila_alpestris,_nestlings_begging,_baby_birds,_gape_colors,_leaping_in_nest_Alberta_Canada_(1).jpg

Lesson + Study = Lesson Study! Researching learning in the college classroom

Sometimes you find a RIOT topic, and sometimes a RIOT topic finds you. I was jumping around from article to article last week when Michele sent out the latest issue of LOEX and this article caught my eye (perhaps because I was hungry): From Prix Fixe to A la Carte: Using Lesson Study to Collaborate with Faculty in Customizing Information Literacy. It describes using a research method called “lesson study” to collaboratively design and assess a one-shot information literacy session for a first year composition course at University of Wisconsin-Eau Claire. I ended up reading more about lesson study and found the concept really intriguing. This entry focuses on the above article, as well as one that informed it.

What is lesson study?
Lesson study originated in Japan, and is a way of systematically designing and assessing a lesson plan in a way that contributes to our knowledge on teaching and learning. In lesson study, a group of teachers works in a small team to plan, teach, observe, analyze, and refine individual lessons (Cerbin and Kopp). In Japan, the resulting lesson plans and studies are published and disseminated for other teachers to build from and use so that “in essence Japanese lesson study is a broad-based, teacher-led system for improvement of teaching and learning” (Cerbin and Kopp). The Cerbin and Kopp article I keep quoting proposes a model of using lesson study in the college classroom. Instructors at the University of Wisconsin-La Crosse (where Cerbin and Kopp teach) have actually been using the lesson study method since 2006, and have a really great site that documents the process and shares all of their results. This is the context through which the LOEX article I found originated, as the project has spread to multiple UW campuses and throughout departments.

Planning
To embark upon a lesson study, a small team of teachers comes together to select a course, topic, and goals for student learning. Often, these teams are composed of instructors teaching the same course but they can also be interdisciplinary teams (hello, librarians!) working toward common goals. In the Jennings et al. study, 4 librarians collaborated with 3 composition faculty. Their initial list of goals was huge, and they reported that the process of sitting down with faculty to discuss the meaning of their goals, how they could be taught and assessed, whether they could reasonably be taught in a one-shot, and how they fit into the overall curriculum was one of the most valuable aspects of the lesson study. Eventually, they whittled down to two outcomes, leaving the other concepts to be taught in preceding classroom activities or discussions.
The next step is to plan the lesson. One of the main goals of lesson study is to design lessons that make the process of student learning visible, so that it can be observed. Once the lesson is planned, teams must design the study of the lesson. This involves deciding what data they will collect to assess student learning and thinking, and what observation guidelines they will use when team members observe the lesson being taught. To me, this focus on how students learn is what makes lesson study different than other forms of assessment.

“…the primary focus of lesson study is not what students learn, but rather how students learn from the lesson. To investigate how students learn, teams focus on student thinking during the lesson, how they make sense of the material, what kinds of difficulties they have, how they answer questions, how their thinking changes during the lesson and so forth.” Cerbin and Kopp

Teaching and Observing
Once the lesson and study have both been planned, one team member teaches the lesson while the others observe and collect data. Data collection may involve field notes, checklists, rubrics, etc. Cerbin and Kopp note that lesson studies promote observation of students rather than the performance of the teacher, and that the collaboratively planned lesson (not the teacher or the students) is what is being judged.* This takes the heat off of individuals and “helps pave the way for public knowledge building.”

Analysis
After the first go-round, the team debriefs to talk about their experiences, analyze data for evidence of student learning, and discuss possible changes based on what they found. The revised lesson can then be used in another class, continuing the cycle of evidence-based improvements.

Documentation and Sharing
The idea behind lesson studies is that they will produce valuable knowledge to be shared with others. Teams extensively document both the lesson portion and the study portion so that they can be disseminated and shared.

Why is it valuable?
Some of the reasons Cerbin and Kopp value lesson study include:

  • it encourages scaffolded, reflective design and assessment
  • it can help build a shared language for teaching and learning among instructors
  • it offers an evidence-based approach to teaching improvement
  • it provides a framework for investigating teaching and learning in the classroom

Jennings et al. reported that using lesson study to design the composition one-shot began a process of continual improvement and engendered a “culture of collaboration” among members of the lesson study team. It also led to further library involvement in the integration of information literacy into some curricular revision in the department. Eventually, it also led to similar studies in courses within other departments. They reported that in a science lesson study group, the process revealed that faculty assumed their students came to them with much more robust information literacy skills than they actually did. Through the process of planning the lesson study, “Faculty began to recognize and internalize the idea that if they wanted their students to use information in the sciences effectively and appropriately, it was incumbent upon them to integrate information literacy into the curriculum rather than assuming the students were gaining these students elsewhere” (Jennings et al.). Hooray!

I think this could be a great way to promote collaboration, and to work in some meaningful assessment work. It is difficult to assess the actual process of student learning, and I think this is one angle from which to approach it.

*Yes, this method requires IRB approval

Questions to think about:

  • Where might a lesson study fit in our teaching?
  • Who on campus might we partner with?
  • How would we share our findings?

References:

Cerbin, W. & Kopp, B. (2006). Lesson Study as a Model for Building Pedagogical Knowledge and Improving Teaching. International Journal of Teaching and Learning in Higher Education, 18(3).

Retrieved from http://www.isetl.org/ijtlhe/pdf/IJTLHE110.pdf

Jennings, E., Kishel, H., & Markgraf, J. (2012). From Prix Fixe to A la Carte: Using Lesson Study to Collaborate with Faculty in Customizing Information Literacy. LOEX Quarterly, 38(4).

Retrieved from http://commons.emich.edu/loexquarterly/vol38/iss4/4

Does putting on a good show matter?

The article:
Corcose, E., & Monty, V. (2008). Interactivity in Library Presentations Using a
Personal Response System. EDUCAUSE Quarterly, 31(2).

The basics:

This article reports on a study of the use of a “Personal Response System” (more commonly known as clickers – wireless devices that students use to respond to a question posed by the instructor) in library instruction. The authors conducted three classes using the clickers, and three classes covering the same content without them (with a total of 127 participating students in each group). In the clicker classes, students were presented with multiple choice questions throughout the session, which allowed the instructor to gauge their understanding of each topic. In the non-clicker classes, similar feedback was obtained by asking open-ended questions.
At the end of each class, students completed anonymous questionnaires ranking (using 5-point scales) 1) their enjoyment of the session, 2) their feeling of competency using the library, 3) the relevancy of the class to their needs, 4) the organization and presentation of the class, and 5) the knowledgability, helpfulness and effectiveness of the instructor.
Using chi-square analysis, the authors determined that the only responses that significantly differed between the clicker and non-clicker students were those for enjoyment of the session and for organization and presentation of the class, with the clicker students reporting higher enjoyment and better organization. The questionnaires also included a few open-ended questions.
The authors noted that using the clickers “enabled good pedagogy,” but reduced flexibility in the classroom (the questions had to be pre-programmed), and extended class preparation time. Additionally, they reported that clicker use ate up 15 minutes of the 50-60 minute classes. They concluded that the advantages outweighed the negatives, due to the immediate feedback they facilitate and to an awareness they create in the instructor that students can only learn so much in one session. They noted that other studies have found that learning outcomes remain the same for both traditional and clicker methods.

Why do we care?

This article drew my attention because several students have recently come to the reference desk asking for scissors to open packages of clickers, so they seem to be in use on campus. Since we usually don’t have the time to develop relationships with the students we teach, they are sometimes reluctant to interact during our sessions. Part of this could just be due to other factors (maybe they’re a quiet class, or maybe they just turned in a paper and are all tired), but I wonder if giving them a chance to submit anonymous feedback would help them feel more comfortable.
After reading the article, I found myself thinking about whether technology like this is worth using if it makes the class more enjoyable but doesn’t increase learning outcomes. If we use technology to make the session more fun, are we just putting on a show, or are we adding something valuable?
One major difference between the authors’ instruction sessions and ours is that for whatever reason, their students didn’t have the opportunity to conduct their own searches (though it seemed like they had computers). 17% of the non-clicker students suggested that future classes have a chance to search on their own, but only 3% of the clicker students made this suggestion. To me, this suggests that using the clickers may have filled some desire the students had for interaction that could have been filled in other ways (like active learning). If we were to implement something like this, would it take away from other forms of interaction? Between the laptops and the clickers, would all the technology be too distracting?
Finally, I wonder how much you can really change your class plan to respond to such immediate feedback. While flexibility is definitely a good thing, would it be difficult to switch your plan on the fly? I found it interesting that one of the authors’ pros for using clickers was that it made them realize the limitations of how much students can learn in one session. Sometimes it’s easy to get caught up in trying to cover everything, but it might be useful to have a reminder to slow down and make sure everyone’s on the same page.

Big picture:

Beyond looking at specific types of technology, what are the best reasons to introduce new gadgets or techniques into the classroom? Should criteria always be focused on improving learning outcomes, or do student enjoyment and instructor organization/presentation style matter too?