Tuesday, September 15, 2015

Exploring the Advantages of Rubrics

September 9th, 2015



Exploring the advantages of rubrics

“I don’t believe in giving students rubrics,” a faculty member told me recently. “They’re another example of something that waters down education.” I was telling him about a study I’d just read that documented some significant improvement in student papers when students used a detailed rubric to guide their preparation of the research paper. I wasn’t very articulate in my response to him and decided I’d use this post to explore some of the issues involved in sharing rubrics and grading criteria with students.
“I don’t understand what you want on this assignment.” It’s one of those comments teachers don’t like to hear from students, and rubrics, checklists, or the grading criteria offer constructive ways to respond. They identify those parts of an assignment or performance that matter, that if included and done well garner good grades and learning. If teachers don’t identify them, then students must figure out for themselves what the assignment needs in order to be considered good.
The objection to sharing rubrics is not groundless. If you give students a detailed rubric, behaviorally focused, like the one used in this study, you’ve essentially deconstructed Teaching Professor Blog (a descriptive term used by the study’s author) a research report. You’ve broken it down into multiple small pieces, enabling the student to do each piece, patch them together, and have a research report. In the study, research reports written using the rubric were significantly better than those written not using a rubric. It is fair to ask whether use of the rubric improved their research report writing in general or only this one time on this one assignment.
Not knowing how the work will be assessed definitely adds challenge to an assignment. But what’s challenging the students? The time and energy necessary to figure out assignment criteria or the intellectual richness of the work itself? If students get sidetracked by trying to figure out what the teacher wants and that ends up taking as much or more time than dealing with the content, then I don’t think that makes an assignment challenging for the right reasons.
A lot of students are obsessed with trying to figure out what the teacher wants. From their long years in school, they’ve learned that different teachers want different things. It’s not all random whimsy; there are any number of criteria that most of us would agree are relevant to particular kinds of assignments. But there’s lots of variation among us at the level of detail—appropriate fonts, number of references, and whether the first person can be used in essays, for example. Students mostly see this as a guessing game, and there’s not a lot of enduring, transferrable learning that comes from trying to answer questions that revolve around what looks to students like personal preference. I’m not advocating uniform standards here. Personal preference has its place, and some of what looks like personal preference to students isn’t.
I think rubrics have value if teachers use them to get students past what the teacher wants to what criteria make papers, projects, and performances excellent. First, seeing that delineation on a rubric is certainly more efficient than trying to figure it out on your own, and using a rubric often garners secondary benefits. In the second study reported by this author, students used the rubric to grade another student’s report. Their feedback was not shared with the report’s author. But that assessment activity alone was enough to enable 60% of the students to rewrite their own paper and receive a significantly higher score.
We continue to keep students out of the assessment process. No, we can’t let them grade their own work, but assessment should be thought of more holistically. It’s the ability to figure out what criteria others will be using to judge your work. It’s about being able to identify what’s good and what isn’t in your own work. Being able to accurately assess your work and that of others is one of those lifetime skills that separates successful professionals from those less so.
The ultimate goal should be students who don’t need teacher-constructed rubrics. The question is when and how we develop that level of assessment skill.
Reference: Greenberg, K. P. (2015). Rubric use in formative assessment: A detailed behavioral rubric helps students improve their scientific writing skills. Teaching of Psychology, 42 (3), 211-217.
Click here to view this at www.facultyfocus.com

Wednesday, September 2, 2015

The Eight-Minute Lecture Keeps Students Engaged

August 31st, 2015



The Eight-Minute Lecture Keeps Students Engaged

In the 1970s, my mother, a fifth-grade teacher, would lament, “The TV remote has ruined my classroom! I can almost feel the kids trying to point a clicker at me to change the channel!” Little did she know that college students today don’t need to wish for a remote control to switch from their professor to entertainment—an endless assortment of distractions are all on their smart phones.
Numerous studies have demonstrated that students retain little of our lectures, and research on determining the “average attention span,” while varying, seems to congregate around eight to ten minutes (“Attention Span Statistics,” 2015), (Richardson, 2010). Research discussed in a 2009 Faculty Focus article by Maryellen Weimer questions the attention span research, while encouraging instructors to facilitate student focus.
When I began teaching in 2006, I assumed that students could read anything I say. Therefore, my classes consisted of debates of, activities building on, and direct application of theories taught in the readings—no lectures.
But I noticed that students had difficulty understanding the content in a way that enabled accurate and deep application without some framing from me. In short, I needed to lecture—at least a little. This is when I began the eight-minute lecture. If you’re worried that eight minutes is too long, I discovered that when students experience many short lectures throughout the semester, they learn to focus in those bursts, in part because they know the lecture will be brief.
How to implement the eight-minute lecture
1. Prepare students – Early in the semester, explain your teaching methodology and your rationale for doing things a certain way. This helps manage students’ expectations. Most of my students study engineering and expect to mostly listen to lectures and take notes. They are less accustomed to an active learning environment that involves lots of debates on the readings, small group discussions and report-backs, short reflection papers, quick multiple choice clicker quizzes, problem sets, and/or short lectures.
2. Redesign/rewrite lectures – Review your lectures to identify natural breaks. Where can you pause without losing meaning? How can you use students’ knowledge from their homework and previous learning as a scaffold?
Next, look for areas in your lecture where you talk about something that instead can be learned from an image, video, or interactive activity, and substitute accordingly. Cull through the content until you have eliminated two-thirds of your lecture material.
An example from last semester
Toward the end of last semester, I began a module on global business. The learning objectives for the first 50-minute class period on the topic were to be able to discuss the origins and benefits/costs of globalization and to test global business theories against existing corporate outcomes.
In preparation, students read a textbook chapter delineating the history and theories of success in global business, and completed either an interview with a manager working internationally or an analysis of global business news (their choice).
With this preparation, they came to class with a firm grasp of global business terminology and context. Further, as this class period came toward the end of the semester, students had a basic working knowledge of management and leadership theory; Western business history; and the interaction of business, government, and the global economy.
I started out by asking a question related to their preparation. I then began my first eight-minute lecture, introducing them to the concept of balance of payments while displaying current numbers up on the screen. Once I explained trade imbalances, I asked questions that weren’t answered in their reading or my lecture, but were answerable with careful reflection on both.
For example, “How might you incorporate your previous learning on the supply and demand curve to understand how exchange rates influence global business?”
Once this topic was fully explored, I gave another eight-minute lecture, and then engaged them in a new activity that taught the next learning objective. At the end of class, I tested to ensure that the objectives had been met by asking students for a one-to-three-sentence note card summarizing their learning. The success of this method of interspersing mini-lectures with activities, discussions, and time for reflection was validated by the final exam scores achieved by the students in this class, which surpassed those of previous semesters.
References:
Statistics Brain Research Institute. “Attention Span Statistics.” April 2, 2015. Retrieved from http://www.statisticbrain.com/attention-span-statistics/.
Richardson, H. “Students only have ‘10-minute attention span’.” News.bbc.co.uk. January, 2010. Retrieved from http://news.bbc.co.uk/2/hi/uk_news/education/8449307.stm.
Wilson, K. and Korn, J. H. “Attention during lectures: Beyond ten minutes.” Teaching of Psychology 34, no. 2 (2007): 85–89.

Illysa Izenberg is a lecturer for the Center for Leadership Education in the Whiting School of Engineering at Johns Hopkins University.

© Magna Publications. All rights reserved.

The First Day of Class: A Once-a-Semester Opportunity

August 19th, 2015



The First Day of Class: A Once-a-Semester Opportunity

There’s only one first day of class. Here are some ideas for taking advantage of opportunities that are not available in the same way on any other day of the course.
  • It’s students’ first introduction to the course content. Catalog descriptions of courses may be accurate, but they aren’t all that good at conveying why the content is important, relevant, and useful; why students just may find it interesting; and why a few in the past have actually fallen in love with it. A good introduction provides a bit of background; it builds connections by identifying shared experiences and common interests. The details offered in a good introduction motivate continued conversation.
  • The first day gives you the chance to explain why this course and the content of this field matter to you. Of all the potential majors, you chose one in this field—how did that happen? Did you choose well? Why?
  • Teaching Professor Blog
  • Most courses develop important skills—concrete ones like how to calculate the Doppler shift and less specific ones like how to evaluate evidence or construct a persuasive argument. The first day is a good time to let students know what they will be able to do—or do better—as a consequence of this course. Too often we focus the conversation on what the course covers and what students will know by the end of the term. That’s important, but we shouldn’t leave out how the course develops skills—some of which students will use for the rest of their lives.
  • Courses have been known to change lives. Most don’t, but why not introduce the possibility on the first day? Adult educators call it transformative learning. It happens when we learn something that not only changes how we think, but also changes what we do; indeed, who we are. Sometimes these big changes occur incrementally; other times they hit like lightning—with a burst of light and a thunderous revelation. It’s been known to happen in all types of courses and with all types of students.
  • You can talk about your commitment to teaching. What are your favorite things about teaching? What do you need from students in order to do your very best teaching?
  • You can talk about your commitment to student learning. How will you support their efforts to master the material? What can you do to go beyond “I’m happy to answer questions” and “I have regularly scheduled office hours”?
  • You can explore students’ commitments to learning. Yes, most often their first commitment is to grades and getting good ones, but there’s an opportunity missed if you talk only about grades and don’t mention learning. Could you compose a potential course theme song? “Grades matter, but learning matters more.” You’ll be singing it solo, but if students hear it often enough, you may get some accompaniment by the end of the course.
  • It’s the first chance to find out about your students in the course: year in school, major, prior course work, current jobs, career objectives, characteristics of courses in which they’ve learned a lot, teacher feedback that is and isn’t helpful, peer contributions that support learning—whatever information you might need to connect with them as learners. Collecting this information is the first step in building constructive relationships with students and discovering concrete ways you can link course content to student realities.
  • It’s a new course and, for most, the beginning of a new academic year. Optimism prevails. Teachers and students want the same things on the first day—a good course, a positive constructive learning environment, the chance to succeed—and at this point everyone still believes these things are possible.
  • Students may look passive and not especially interested, but don’t be fooled. In most cases, it’s a facade. Who among us hasn’t tried to look calm, cool, and collected when we’re feeling scared, uncomfortable, and afraid of looking stupid? On that very first day, get students connected with each other and the course content. Let students wade around in some intriguing content details, collectively discovering that the water’s warm and feels good. Maybe they’ll be motivated to dive in and swim out toward deeper water.
  • It’s the day in the course when it’s easiest for the teacher to genuinely smile. You have only good news to share, so let them hear it.
© Magna Publications. All rights reserved.

How Do You Learn?

August 12th, 2015



How do you learn? How do you teach?

We are definitely way more interested in learning than we used to be. In the early years of my teaching and faculty development work, it was all about teaching: improve it and students will automatically learn more. Now the focus is on how students learn and the implications that has for how we teach.
Lately I’ve been wondering about the learning practices of those of us who teach—what we know about ourselves as learners and how that knowledge influences the decisions we make about teaching. I’ve been trying to recall what I’ve thought about myself as a learner when I was in college. I think I self-identified as a student. I took courses and learned content. I liked some subjects and didn’t like others, which was sort of related to what I thought I could do. But the concept of learning as an entity was pretty much a big amorphous fuzz.
In a workshop on using reflection to promote professional growth, I asked participants to spend some time thinking and writing about what they knew about themselves as learners. Teaching Professor Blog When we moved to a whole-group discussion, people talked about learning in general, not about themselves as learners. I didn’t have much luck getting the group to make it personal. Did it feel too risky? That didn’t seem right. This group had been working together for almost eight weeks. Was the question unclear? Or was it simply that these college teachers hadn’t thought much about themselves as learners and didn’t have any good answers at the ready?
Many of us have done the learning styles bit. We’ve got some broad parameters. I learn from text. If findings are explained in the text, I get it. Make me get the conclusions from a table and I struggle. I like questions that generate an array of answers without definitive right ones. I’m better with details and don’t always see how they can be assembled into a big picture. I’m betting you can come up with your own descriptions for how you like to learn, but these are all general characteristics, starting points. The wave of neuroscience research is making it clear that learners are unique, that understanding and sense-making is very much an individual process. Our thinking about how we do it needs to be more precise and specific.
I also tried to get my workshop group to talk about the relationship between what we study and how we learn. We find our way to these disciplines where knowledge is configured, organized, shaped, and structured in particular ways. Do we feel at home there because those ways of dealing with content fit with how we manage material—or is it the other way around? We get into these disciplinary domains and they start shaping how we think, question, analyze, discover, and learn. Or, maybe it’s some synergistic relationship that we have yet to figure out.
It’s interesting to try to learn something new and unlike what you know well. That takes most of us outside our comfort zones, and pretty quickly we start looking and acting a lot like our students. I’m trying to learn how to kayak this summer. A phys ed teacher who lives next door has been helping me. I hear myself telling her that I’m a motor-skills moron and may be too old to learn. My kayak mostly moves in clumsy circles. She glides around smoothly and with such precision that I’m embarrassed to be in her presence. I apologize for my stupid questions. The learning strategies I rely on to read, write, think, and make presentations simply don’t work with this learning task.
I’m convinced that how we learn influences the decisions we make about how to teach. It starts with the commitment to teach the kind of course we’d like to take. Many of us talk a lot when we teach because we learn well by listening. We assign lots of reading because that’s how we master new information. But those are the easy, obvious connections. I suspect there are others that are more subtle and complex. How we learn and its effects on how we teach are intriguing. It’s important because it affects how students learn. I’m wondering if the kind of teaching that helps students learn begins with a clear understanding of how learning works for us.