Making EFL Matter Pt. 6: Prepared to Learn

image of students

The present series of posts is looking at how EFL courses and classes in Japan might be improved by considering some of the techniques and activities emerging in ESL and L1 mainstream education settings. Previous posts have looked at goals, data and feedback, discussion, portfolios, and prolepsis and debate. The basic idea is to structure courses in accordance with the principles of formative assessment, so students know where they are going and how to get there, and then train them to think formatively and interact with their classmates formatively in English. All of the ideas presented in this series came not from TESOL methodology books, but rather more general education methodology books I read with my EFL teacher lens. I realise that this might put some EFL teachers off. I don’t think it should, since many of the widely-accepted theories and practices in TESOL first appeared in mainstream classes (journals, extensive reading, portfolio assessment, etc.); also,  the last few years have seen an explosion in data-informed pedagogy, and we would be wise not to ignore it. In this post, however, I’d like to go back to TESOL research for a moment and look at how some of it might be problematic. Actually, “problematic” may be too strong a word. I’m not pointing out flaws in research methodology, but I would like to suggest that there may be a danger in drawing conclusions for pedagogy from experiments that simply observe what students tend to do or not do without their awareness raised and without training.

I’ve been reading Peer Interaction and Second Language Learning by Jenefer Philps, Rebecca Adams, and Noriko Iwashita. It is a wonderful book, very nicely conceived and organized, and I plan to write a review in this blog in a short time. But today I’d just like to make a point connected with the notion of getting learners more engaged in formative assessment in EFL classes. As I was reading the book, it seemed that many of the studies cited just seemed to look at what learners do as they go about completing tasks (very often picture difference tasks, for some reason). That is, the studies seem to set learners up with a task and then watch what they do as they interact, and count how many LRE (language related episode) incidences of noticing and negotiation of language happen, or how often learners manage to produce correct target structures. Many of the studies just seem to have set learners about doing a task and then videoed them. That would be fine if we were examining chimpanzees in the wild or ants on a hill; but I strongly believe it is our job to actively improve the quality of the interactions between learners and to push their learning, not just to observe what they do. None of the studies in the book seem to be measuring organized and systematic training-based interventions for teaching how to interact and respond to peers. In one of the studies that sort of did, Kim and McDonough (2011), teachers just showed a video of students modelling certain interaction and engagement strategies as part of a two-week study. But even with that little bit of formative assessment/training, we find better results, better learning. The authors of the book are cool-headed researchers, and they organize and report the findings of various studies duly. But my jaw dropped open a number of times, if only in suspicion of what seemed to be (not) happening; my formative assessment instincts were stunned. How can we expect learners to do something if they are not explicitly instructed and trained to do so? And why would we really want to see what they do if they are not trained to do so? Just a little modelling is not bad, but there is so much more that can be done. Right Mr. Wiliam? Right Ms. Greenstein?

Philps et al. acknowledge this in places. In the section on peer dynamics, they stress the importance of developing both cognitive and social skills. “Neither can be taken for granted,” they state clearly (pg. 100). And just after that, they express the need for more training and more research on how to scaffold/train learners to interact with each other for maximum learning:

“Part of the effectiveness of peer interaction…relates to how well learners listen to and engage with one another…In task-based language teaching research, a primary agenda has been the creation of effective tasks that promote maximum opportunities for L2 learning, but an important area for research, largely ignored, is the training of interpersonal skills essential to make these tasks work as intended” (pg. 101).

But not once in their book do they mention formative assessment or rubrics. Without understanding of the rationale of providing each other with feedback, without models, without rubrics, without being shown how to give feedback or provide scaffolding to peers, how can we expect them to do so, or to do so in a way that drives learning. Many studies discussed in the book show that learners do not really trust peer feedback, and do not feel confident in giving it. Sure, if it’s just kids with nothing to back themselves up, that’s natural. But if we have a good system of formative feedback in place (clear goals, rubrics, checklists, etc.), everyone knows what to do and what to do to get better. Everyone has an understanding of the targets. They are detailed and they are actionable. And it becomes much easier to speak up and help someone improve.

Teachers need to make goals clear and provide rubrics detailing micro-skills or competencies that learners need to demonstrate. They also need to train learners in how to give and receive feedback. That is a fundamental objective of a learning community. The study I want to see will track learners as they enter and progress in such a community.

 

Kim, Y., & McDonough, K. (2011). Using pretask modeling to encourage collaborative learning opportunities, Language Teaching Research,15(2), 1-17.

 

Making EFL Matter Pt. 2: Data and Feedback

imafiling cabinet

 

In the last few years, I’ve found myself increasingly reaching for books that are not on my SLA or Applied Linguistics shelves. Instead, books on general teaching methodology have engaged me more. It started a few years ago when I came across John Hattie’s Visible Learning for Teachers, a book in which various approaches in education are ranked by their proven effectiveness in research. This led me to further explore formative assessment, one of the approaches that Hattie identifies as particularly effective, citing Yeh (2011). I was impressed and intrigued and began searching for more–and man is there a lot out there! Dylan Wiliam’s Embedded Formative Assessment is great (leading to more blogging);  Laura Greenstein’s What Teachers Really Need to Know about Formative Assessment is very practical and comprehensive;  Visible Learning and the Science of How We Learn by Hattie and Yates has a solid  section; and Leaders of Their Own Learning by Ron Berger et al., the inspiration for this series of blog posts, places formative assessment at the heart of curricular organization. There is, as far as I know, nothing like this in TESOL/SLA. I’m not suggesting, I would like to emphasize, throwing out bathwater or babies, however. I see the content of these books as completely additive to good EFL pedagogy. So let’s go back to that for a moment.

One of my favorite lists in TESOL comes from a 2006 article by Kumaravadivelu in which he puts forth his list of macro-strategies, basic principles that should guide the micro-strategies of day-to-day language classroom teaching, as well as curriculum and syllabus design. This list never became the Pinterest-worthy ten commandments that I always thought it deserved to be. Aside from me and this teacher in Iran, it didn’t seem to catch on so much, though I’m sure you’ll agree it is a good, general set of directives. Hard to disagree with anything, right?

  1. Maximize learning opportunities
  2. Facilitate negotiated interaction
  3. Minimize perceptual mismatches
  4. Activate intuitive heuristics
  5. Foster language awareness
  6. Contextualize linguistic input
  7. Integrate language skills
  8. Promote learner autonomy
  9. Raise cultural awareness
  10. Ensure social relevance

But what is missing from the list (if we really want to take it up to 11) I can tell you now is Provide adequate formative feedback. One of the great failings of communicative language teaching (CLT) is that is has been so concerned with just getting students talking, that it has mostly ignored one of the fundamental aspects of human learning:  it is future-oriented. People want to know how to improve their work so that they can do better next time (Hattie and Yates, 2014). “For many students, classrooms are akin to video games without the feedback, without knowing what success looks like, or knowing when you attain success in key tasks” (pg. 67). Feedback helps when it shows students  what success looks like, when they can clearly see the gap between where they are now and where they need to be, and when the feedback provides actionable suggestions on what is being done right now and what learners should  do/change next to improve. It should be timely and actionable, and learners should be given ample time to incorporate it and try again (Wiliam, 2011; Greenstein, 2010).

One of the most conceptually difficult things to get used to in the world of formative feedback is the notion of data. We language teachers are not used to thinking of students’ utterances and performances as data, yet they are–data that can help us and them learn and improve. I mean, scores on certain norm-referenced tests can be seen as data, final test scores can be seen as data, and attendance can be seen as data, but we tend, I think, to look at what students do in our classes with a more communicative, qualitative, meaning-focused set of lenses. We may be comfortable giving immediate formative performance feedback on pronunciation, but for almost anything else, we hesitate and generalize with our feedback.  Ms. Greenstein, focusing on occasionally enigmatic 21st century skills, offers this:

“Formative assessment requires a systematic and planned approach that illuminates learning and displays what students know, understand, and do. It is used by both teachers and students to inform learning. Evidence is gathered through a variety of strategies throughout the instructional process, and teaching should be responsive to that evidence. There are numerous strategies for making use of evidence before, during, and after instruction” Greenstein, 2012, pg. 45).

Ms. Greenstein and others are teachers who look for data–evidence–of student learning, and look for ways involving learners in the process of seeing and acting on that data. Their point is we have a lot of data (and we can potentially collect more) and we should be using it with students as part of a system of formative feedback. Berger, Ruben & Woodfin, 2014) put it thus:

“The most powerful determinants of student growth are the mindsets and learning strategies that students themselves bring to their work–how much they care about working hard and learning, how convinced they are that hard work leads to growth, and how capably they have built strategies to focus, organize, remember, and navigate challenges. When students themselves identify, analyze, an use data from their learning, they become active agents in their own growth (Berger, Rugen & Woodfin, 2014, pg. 97).

They suggest, therefore, that students be trained to collect, analyze, and share their own learning data. This sounds rather radical, but it is only the logical extension of the rationale for having students track performance on regular tests, or making leader boards, or even giving students report cards.  It just does so more comprehensively. Of course, this will require training/scaffolding and time in class to do. The reasons for doing are worth that time and effort, they stress. Data has an authoritative power that a teacher’s “good job” or “try harder” just don’t. It is honest, unemotional, and specific, and therefore can have powerful effects. There are transformations in student mindsets, statistics literacy, and grading transparency, all of which help make students more responsible and accountable for their own learning. Among the practices they suggest that could be deployed in an EFL classroom are tracking weekly quiz results, standardized tests, or school exams, using error analysis forms for writing or speaking assignments, and using goal-setting worksheets for regular planning and reflection.

You can see the use of data for formative assessment in action in a 6th grade classroom here.

This post is part of a series considering ways to add more focus and learning to EFL classrooms by drawing on ideas and best practices from L1 classrooms.

Part 1 looked at the importance of goals.

Part 3 looks at the challenges and benefits of academic discussions

 

References

Yeh, S. S. (2011). The cost-effectiveness of 22 approaches for raising student achievement. Charlotte, North Carolina: Information Age Publishing.

EFL Gamification 7: Required Reading

With a few gamification/gameful design posts and much of what I want to say out of the way,  I thought it might be a good time right now to offer a reading list. If you are interested in games and learning and you are just pulling in the occasional article or presentation from your PLE, you are likely getting your info on gamification in less-than-comprehensive bits…and bits…and…bits.  It takes some sifting to see if you get anything good and useful, and that sifting requires a little knowledge and/or experience.  For that reason, and to give yourself a little thinking time, I recommend you try reading a few books. The books mentioned below each contain a diverse range of combinations of theory and examples. Reading through them is like a taking hot air balloon trip over unfamiliar territory, or just climbing up to a high place to get the lay of the land. That said, unfortunately there is no one book that’ll do this completely; you’ll need to read a couple at least. The downside is that books, even the most recent ones, are dated. These are the best of recent books on the topic, but the ideas within them stretch back a decade in some cases. You’ll need to keep trawling your PLE for recent developments. I recommend following a few key people: Nicole Lazzaro, Amy Jo Kim, Gabe Zichermann, and Sebastian Deterding.

I’m working from a few assumptions here: you are a classroom teacher; you work with large classes that often display less than optimal motivation; you have searched online and found lots of short blog articles (particularly business-focused ones) with lots of opinions but not much that is useful for you or your learners; you are interested but skeptical. If this is a reasonably accurate description of you, you’ll likely find my recommendations helpful.

Reality Is Broken (book cover)

One of the things I’ve noticed is that you really ought to try to avoid the term/idea “gamification” and think instead of gameful design or something like that. If that distinction doesn’t mean anything to you yet, Jane McGonigal’s Reality is Broken is a good way to learn that it is more than just the choice of term that matters. This book will help you make that important change in perspective. She does a great job explaining what games are and why and how they are effective for enjoyment and change. Part 1  of the book is really great–very passionate, very eye-opening, and very clear. She is really does a fine job explaining  intrinsic rewards, unpacking what she sees as the four major categories: the need for satisfying work, how success must be possible, the social environment of our activities, and the craving we all have for higher meaning. She shows how games provide these things and in the process helps you understand how important it is to make use of these things in just about any situation. She challenges your assumptions with arguments that are both passionate and sensible, if a little revolutionary in perspective. As the chapters continue, she covers happiness and her ideas for how games can be a force for good in the world. She does get a little weird in places and you will likely see her more as a zealot than a voice of balanced pedagogy by the time you reach the end. But don’t skip this book. You might not know it, but you need to understand the mindset of gamers/game designers, and Ms. McGonigal is a great guide.

 

Using Games to Enhance Learning and Teaching (book cover)

Using Games to Enhance Learning and Teaching is a rather ambitious little academic book edited by Nicola Whitton and Alex Moseley. It is ambitious in that it tries to do many things at the same time: provide rationale for the greater use of games in education; show how games can be designed and deployed; provide a theoretical framework for the evaluation of games for educations; etc. Some of these are done better than others and one might question the reasoning behind the inclusion of a couple of chapters. However, the chapters entitled “Good Game Design Is Good Learning Design” and “Narrative: Let Me Tell You a Story” are particularly good and helpful for teachers who want to know more about what games offer to education. Also, the several sections dealing with alternative reality games (ARGs) really help you to see the the pedagogy and design of such activities. The many examples included and the authors’ experience with campus-wide ARGs make these parts of the book very interesting and practically useful if you would like to try it yourself. Oddly, despite the focus on education, there is little attention to using games for individual classrooms. If you are looking for some ideas to bring into your own classes here, you’ll find a few, but you’ll still need to do the specific designing and construction work yourself. One of the strong points of this book is that points are backed up with citations and references to academic papers. The authors are researchers / practitioners and they manage a good balance between theoretical support and practice. It might seem seem strange to praise a book for including references, but academic literature reviews are something the other authors on this list didn’t  seem to worry too much about.

 

The Mulltiplayer Classroom (book cover)

The Multiplayer Classroom: Designing Coursework as a Game by Lee Sheldon is what it says it is. If you are looking to set up your course as a game, this is the book for you. See my post on this topic for more details. One of the take-aways from this book is that trying to do so will require a serious re-thinking of how you organize content and a lot of tweaking to get it right for your group of learners. The book is particularly aimed at college teachers who have more control over their curriculum, but various high school and other teachers who have changed their courses into games are also presented as case studies.

 

For the Win (book cover)

For the Win: How Game Thinking Can Revolutionize Your Business by Kevin Werbach and Dan Hunter might seem a strange choice for a list of gamification books for education, but it is included here because it is a succinct overview that can get you up to speed on the topic. The focus is on how gamification can be used for businesses with a web presence especially, but the Mr. Werbach, in addition to designing and delivering one of the first courses on gamification and another that is available as a MOOC from Coursera.org, does a good job introducing the genre, explaining motivation, the elements of games, and the steps for deploying gamification. There are thousands of  businesses trying really hard to make their websites and businesses more fun, and Mr. Werbach knows a lot about them. Understanding their challenges and how they are meeting them helps in conceptualizing the somewhat parallel problem schools have with engaging students. But that’s about as far as it’ll get you. Recently, Mr. Werbach was asked to recommend a short, humorous video that gives a nice introduction to gamification. This one from PennyArcade is what he suggested.

 

Seductive Interaction Design (book cover)

 

Seductive Interaction Design by Stephen Anderson is a book that will help you understand gameful design. The sub-title, Creating Playful, Fun, and Effective User Experiences gives you a better idea of what is in this book but Mr. Anderson is a unique thinker with an interesting perspective. The book is not at all about education, it is not even really much about games or gamification; rather it is a book on user experience design from someone who is an expert in web interface design. So why would you want to read it? Well, education begins with getting attention and trust and Mr. Anderson has a lot to say on those topics.

 

The Art of Game Design (book cover)

The Art of Game Design: A Book of Lenses by Jesse Schell comes highly recommended. Sebastian Deterding, for example, says it is the one to read (along with A Well-Played Game by Bernard De Koven, an old book that is soon to be re-released in an updated version). Mr. Schell, of Carnagie Mellon’s Entertainment Technology Center, and of The International Game Developer’s Association, has both the industry experience (he designed Toontown Online for Disney, for example) and the academic position to be taken very seriously. This book, at more than 500 pages, requires a serious investment in time.  It is theoretical, it is practical, and it will help you to see things differently through different lenses.

 

Embedded Formative Assessment (book cover)

Embedded Formative Assessment by Dylan Wiliam is a book that is not at all about gameful design, and yet what is contained here is very important if you are interested in making learning happen. “Fun is just another word for learning,” said game design guru Raph Koster. And learning happens with feedback–lots of it, in a social context, from peers, teachers, and the learner herself. This book will explain why. This book will sell you on the need for feedback in education. This importance of feedback, for learning, for fun, is at the heart of gameful design. That, and the playfulness that Mr. Anderson talks about (see above). Without good feedback, games become an end unto themselves; the feedback only helps the learner get better at the game. In educational game design, the trick is to use the game to build knowledge or develop skills that go beyond the game. Mr. Wiliam will help to keep your one foot planted squarely in pedagogy. And some of his ideas for providing feedback, you’ll notice if you’re looking through your ludic lens, are pure gamification.

 

 

 

 

Formative Assessment Pt. 5: Owning Learning

This is the final post considering the implementation of Dylan Wiliam’s ideas on formative assessment in EFL classrooms in Japan. The ideas come mostly from his wonderful 2011 book titled Embedded Formative Assessment. You can learn more about Mr. Wiliam from his website or from a BBC documentary titled The Classroom Experiment (available on YouTube: Part 1 and Part 2). Earlier posts covered these topics: 1) Raising Awareness of Learning Intentions, 2) Eliciting Evidence of Achievement, 3) Feedback from the Teacher, and 4) Peer Feedback and Cooperative Learning. This post will look at how to make learners more autonomous. This does not necessarily mean getting learners to do more outside of the classroom (though it can). Often it means just having the learners clearly signal when learning is not happening, and reaching out for resources that can rectify that.

As a parent, I know that the most efficient way of getting my kids to clean up the family room is to do it myself. It’s faster, I can be sure the job is done well, and best of all, no time or energy has to be used for the messy business of requesting, cajoling, demanding, and inevitably, getting angry and/or disappointed. But, as my wife so correctly points out, that’s just bad parenting. It’s also a bad way of going about teaching. Ultimately, it is the learners who have to learn. And they need to learn how they learn and how they can improve that. But it ain’t easy.

One of the themes of Embedded Formative Assessment is to focus on the the cognitive, the task, the goal, and learning,  and take the focus off the emotional, the immediate sense of well-being, and “get the egos of the students out of the learning situation.” For improved autonomy, this entails dealing with issues of metacognition and motivation and Mr. Wiliam does another nice job of laying out the research context. What goes on in a learner’s head is tricky because so many things are at play–and the cognitive/motivational landscape is,  like any good offer you manage to find, subject to change without notice. As Mr. Wiliam summarizes it, it depends on the learner’s “perception of the task and its context, [the learner’s] knowledge about the task and what it will take to be successful, and [the learner’s] motivational beliefs, including their interest and whether they think they know enough to succeed.” Greatly affecting  this is the notion of self-efficacy, the belief that success comes from effort and is attainable. That needs to be nurtured, as I have mentioned before. But Mr. Wiliam is suggesting a wider approach. Everything he has talked about in the previous chapters helps to promote autonomy, by encouraging the learner to focus on growth. Encouraging the transfer of executive control from the teacher to the learner is just another part of it, and if the focus of the course and  the focus of the class  is on learning, on giving and getting feedback that moves the learning forward, then it is easier for the learner to see that as one of her own jobs, too. There are, of course, no “quick fixes.” But Mr. Wiliam provides a few practical ideas for encouraging learners to move toward owning learning. One of the  keys is establishing channels of communication and then promoting their use.

Colored Cards or disks, or cups for reacting to difficult topics.  Mr. Wiliam suggests a few ideas of how to use traffic light cards or cups or disks or marks to signal to the teacher if learning or understanding has happened or not. Creating an environment where learners can use the signals is essential for their success. Part of that involves responding in a way that takes the teacher’s ego out of the equation as well. The teacher needs to react responsibly when learners signal a failure of learning. One idea Mr. Wiliam suggests, illustrates how this can be done to promote autonomy. Let’s say the teacher has just finished explaining a particularly gnarly grammar item like the difference between perfect and simple past tenses. The students signal their understanding using cups/cards/disks. After students hold up red, yellow, or green cards, the teacher instructs  the green card students to help the yellow card students while she gathers the red card students together for further teaching or help. Everyone wins here. The students feel the teacher is responsive. The good learners get a chance to cognitively elaborate, the weak learners get some rephrasing/reinforcement, and the weakest learners get the second chance they need.

Learning Portfolios. For productive skills, have the learners keep samples of their writing or presentations or conversations in a portfolio. This can be done digitally, though that will require some tech savvy on the part of the teacher. The idea is to have a few samples that can allow the learner to see the trajectory of his or her improvement. That sends two very important messages: change is happening (possible); and you make it happen. I’ve done something similar in writing class effectively. I had learners keep their’ first assignments after asking them how long it took them to complete them. Then at the end of term, I asked them to compare their first assignment to their most recent assignment in terms of sentence variety, sentence word length, and time for assignment completion. The results  always showed improvement and caused learners to feel proud of their achievement. I used to look forward to that class every year.

“Reflecting critically on one’s own learning is emotionally charged, which is why developing such skills takes time, especially with students who are accustomed to failure,” Mr. Wiliam says. He is talking about all but a few of the English language learners at high schools in Japan, I’m afraid, where average exam scores are in the 40s or 50s or 60s. Success is usually passing a test and not accomplishing a communicative act, or understanding or performing with confidence. Mr. Wiliam’s techniques can help make classrooms less of a teacher-controlled one-way info barrage. That would be a step in the right direction.

 

 

Formative Assessment Pt. 4: Getting Other Learners Involved

This is the fourth post considering the implementation of Dylan Wiliam’s ideas on formative assessment in EFL classrooms in Japan. The ideas come mostly from his wonderful 2011 book titled Embedded Formative Assessment. You can learn more about Mr. Wiliam from his website or from a BBC documentary titled The Classroom Experiment (available on YouTube: Part 1 and Part 2). The first posting in this series looked at learning intentions. The second looked at eliciting evidence of achievement. The third looked at how and when teachers can best provide feedback to learners. This post will look at cooperative learning and peer involvement in learning. Mr. Wiliam’s point is that when learners are working together and helping each other, they are naturally giving and getting formative feedback.

Real cooperative learning is a little like real communism. It’s a nice idea but in actual practice, too many people just game the system for their own benefit to get maximum reward for minimum effort. Teachers have serious–and well-founded–concerns about the amount and quality of participation that is brought to the group table by all members. Mr. Wiliam’s comparatively short  chapter on activating students as instructional resources for one another approaches the topic with a tone that makes you think he shares at least some of that sense of trepidation. The research is clearly positive, and Mr. Wiliam presents the profound effects that have been found for cooperative learning, if it is done right (which it usually isn’t). Mr. Wiliam explains how it works (motivation, social cohesion, personalization, and cognitive elaboration) and what two elements are crucial (group goals and individual accountability) before ending the the first part of the chapter with a discussion on how many teachers have a problem with pure, uncut cooperative learning (holding everyone accountable by giving everyone in a group the same score as the lowest-scoring member) and then citing stats that show how few teachers are actually making use of real cooperative learning in their classrooms (very, very few). And on that mixed note of confidence, he begins listing his techniques. I’ll get to the techniques I think might work in Japanese high school EFL classes in a moment, but first an educational culture point needs to be addressed.

There seems to be a strong sense that Japanese classrooms are naturally more cooperative because, well, Japanese group culture makes it easier. Mr. Wiliam states the same thing in his book, listing as “proof” the contrasting proverbs of the squeaky wheel gets the grease (US) and the nail that sticks out will get hammered down (Japan). In addition to the book containing  a mistake with the Japanese version of the proverb, I think this generalization is more than a little stereotypical. Anyone who has seen Japanese students “unmotivated” in regular classes come together in a club activity or festival project knows that  group power and individual accountability are impressive but cannot be taken for granted; and anyone who has seen PTA mothers–dedicated, concerned parents all–trying to avoid being elected for positions that require work knows that Japanese, like anyone else I imagine, can go to pretty great lengths to remain uninvolved, despite being a members of a nation known for being responsible and group-oriented. But I don’t want to get on Mr. Wiliam’s back because his main point is sound: we want to get everyone more involved with helping each other because there are great benefits when that happens; and it really matters how you do it.

One idea that any school can use is the “Secret Student.” You can see it in practice in the BBC video. It is a devious bit of peer pressure judo teachers can use to promote better behavior in the classroom and I think it would work brilliantly in Japan. Each day one student is chosen at random as the secret student and his/her behavior is monitored by the teacher(s). If the student’s behavior/participation is good, his/her identity is revealed to the class at the end of the lesson or day. And the whole class gets a point that goes toward some reward (a trip to an amusement park in the video!). If the behavior/participation of the student is unsatisfactory, the identity is not revealed and the class is informed that they did not get a point for that day. This would almost certainly help to improve participation and reduce disruptive behavior (two really big problems in most high school English classrooms). The only problem is what reward can be offered. It would have to be something possible yet motivating.

One technique to get started with cooperative learning is “Two Stars and a Wish.” Students give feedback on other students’ work  by stating two things they like and one thing that they think could be improved. Mr. William suggests using sticky notes for this feedback. He also suggests picking up some of the feedback comments from time to time to teach students how to give better feedback. This last point is important because it is precisely the generally poor quality of student or peer feedback that makes many teachers to unenthusiastic about peer feedback. There are many times in a language course when students are just out and out unable to provide good feedback. But learning how to give feedback well when it is possible to do so is a real learning opportunity that can benefit the giver and (eventually) the receiver. This technique could be used well for anything students write, translate, present, or any time students produce anything in the target language.

One activity that he suggests, “Error Classification,” probably wouldn’t work in a language classroom as he suggests. This activity requires learners to pour over writing examples to classify the errors made. It sounds nice, but it is unlikely the learners would be able to do this at all but the most proficient of classes. And even if they could, spending so much time on superficial mechanical errors  may not be a good idea. Another activity, “Preflight Checklist,” might be much better for student writing assignments. For this activity, students are given a list of requirements for the writing assignment (things like proper format, clear topic sentence, logical organization, subject-verb agreement, or whatever the teacher is focusing on at the time). Another student is responsible for checking the writing and signing off, meaning certifying that the first student’s writing meets all the requirements.

And a final activity that I think would work well in EFL classes is providing a little time at the end of a lesson or section for pairs or groups to discuss and report on what they have learned. This can be a nice student-led review, and a chance for teachers to see what has and has not been grasped well.

To really get the benefit of cooperative learning, teachers need get learners to have group goals and accept the idea of shared responsibility and accountability. This may be problematic in many situations for many reasons, depending on the year, the course, and the proficiency and motivation differences of learners. I have recently observed a class where the teacher was making extensive use of group cooperative learning. Out of six groups, it was working for three but not really working for the other three. For it to work, it seems that some training, some acceptance of the approach, some accountability, and a fair bit of time are all necessary. When it comes to cooperative learning in Japan, perhaps introducing more chances for learners to see, formatively assess, and then communicate that assessment might be the best way to start. Real cooperative learning is hard, takes a serious commitment, and can all be for naught if not done (and embraced) well.

Next: Part 5, Encouraging greater autonomy and ownership of learning.

 

Formative Assessment Pt. 3: Moving Right Along

This is the third post considering the implementation of Dylan Wiliam’s ideas on formative assessment in EFL classrooms in Japan. The ideas were gleaned from his wonderful 2011 book titled Embedded Formative Assessment. The first post in this series looked at learning intentions. The second looked at eliciting evidence of achievement. This post will consider how and when teachers can best provide feedback to learners. This part of the book takes up the theoretical rationale for giving feedback.

Let’s start with a question: is a grade feedback? That is, is it information–meaningful, understandable, actionable information–that contributes to the learning process? Mr. Wiliam says usually it is not. In the language of assessment, there is summative assessment and formative assessment. And grades are not formative assessment. And in Mr. Wiliam’s view, formative assessment is really all that matters.

If we think carefully about it, and Mr. Wiliam has, we can see that there are four possible responses to feedback: the learner can change his behavior (make more or less effort); the learner can change his goal (either increase or reduce his aspiration); the learner can abandon his goal altogether (decide that it is too hard or too easy); or the learner can just reject or ignore the feedback. As teachers, we know which of these actions we want learners to take, but what the learner actually does depends on how he sees the goal, the feedback, the feedback giver, and a host of other factors. Feedback seems straightforward in the teaching/learning culture we grew up with. But it is not. In fact, getting it right is really hard. But before we even try to get it right, a more fundamental mindset change is necessary. We have to understand that much of the “feedback-giving” we have traditionally done as teachers has been a waste of time–our time mostly–and has not contributed to learning. Much of or the “feedback-giving” we thought was so important, turns out to either have negligible effect or even negative effect. Yup, negative.

Feedback needs to “cause a cognitive rather than emotional reaction in learners”. It must “make learners think”, and it is only effective “if the information fed back to the learner is used by the learner in improving performance.” And this is why just giving grades is problematic. Students first look at their grades, then they look at the grades of other students, and they generally don’t even read those elaborate comments you spent all that time writing. Providing good feedback is difficult. It requires breaking down each learning intention into micro-skills, or micro-concepts, or significant units, and then being able to identify exactly what the learner is not doing right and how he can improve. The timing is also important. Performance must be fresh in a learner’s mind and there must be time to make use of that feedback on subsequent performance. The amount is important. It must be focused enough to be understandable and actionable. And learners need to believe they have the power to make changes that lead to improvement. They have to trust the teacher and believe in themselves. These are not givens. Teacher praise of effort (see Carol Dweck, who Mr. Wiliam cites often in this chapter) affects this, but so do task perception and the social atmosphere of the classroom.

For language classes with their combination of knowledge learning and skill building, this is a challenge that will require at least two distinct approaches. For skill building, the teacher must act more like a coach. Speaking, writing, listening, and reading must be broken down into micro-skills and learners need to be given feedback on each one so that they and the teacher get a picture of how they are doing and what they need to improve. Let’s take listening as an example. Mr. Wiliam suggests a chart of micro-skills based on the rubric of learning intentions for the course and a score of 0, 1, or 2 for each. 0 means no evidence of mastery; 1 means some evidence of mastery; and 2 means strong evidence of mastery. Both the learner and the teacher get a good idea of what is being done well and not so well, and the rubric (provided earlier) clearly states the conditions of mastery performance. The teacher can then concentrate on giving advice for improving performance. Let’s say the micro-skills include  genre identification, understanding reduced speech, identifying transition signals, or keeping up with native speed levels. The teacher has ways of checking all of these and knows ways of improving each of them.

For productive skills like conversation skills or presentation skills, the same can be done. In addition, video can be used to give feedback and provide a marker against which future performance can be judged (though Mr. Wiliam doesn’t specifically suggest this in the book). I tried this back in the day of VHS analog video and it worked really well, though it was very difficult to get learners to watch critically and reflect on their performance and think about how to improve it. The original idea came out of work done at Nanzan University in the 1990s by Tim Murphey, Linda Woo, and Tom Kenny (here is a later article explaining how it is done). Recently, with digital video and with every student sporting a smartphone or a tablet, this can be done much more easily. Techsmith has a brilliant app available for exactly this purpose, called Coach’s Eye. It allows you shoot and annotate a video and then share it.

For any kind of written work (translations, example sentences, paragraphs, essays, culture notes, etc., something Mr. Wiliam suggests is providing feedback without the grade. This can be done individually or in groups. For groups of four, for example, essay comments can be handed out separately on four sheets of paper. The four corresponding essays are also handed out and the learners in the group must work to match the comments to the paper. This forces them to consider the comments and it gives them a way to compare their performance on specific criteria against that of others. After that–and this is a critical step–the learners are given a chance to make adjustments to their papers and resubmit them for actual grading.

Mr. Wiliam quotes Alfie Kohn in the chapter: “never grade a student while they are still learning.” This is good advice. It can help a teacher to get into the best mindset to move learning along. Mr. Wiliam provides a strong case for doing this. The differences in learning outcomes between classes that employ formative assessment and those that do not are stunning. Teachers should be coaches, encouraging, developing, and training essential skills for performance. Formative assessment is the key, I believe, to getting teachers to assume a more effective role in the classroom and to building a community of learning. More on that last point when we look at what Mr. William has to say about leveraging peer feedback in the next post.

Next: Part 4, Getting other learners involved.

Formative Assessment Pt. 2: Eliciting Evidence of Achievement

This the second post of a series  considering  Dylan Wiliam’s ideas on embedded formative assessment in EFL  classes at high schools in Japan. Mr. Wiliam is a proponent of assessment for learning, a system where teachers work closely with learners to guide them to better learning. In the previous post, I looked at learning intentions, picking up some of his recommendations and describing how they might fit in EFL classes.  To learn more about Dylan Wiliam, you can visit his website, or read this article from The Guardian, or read his latest book about why and how to make greater use of formative assessment, Embedded Formative Assessment. A BBC documentary of his initiatives called The Classroom Experiment is also available on YouTube (Part 1 and Part 2). Some of the ideas in this post are observable in the TV program and I encourage you to watch it. The book is much richer than the program and I encourage you to get and read it.

In Chapter 4 of his book, Dylan Wiliam illustrates a problem with a nice story. Ask small children what causes wind and they might say it’s trees. They are not being stupid, they are using their observations and creatively making sense of what they see. But it’s a classic confusion of correlation and causation. Your own students would never do such a thing, would they? Oh, yes, they would. They misunderstand, misinterpret, overgeneralize, oversimplify, etc. etc.  probably more often than you think; and it’s your job as a teacher to catch them when they do. By eliciting evidence of learning (or lack of learning), we make it easier for learners to stay on the path of learning. It is important–crucial–that learners and teachers know if learners are on that path, or are veering into the trees (as it were). Very often students manage to achieve the correct answer without really understanding why. But by cleverly using questions and other techniques and attentively listening to learners, we (and they) can get a better idea of how they are progressing. Teachers, aware of some of the common problems learners regularly experience, should give learners the opportunity to make those common errors. This garden path/trap technique is unfair on a test, but is a useful tool in assessment where the goal is to make error salient to  the learner, his peers, and the teacher.

At present, too few of the questions teachers ask in class help to do this. In research cited by Mr. Wiliam for an elementary school class, 57% of teacher questions were related to classroom management, 35% was used for rehearsing things students already know, and only 8% required students to analyze, make inferences, or to generalize–in a word, to really think. For Mr. Wiliam, this represents a good place to make some changes and he suggests things that we do two things at the same time: promote thinking (to see if it’s happening), and increase engagement in that thinking by a larger percentage of the class. These things, unsurprisingly, have “a significant impact on student achievement.”

So how can things be done in language classrooms? Looking at the chapter, it seems that most of this applies to science, history, and math courses, the ponder and wonder courses. Language courses, especially if we have a strong skill focus element as I pushed for last post, seem to require a different kind of learning. But all disciplines are a combination of skills and knowledge. And the techniques Mr. Wiliam describes can be adjusted for different parts of different courses. I will use the terms question and answer when illustrating the techniques, but they could be used for knowledge questions of usage or application of strategies or skill demonstrations of listening or reading comprehension or pronunciation, etc. So let’s get to them. Once again, I am selecting the techniques I think best match high school EFL courses. This is not a comprehensive list and the examples are mostly illustrated by how I imagine they could be used here in Japan. Here we go.

1) The No Questions By Role Rule (my variation of the No Hands Up Rule). Fortunately in Japan we are not oppressed by that small clique of students in every class who seem to raise their hands to venture answers or provide extra comments for almost every question and statement that comes out of a teacher’s mouth. I’ve probably had fewer hands up to answer questions in my 25 years of teaching here than the average North American teacher experiences on a Monday morning. In order to prevent that small clique from monopolizing class (and learning) time, Mr. Wiliam came up with his No Hands Up rule. In Japan, teachers typically go down the role list or go up and down rows picking the students to answer questions. It’s more democratic, yes, but there are similar problems. I’ve regularly observed students counting the questions and students so they can focus on getting their answer to their question right, completely disregarding every other question. What we need is for all students to be engaged in answering all questions. So instead of the roles or the hands, Mr. Wiliam recommends a pot of popsicle sticks, each with the name of one of the students written on it. The teacher asks a question and then pulls a stick from the pot and asks that student to answer it. It forces all students to pay attention and try to come up with an answer since they don’t know when their name will be called.  Of course, variations on this can make it better for your class (see the video for some of these). Adding more than one stick for some special  students is one way, and putting a student in charge of pulling names is another. Another technique is the Pose-Pause-Pounce-Bounce, which can be used along with the sticks. Ask the question, and give everyone a bit of time to think; then choose a student to answer; then ask another student to evaluate the first student’s answer.

Some of you are already shaking your heads. Too many students will answer with “I don’t know.” It’ll be stick after stick after stick of “I don’t know.” What’ll you do then, huh? Well, Mr. Wiliam offers a few suggestions for that, too, because it is essential that all students be brought into the ring of engagement. Get more students to answer and then ask the I-don’t-knower to choose the best answer. Or gamify things a little. Use game techniques like “Phone a Friend“, or give the student two choices and let him or her gamble on the answer. The key point is: keep them engaged and thinking, no matter what it takes, for as long as it takes. Don’t let them slip into drowsy disengagement in the warm sunlight in the back corner of the class. Sleeping students are a real problem in Japan. Sleeping should not be allowed. A policy of zero tolerance for disengagement should be embraced. It’s not easy and it might negatively impact the brighter, more motivated learners for a while, but in the end it is a better approach, Mr. Wiliam argues. Watch the video of  The Classroom Experiment to see some blowback, though.

2) Hot Seat and Waiting Time. In the Hot Seat technique, one student is chosen to answer several teacher questions. Another student is then chosen to summarize or report on what the first student answered. The teacher then gives his or her evaluation. The reason for this is to give learners enough waiting time to process and evaluate in their own heads the answers of their peers before the teacher provides the “correct” answer. Without that waiting time, learners just listen and wait for the right answer from the teacher rather than develop the habit of evaluating ideas themselves. This, of course, can be done with any questions. Be sure to allow enough time for everyone to hear, process, and assess an answer before you,as the teacher, pronounce judgement on it.

3) Multiple Choice Questions For Thinking. Give the learners a set of three, four, or five sentences and ask them to answer a question about them. Which are grammatically correct? Which are academic and which are more casual? Which grammar rules are true? How are the items related? Which one doesn’t belong in the set? Etc. These are all questions that can stimulate pair, group, or whole-class discussions.

4) Variations for No. 3. There are many ways of making use of questions or multiple choice questions or statements for evaluation mentioned in the book. Giving learners cards (A,B,C,D, for example) that everyone can hold up to display their choices can be a nice way of getting the whole class involved in answering. Exit passes are another variation. Each student must write and submit an answer or an opinion on a paper before leaving the class. This forces all students to participate and gives the teacher something concrete in his/her hands.

Many of these techniques are second nature to many teachers, but it is amazing how many do not ever dip their toes in the waters of achievement checking until they are slashing stokes on the the final tests. Making thinking visible has been a buzzy concept for the last few years. One book promotes many ideas for doing so, one of which fits right in with what Mr. Wiliam is suggesting. When eliciting student responses, ask a follow-up question: What makes you say that? This is something I’ve tried successfully in my own classes. It makes students think more deeply and justify their ideas more. Ideas like this are not only effective in L1 content courses. Ideas and approaches like Mr. Wiliam’s  could work very nicely in EFL classrooms in Japan. At present there is a strong tendency for the teacher to just teach, imparting (or so he/she believes) knowledge to learners. Learners are asked to “study.” But aside from memorizing words, or memorizing the text, they usually don’t know what to do. Next year, the Ministry of Education is pushing for all teachers to teach English in English. Mr. Wiliam’s techniques can fit really nicely with that. The techniques listed above could allow for more meaningful use of English in the classroom, more engagement by all learners, and very possibly more learning.

Next: Part 3, Moving right along.

Formative Assessment Pt. 1: Learning Intentions

This the first post of a series on considering embedded formative assessment in EFL  classes at high schools in Japan. In previous posts (here and here), I mentioned some of the potentially powerful reasons for making use of this type of formative assessment. Dylan Wiliam, a teacher/administrator/researcher/teacher training from the UK believes that the single most effective (and cost-effective!) way of improving learning is for teachers (and learners) to provide assessment for learning, not assessment of learning. This requires a rethinking of the purposes, timing, and techniques of assessment. In Japanese EFL classes, it will likely involve more than this…In this series, I will look at the possible application of Dylan Wiliam’s stages of formative assessment here in Japan. To learn more about Dylan Wiliam, you can visit his website, or read this article from The Guardian, or read his latest book about why and how to make greater use of formative assessment, Embedded Formative Assessment. A BBC documentary of his initiatives called The Classroom Experiment is also available on YouTube (Part 1 and Part 2). But before we go on, it is important to clear one thing up: assessment for learning is perhaps not the assessment you are thinking of if you are thinking about grading. It has very little to do with grading and everything to do with informing the teacher and the students (and possibly others, including peers and parents) about how to learn. So the topic of testing for grading will not be addressed here.

Where are we going? Or more precisely, where am I going? This is the question that should be on the minds of all learners as they select a course or arrive for the first lesson. It is a question that needs to be kept in mind as learners proceed through courses as active monitors and agents in their own learning. But often in institutionalized settings, it is not. Instead, the learners do not voice any expectations they may have and just flip through the textbook for a hint of the things they will learn. It’s frustrating for some, but years of similar starts to courses have made it unquestionably normal.

Too often in high schools in Japan, the teachers actually have a fairly similar experience. They flip through the textbook to see what it is they are going to teach in the upcoming year. That is, many schools fail to create a curriculum with specific skill targets for each year and instead they let the textbooks (OK, Ministry-approved so they must be appropriate, no?) decide what they are going to teach. It is the content of the textbook that becomes the de facto syllabus for the course. Having students learn–usually meaning “memorize”–the content of the textbook becomes everyone’s purpose. And it is at the point of this decision to not make a syllabus with specific skill targets and instead just teach the textbook from start to however far we get, that the first obstacle to deploying embedded formative assessment  emerges. For once the textbook becomes the object of learning, it changes the course content into a body of knowledge or information. It shifts the goals of the course from the learner’s skills and ability to something outside the learner. The starting and ending point of learning is no longer the learner, but the percentage of the textbook that the learner can “master.”

That is not to say that the textbook content cannot be a good part of a syllabus for a course. Used flexibly, by a dedicated teacher, a good textbook contains enough interesting activities and content that it can provide structure for a course and facilitate learning. But there’s an expression in English that we need to keep in mind: when the only tool you have is a hammer, every problem begins to look like a nail. For HS teachers in Japan, the textbook becomes the hammer with which they address the needs of every unique learner in the class. It is not the most effective way to teach and it doesn’t have to be this way. With clear skill targets, the teacher and the learners get a way of talking about learning. The teacher gets something she can show, demonstrate, and measure the progress of. The learners get a model and a yardstick. Of course all language courses feature a combination of knowledge content, skill content. But a greater emphasis on skills by everyone in the classroom is necessary to prevent the course from focusing completely on knowledge and understanding, things that will not actually matter that much when learners try to make use of the target language in the real world.

“It is important that students know where they are going in their learning and what counts as quality work, but there cannot be a simple formula for doing this,” says Mr. Wiliam. Look at that first part again: “know where they are going in their learning and what counts as quality work.” The learners need to have a better idea of what they can do now and and what they will be expected to be able to do and know by the end. They need to see it. They need to see themselves, the target, and the gap. This is, at present, not a common way that schools, English departments, or individual teachers approach the kids who come to them to learn. The focus of Mr. Wiliam’s book and  assessment for learning (AFL) is entirely the classroom and the learners in it. He does not spend any time discussing placement tests or proficiency tests. Instead, the learners are asked to consider learning intentions for every unit, topic, or module the class will encounter.  And he provides several concrete suggestions as examples for how this can be done. Many of them are collaborative in nature. I went through them and pulled out the ones that I thought could be adapted for use in English language classes in Japan. In most cases, the actual example is described as how I would imagine using the technique in HS English classes. If you want the complete list of original examples, you’ll just have to get the book, something I recommend anyway.

First up is passing out 4-5 examples of student work from the previous year. In the book it is done with lab reports, but it could be done with any kind of student writing (or if you have recorded examples of presentations or student speaking, that would work, too). In groups, the learners rank the works and report on how they assessed them. This lets the criteria for better performance become salient through comparison and discussion. Teachers may want to provide some topics or questions to guide the learners’ attention to specific aspects.

A variation of the  above involves the work of the present class. After the writing assignment is completed, the teacher collects them all and reads them, selecting what he thinks are the three best examples of student writing. No other feedback is on the paper at this point–no grade and no comments. The teacher hands out copies of the best student writing. The learners are asked to read them for homework and then discuss why the teacher thought these were the best. Then–and here’s the important step–all the students (including the authors of the best papers) get their papers back and are given time to redraft their writing. They then, finally, submit them for a grade.

In “Choose-Swap-Choose” learners choose a good example of their own work from several they have made (a short recorded speech, for example). They then submit these to a partner who then chooses the one he/she thinks is best. The two students discuss their choices if there is disagreement.

One good idea of reading aloud or pronunciation classes has learners in groups practicing the recitation of a short passage in the target language. Each group then chooses the learner who they think has the best accent and the whole class listens in turn to the representatives of each group. The teacher comments on the strengths and weaknesses of each one.

And finally, have the learners try to design their own test or test items for mid-term or end-of-term tests. Of course, this should be done while there is still time to make use of the feedback that emerges from this activity. But in making test items, students clearly show what they think they have learned and what they think is important.

The main thing to point out from all of the above techniques is that they provide feedback to both the learners and the teacher. The learners can use that information to make adjustments to their learning. And the teacher can use it to see what has been learned and how well in order to make adjustments to teaching. All of these techniques promote meta-cognitive skills. They also contribute to the creation of a community of learners. According to Mr. Wiliam, they also definitely lead to better learning. But would this approach work at high schools in Japan? The answer is a great big “it depends.” It depends on the levels of motivation and trust in the classroom. It depends on whether the teacher can afford the time it takes to allow learners to examine and discuss the work of others. And it depends on the mindset of the teachers. They need to be willing to try out a more learner-centered approach to teaching and learning, one with a greater emphasis on skills. Many–too many–teachers prefer to teach content at the students and leave the learning up to them. Too many have their syllabus strapped to the ankles of the syllabuses of the other teachers teaching the course in a given year. There is nothing to do but move along in lockstep. But I think that some of these ideas could be put into practice in almost any school in the prefecture where I work.

In the next post, we’ll look at what Dylan Wiliam says about how to elicit evidence of learning. Part 2: Eliciting evidence.