Making EFL Matter Pt. 6: Prepared to Learn

image of students

The present series of posts is looking at how EFL courses and classes in Japan might be improved by considering some of the techniques and activities emerging in ESL and L1 mainstream education settings. Previous posts have looked at goals, data and feedback, discussion, portfolios, and prolepsis and debate. The basic idea is to structure courses in accordance with the principles of formative assessment, so students know where they are going and how to get there, and then train them to think formatively and interact with their classmates formatively in English. All of the ideas presented in this series came not from TESOL methodology books, but rather more general education methodology books I read with my EFL teacher lens. I realise that this might put some EFL teachers off. I don’t think it should, since many of the widely-accepted theories and practices in TESOL first appeared in mainstream classes (journals, extensive reading, portfolio assessment, etc.); also,  the last few years have seen an explosion in data-informed pedagogy, and we would be wise not to ignore it. In this post, however, I’d like to go back to TESOL research for a moment and look at how some of it might be problematic. Actually, “problematic” may be too strong a word. I’m not pointing out flaws in research methodology, but I would like to suggest that there may be a danger in drawing conclusions for pedagogy from experiments that simply observe what students tend to do or not do without their awareness raised and without training.

I’ve been reading Peer Interaction and Second Language Learning by Jenefer Philps, Rebecca Adams, and Noriko Iwashita. It is a wonderful book, very nicely conceived and organized, and I plan to write a review in this blog in a short time. But today I’d just like to make a point connected with the notion of getting learners more engaged in formative assessment in EFL classes. As I was reading the book, it seemed that many of the studies cited just seemed to look at what learners do as they go about completing tasks (very often picture difference tasks, for some reason). That is, the studies seem to set learners up with a task and then watch what they do as they interact, and count how many LRE (language related episode) incidences of noticing and negotiation of language happen, or how often learners manage to produce correct target structures. Many of the studies just seem to have set learners about doing a task and then videoed them. That would be fine if we were examining chimpanzees in the wild or ants on a hill; but I strongly believe it is our job to actively improve the quality of the interactions between learners and to push their learning, not just to observe what they do. None of the studies in the book seem to be measuring organized and systematic training-based interventions for teaching how to interact and respond to peers. In one of the studies that sort of did, Kim and McDonough (2011), teachers just showed a video of students modelling certain interaction and engagement strategies as part of a two-week study. But even with that little bit of formative assessment/training, we find better results, better learning. The authors of the book are cool-headed researchers, and they organize and report the findings of various studies duly. But my jaw dropped open a number of times, if only in suspicion of what seemed to be (not) happening; my formative assessment instincts were stunned. How can we expect learners to do something if they are not explicitly instructed and trained to do so? And why would we really want to see what they do if they are not trained to do so? Just a little modelling is not bad, but there is so much more that can be done. Right Mr. Wiliam? Right Ms. Greenstein?

Philps et al. acknowledge this in places. In the section on peer dynamics, they stress the importance of developing both cognitive and social skills. “Neither can be taken for granted,” they state clearly (pg. 100). And just after that, they express the need for more training and more research on how to scaffold/train learners to interact with each other for maximum learning:

“Part of the effectiveness of peer interaction…relates to how well learners listen to and engage with one another…In task-based language teaching research, a primary agenda has been the creation of effective tasks that promote maximum opportunities for L2 learning, but an important area for research, largely ignored, is the training of interpersonal skills essential to make these tasks work as intended” (pg. 101).

But not once in their book do they mention formative assessment or rubrics. Without understanding of the rationale of providing each other with feedback, without models, without rubrics, without being shown how to give feedback or provide scaffolding to peers, how can we expect them to do so, or to do so in a way that drives learning. Many studies discussed in the book show that learners do not really trust peer feedback, and do not feel confident in giving it. Sure, if it’s just kids with nothing to back themselves up, that’s natural. But if we have a good system of formative feedback in place (clear goals, rubrics, checklists, etc.), everyone knows what to do and what to do to get better. Everyone has an understanding of the targets. They are detailed and they are actionable. And it becomes much easier to speak up and help someone improve.

Teachers need to make goals clear and provide rubrics detailing micro-skills or competencies that learners need to demonstrate. They also need to train learners in how to give and receive feedback. That is a fundamental objective of a learning community. The study I want to see will track learners as they enter and progress in such a community.

 

Kim, Y., & McDonough, K. (2011). Using pretask modeling to encourage collaborative learning opportunities, Language Teaching Research,15(2), 1-17.

 

Making EFL Matter Pt. 4: Portfolios and Assessment

desktop image

In principle, a portfolio is an easy to understand and intuitively attractive concept: students keep the work they produce. The real challenge of a portfolio is what you do with it. Without a clear vision of how the tool will be used, it can easily end up being a little like a child’s art box of works produced in art class in school over the years—just a repository of things we hold on to for no specific reason other than sentimental attachment. We might pull these works out to look at them from time to time, but they are not a clear record of achievement, nor can they help inform future learning decisions. The central function of a quality portfolio is to clearly provide evidence of growth and to “…engage students in assessing their growth and learning” (Berger, Rugen & Woodfin, 2014, pg. 261). Specifically what growth depends on the goals of the course or program. When a course or program has clear goals, a portfolio can have a formative or summative role in demonstrating a learner’s achievement or progress toward achieving those goals. There are also practical/logistical constraints on portfolio deployment. What artifacts should be included, how many should be included, where should the artifacts be stored, and how will the portfolio be assessed and by whom, are all important decisions. The results of these decisions can greatly impact the success of a portfolio as a learning tool.

 

Conceptualizing a portfolio

A portfolio is not simply a repository file. It must serve as a record of progress that is used to assess learning by the learner him/herself or by others. All decisions on its structure and deployment must start with this basic understanding. The design of the portfolio itself, and its integration into the syllabus (i.e., how it will be used on a regular basis) must aim to make it as easy as possible to record progress/achievement, to make visible evidence or patterns progress/achievement in the collected data. For this reason, not only student-produced academic work (essays, presentations, tests), but also documents that make progress and achievement salient should be kept in a portfolio. Such documents may include introductory statements, target-setting plans, records of times on tasks, assignment rubrics, progress charts, and reflection reports.

 

The importance of goals

In order to be effective, the portfolio must be closely aligned to the goals of the course or program and be able to show progress toward or achievement of those goals. In other words, it must be able to provide specific evidence of progress in achieving the target competencies in a way that is clear and actionable. It must also do so in a way that makes the most effective or efficient use of time. These goals can include knowledge goals, skill goals, or learning goals for constructs such as responsibility, autonomy, revision, collaboration, service and stewardship (to name a few). Without clear goals (usually arranged in a clear sequence), effective use of a portfolio cannot be possible. Without clear goals, the formative and reflective functions of a portfolio cannot be leveraged in a clear and actionable way. However, if students know what they are aiming for and can compare their work in how it meets the target competencies (using the descriptions and rubrics that define the goals/competencies), portfolios can be a powerful tool for reflection and formative feedback.

 

The importance of regular portfolio conversations

“In order for portfolios to be a tool for student-engaged assessment, including formative and summative assessments, they must be a regular part of the classroom conversation, not a static collection of student work” (Berger, Rugen & Woodfin, 2014, pg. 268). The portfolio must be a tool of measurement, like a bathroom scale, and can only be effective if it is used regularly. Students must regularly enter data into it (more on what kinds of data in the next section), and they must use it to look for patterns of success and gaps in learning/performance and strategy use. For this reason, providing clear guidelines and time to enter data into portfolios, facilitating the noticing of patterns and gaps, and giving opportunities for students to discuss their progress in groups, are all necessary. This will require classroom time, but also some scaffolding so students can understand how to work with data. Student-led conferences (mini presentations on progress done in groups in class) can be a useful tool. In groups, students can practice talking about learning, but also compare their progress and efforts with those of their classmates. Counselor conferences can also make use of portfolios, and if students have practiced beforehand in groups, time with counselors can be economized. Finally, to truly leverage the power of portfolios, passage presentations (public presentations where students explain and defend their learning accomplishments to groups of teachers, parents, or other concerned parties) can be particularly powerful since they are public and official. If a passage presentation system is in place, it will serve to make the portfolios more meaningful, greatly enhancing the effort students will put into entering and analyzing data and the amount of time they spend analyzing and practicing explaining their learning. Passage presentations and counselor conferences can transform student-led conferences into the role of practice for “the big games.”

 

Portfolio contents Pt. 1: What are we trying to develop?

Let us review our key points so far. It must be easy to enter meaningful data into the portfolio and notice trends or gaps. Noticing the trends and gaps in performance requires an understanding of the goals of the course/program, so they must be clear. The portfolio should be used regularly: students should use it to monitor their learning; and students should be able to refer to it when explaining their learning to others (groups, counselors, or others). These points are all concerned with usability, making the experience of using a portfolio as simple and smooth and effective as possible. What we actually put into the portfolio must be concerned with our learning targets. As mentioned earlier, any program or course will have multiple targets for knowledge and skill acquisition, but also for constructs such as digital literacy, critical thinking, problem solving, responsibility, autonomy, revision, collaboration, service and stewardship, and possibly others. Therefore, it is important for portfolios to contain finished work and evidence of the process of improving work through working with others, checking and revising work responsibly, and helping others to do so, too. Portfolios should also contain records of learning activities and times on tasks as evidence of autonomy and tenacity.

 

Portfolio contents Pt. 2: Portfolios for language learners

As part of English language courses, there are usually weekly classroom assignments for writing and presentation. There may also be other writing assignments, or other speaking assignments. As for other constructs, the following have been shown to be important for successful language learning and therefore should be part of the curriculum:

  • Time on task
  • Time management (efficient use of time)
  • Commitment to improvement/quality (accountable for learning)
  • Critical evaluation of learning strategies
  • Collaboration (accountable to others)
  • Seeking feedback and incorporating feedback (revision)

 

If we try to build these into our portfolio system along with our language and culture target competencies while still managing the volume of the content, I believe that we must include the following elements, in addition to a general goal statement:

  1. Drafts and final products for a limited number of assignments, including a reflection sheet with information about the goals of the assignment (and a copy of the rubric for the assignment), time spent on the assignment, attempts at getting feedback and comments on how that feedback was included;
  2. Weekly reflection sheets (including a schedule planner) in which students can plan out the study plan for their week before it happens, and then reflect upon the results afterward. There could also be sections where students can reflect upon strategy use and explain their attempts to reach certain goals;
  3. Self-access tracking charts in which students list up the reading, listening, or other self-access activities students engage in. Several of these charts can be made available to students (extensive reading charts, extensive listening charts, TOEFl/TOEIC test training, online conversation time, etc.) and students can include the charts relevant to their personal goals (though extensive reading will be required for all students).

Finally

As you can see, there is much to be decided: specifically which assignments and how many will be included; also the various forms need to be designed and created; and, for the English classes, whether completing the portfolio and discussing learning is something that we want to scaffold learners to be able to do (something that I personally think is very important).

 

This post is part of a series considering ways to add more focus and learning to EFL classrooms by drawing on ideas and best practices from L1 classrooms.

Part 1 looked at the importance of goals.

Part 2 looked at using data and feedback.

Part 3 looked at the challenges and benefits of academic discussions

 

References

Berger, R. Rugen, L., and Woodfin, L. (2014). Leaders of their own learning: transforming schools through student-engaged assessment. San Fransisco: Jossey-Bass.

Greenstein, L. (2012). Assessing 21st century skills: a guide to evaluating mastery and authentic learning. Thousand Oaks, CA: Corwin.

Making EFL Matter Pt. 3: The Challenges and Benefits of Discussion

image of balls in a tray

 

Well, what do you think? This question and answer form a basic opinion exchange that is sometimes called a discussion. And it is, sort of. But just as a single decontextualized sentence is of limited use in understanding grammar, so too a brief opinion exchange does not have enough context–with all its intentions, personalities, and sociolinguistic depth–to really be called a discussion. A discussion is more complex, and ultimately more powerful, because it has a goal and requires input and interaction from multiple members, which should allow them to collectively generate better ideas (solutions, plans, etc.) than any one of the participants could have done alone.

This sounds good in theory, but it is difficult to achieve in classrooms–especially EFL classrooms where learners have a layer of linguistic difficulty on top of the conceptual and procedural challenges inherent in establishing a system of rich academic discussions. The first thing we must acknowledge is that academic discussion skills, like Rome, are not built in a day. As I mentioned earlier, they need to be incrementally developed, starting with basic conversation and interaction skills.  Without basic conversation skills, discussion is not attainable. Students who are used to pairwork and are able to use the basic greetings, openings, and closings of common conversation “scripts” (Hi. How’re you doing? So, what did you do on the weekend? Well, nice talking to you!), and can react to each other’s utterances (Uh-huh, Really?! Oh, I love that!, Really? How was it? etc.) will find discussions accessible. Absolute speaking beginners will struggle and likely fail. Speaking must be taught, skills must be developed, and regular opportunities for fluency development given, or else activities like academic discussions, and the opportunities to flex critical thinking muscles that go with them, won’t be achieved. A little bit of speaking tagged on to the end of a lesson won’t get you there (as programs in high schools in Japan are slowly waking up to).

So now we know it’s difficult and requires a program of incremental skill development starting with a foundation in basic interactive conversation skills. One question we might ask is: is it worth the trouble. Given a limited amount of time, why should so much be devoted to conversation and discussion skills development? Well, the answer comes from sociocultural learning theory. As Daniel Siegel puts it in his forward to the wonderful Social Neuroscience of Education: “We evolved in tribes, we grow in families, and we learn in groups.” Walqui and van Lier (2010), in listing up the tenets of sociocultural learning theory for their QTEL approach, focus on some of the key points: “Participation in activity is central to the development of knowledge; participation in activity progresses from apprenticeship to appropriation, or from the social to the individual plane; and learning can be observed as changes in participation over time” (pg. 6). That is to say, we learn through active participation (engagement and collaboration) with others. “Language is primarily social”…and “…learning…is essentially social in nature” (pg. 4-5). This learning does not happen by chance, however. The really really hard thing to do is to get students into that sweet spot where they are developmentally ready and linguistically scaffolded  up to the point where they can function and learn. Development becomes possible when “…teachers plan lessons beyond the students’ ability to carry them out independently” (pg. 7), but create the proper community and provide the proper scaffolding to allow for success with such lessons. To answer the question that started this paragraph, the potential benefits of learning in groups are great enough to warrant using this approach. Students can learn content and language, and collaboration skills, essential skills for the 21st century according to Laura Greenstein (who also helpfully provides a rubric and suggestions for assessing collaboration, as well as other skills).

One more potential objection to focusing on academic discussion comes from Doug Lemov. Actually, it’s not so much of an objection as request to rethink and balance your choices. In Teach Like a Champion 2.0, he suggests that both writing and discussion can be strong tools for “causing all students to do lots of the most rigorous work,..but if I had to choose just one, which admittedly I do not, I would choose writing. Hammering an ideas into precise words and syntax and then linking it to evidence and situating it within a broader argument are, for me the most rigorous work in schooling” (pg. 314).  Writing is great, and cognitively more “precise” perhaps, and definitely needs to be part of the syllabus. Discussion is by nature more social. You can do both and you should do both; finding the time to do so is challenging, however.

So what do we teach? And what are discussion skills that students need to learn and develop? The best list can be found in Academic Conversations by Jeff Zwiers and Marie Crawford. It needs to be said, however, that this book is made for L1 learners and you will need to adapt as you adopt. But the basic list and framework make it easy and intuitive to do so. Here is the list of skills:

  1. Elaborate and Clarify: Make your thinking as detailed and clear as you can, carefully explaining the rationale behind your thinking.
  2. Support Ideas with Examples: Use examples to illustrate thinking. It is a particular and powerful way of elaborating and clarifying ideas.
  3. Build On or Challenge Partners’ Ideas: Actively respond to and develop the ideas that arise, either by expanding on them or tweaking them, or pruning out the bad ones through well-considered disagreement.
  4. Paraphrase Ideas: As ideas arise, paraphrase them to both show your understanding and create a springboard for idea development and improvement.
  5. Synthesize the Discussion Points: Bring all the ideas you’ve been discussing to a conclusion. Produce a group decision or plan.

These skills need to be introduced incrementally. Some of them are more difficult to teach and practice than others, particularly with students who lack proficiency or fluency, but also for cultural reasons. Some students in Japan find it challenging to disagree, and may have trouble ranking or pruning some ideas from their synthesis. These can be trained and taught. In my experience, students are not used to making their thinking so explicit and considering  ideas so carefully. Once they get the hang of it, however, they clearly become better listeners, better collaborators, and better thinkers. And after gaining some fluency with the formulaic expressions required to do academic discussions, they sound considerably more proficient.

Assessment is not as difficult as you may imagine. Ms. Greenstein’s rubric provides a nice overview of expected performance and can be used together with teacher observations, and peer or individual reflection and feedback. Performance tests are easy to organize because we can check several students at once in their group. Focusing on the success of the group in terms of process and outcome is actually not that hard to measure.

This post is part of a series considering ways to add more focus and learning to EFL classrooms by drawing on ideas and best practices from L1 classrooms.

Part 1 looked at the importance of goals.

Part 2 looked at using data and feedback.

 

 

Making EFL Matter Pt. 2: Data and Feedback

imafiling cabinet

 

In the last few years, I’ve found myself increasingly reaching for books that are not on my SLA or Applied Linguistics shelves. Instead, books on general teaching methodology have engaged me more. It started a few years ago when I came across John Hattie’s Visible Learning for Teachers, a book in which various approaches in education are ranked by their proven effectiveness in research. This led me to further explore formative assessment, one of the approaches that Hattie identifies as particularly effective, citing Yeh (2011). I was impressed and intrigued and began searching for more–and man is there a lot out there! Dylan Wiliam’s Embedded Formative Assessment is great (leading to more blogging);  Laura Greenstein’s What Teachers Really Need to Know about Formative Assessment is very practical and comprehensive;  Visible Learning and the Science of How We Learn by Hattie and Yates has a solid  section; and Leaders of Their Own Learning by Ron Berger et al., the inspiration for this series of blog posts, places formative assessment at the heart of curricular organization. There is, as far as I know, nothing like this in TESOL/SLA. I’m not suggesting, I would like to emphasize, throwing out bathwater or babies, however. I see the content of these books as completely additive to good EFL pedagogy. So let’s go back to that for a moment.

One of my favorite lists in TESOL comes from a 2006 article by Kumaravadivelu in which he puts forth his list of macro-strategies, basic principles that should guide the micro-strategies of day-to-day language classroom teaching, as well as curriculum and syllabus design. This list never became the Pinterest-worthy ten commandments that I always thought it deserved to be. Aside from me and this teacher in Iran, it didn’t seem to catch on so much, though I’m sure you’ll agree it is a good, general set of directives. Hard to disagree with anything, right?

  1. Maximize learning opportunities
  2. Facilitate negotiated interaction
  3. Minimize perceptual mismatches
  4. Activate intuitive heuristics
  5. Foster language awareness
  6. Contextualize linguistic input
  7. Integrate language skills
  8. Promote learner autonomy
  9. Raise cultural awareness
  10. Ensure social relevance

But what is missing from the list (if we really want to take it up to 11) I can tell you now is Provide adequate formative feedback. One of the great failings of communicative language teaching (CLT) is that is has been so concerned with just getting students talking, that it has mostly ignored one of the fundamental aspects of human learning:  it is future-oriented. People want to know how to improve their work so that they can do better next time (Hattie and Yates, 2014). “For many students, classrooms are akin to video games without the feedback, without knowing what success looks like, or knowing when you attain success in key tasks” (pg. 67). Feedback helps when it shows students  what success looks like, when they can clearly see the gap between where they are now and where they need to be, and when the feedback provides actionable suggestions on what is being done right now and what learners should  do/change next to improve. It should be timely and actionable, and learners should be given ample time to incorporate it and try again (Wiliam, 2011; Greenstein, 2010).

One of the most conceptually difficult things to get used to in the world of formative feedback is the notion of data. We language teachers are not used to thinking of students’ utterances and performances as data, yet they are–data that can help us and them learn and improve. I mean, scores on certain norm-referenced tests can be seen as data, final test scores can be seen as data, and attendance can be seen as data, but we tend, I think, to look at what students do in our classes with a more communicative, qualitative, meaning-focused set of lenses. We may be comfortable giving immediate formative performance feedback on pronunciation, but for almost anything else, we hesitate and generalize with our feedback.  Ms. Greenstein, focusing on occasionally enigmatic 21st century skills, offers this:

“Formative assessment requires a systematic and planned approach that illuminates learning and displays what students know, understand, and do. It is used by both teachers and students to inform learning. Evidence is gathered through a variety of strategies throughout the instructional process, and teaching should be responsive to that evidence. There are numerous strategies for making use of evidence before, during, and after instruction” Greenstein, 2012, pg. 45).

Ms. Greenstein and others are teachers who look for data–evidence–of student learning, and look for ways involving learners in the process of seeing and acting on that data. Their point is we have a lot of data (and we can potentially collect more) and we should be using it with students as part of a system of formative feedback. Berger, Ruben & Woodfin, 2014) put it thus:

“The most powerful determinants of student growth are the mindsets and learning strategies that students themselves bring to their work–how much they care about working hard and learning, how convinced they are that hard work leads to growth, and how capably they have built strategies to focus, organize, remember, and navigate challenges. When students themselves identify, analyze, an use data from their learning, they become active agents in their own growth (Berger, Rugen & Woodfin, 2014, pg. 97).

They suggest, therefore, that students be trained to collect, analyze, and share their own learning data. This sounds rather radical, but it is only the logical extension of the rationale for having students track performance on regular tests, or making leader boards, or even giving students report cards.  It just does so more comprehensively. Of course, this will require training/scaffolding and time in class to do. The reasons for doing are worth that time and effort, they stress. Data has an authoritative power that a teacher’s “good job” or “try harder” just don’t. It is honest, unemotional, and specific, and therefore can have powerful effects. There are transformations in student mindsets, statistics literacy, and grading transparency, all of which help make students more responsible and accountable for their own learning. Among the practices they suggest that could be deployed in an EFL classroom are tracking weekly quiz results, standardized tests, or school exams, using error analysis forms for writing or speaking assignments, and using goal-setting worksheets for regular planning and reflection.

You can see the use of data for formative assessment in action in a 6th grade classroom here.

This post is part of a series considering ways to add more focus and learning to EFL classrooms by drawing on ideas and best practices from L1 classrooms.

Part 1 looked at the importance of goals.

Part 3 looks at the challenges and benefits of academic discussions

 

References

Yeh, S. S. (2011). The cost-effectiveness of 22 approaches for raising student achievement. Charlotte, North Carolina: Information Age Publishing.