Where is the Student Voice in Assessment?

Even the putative ultimate authority in U.S. culture, the medical doctor, has learned to occasionally listen to the patient. The patient, surprisingly, has evidence to contribute toward diagnosis--who would have guessed?

But this vital insight has yet to influence most of those who would assess educational “outcomes” (yikes, what a terrible term!).

Higher education now has the technology functionality to accept varying kinds of evidence toward authentic assessment because digital technologies can accept multiple inputs and aggregate them: We can all talk at the same time and still make sense. Secondly, students are the ultimate experts on their own learning (albeit not always capable of expressing or even fully understanding their expertise, just like the average doctor patient). And, third, student comments about their own learning may reveal more about their changes than any other kind of external assessment.

In sum, we can include student voices, such inclusion will add a vital data point to our assessment, and this data point may be more telling than any other.

But, hold on, I can hear murmurs among the readers, so here’s an aside about trusting students: From comments I’ve heard over the years when talking about technology on different campuses, it seems that the opening of education (cf Opening Up Education, Iiyoshi and Kumar, MIT press, 2008) creates nervousness in the minds of many faculty. Some faculty members fear that open education--more voices, more resources, more learning venues, etc.--means more chances for plagiarism and purloined answers. Leaving aside the obvious response of “just change your assignment structures and your testing structures to take into account the realities of today,” there still remains this uneasy feeling of distrust of students among faculty. So, once again, remember the experience of those other doctors-come-lately: We can learn surprising things if we listen.

How do we elicit student comments about their own learning? Many faculty members do this already, of course, but let’s consider a more formalized and broad-based genre, used across higher education, designed to get the best student reflections on their own work. If we are to include student voices in assessment, we need to find a universally understandable and interpretable form or genre (a rhetorical term for a specific written discourse form, like a “cover letter” or a “proposal”). With digital technologies, we can propagate this genre across higher education in the U.S. and perhaps in other countries as well.

The genre, let’s call it “student reflections,” could be in writing (probably the most common medium) or in sound (an audio clip of 3 minutes or so) or in video. Fortunately, digital technologies support and handle multimedia files. I haven’t used the word portfolio yet because for many of you that evokes associations that aren’t always positive, but portfolio technologies ideally will be designed to support student reflections, and student reflections on reflections.

Here’s the advantage of students reflecting on their own work: When young learners look back even a couple of months at work they were doing then, they may well see a big change. Seeing this change can be an epiphany for an undergraduate student: “Wow, I can’t believe I wrote that!” one student told me at week 9 in a writing course.

Reflecting at the end of a course on a whole semester’s worth of reflections allows the student doing the meta-reflection to synthesize and interpret the meaning of her or his learning over the past term or semester. If this process is repeated over a whole degree program and is capstoned (synthesized in some fashion), we end up with a new evidence-feed to triangulate with the other traditional evidence about progress and learning for an individual student.

Too much of portfolio deployment and use in the U.S. has been about cohorts of students so the institutions could prepare reports on how well the institution is doing. This tilt toward the institution has postponed the full support that assessment for learning--students assessing their own work to learn how to change--should receive. This tilt has also influenced the market so that ePortfolio applications have favored the cohort over the individual.

For students, portfolio-for-the-matrix has left them estranged from their own work and the student-centered technology that was supposed to be has lagged behind accreditation management technology. Partly the problem was the assumption that one portfolio platform for a whole institution was adequate.

If there is only one ePortfolio platform on campus, it is bound to become an institutional ePortfolio. In response to this obvious problem, some vendors have introduced customizable ePortfolios or modularized ePortfolios--clearly a good step forward. Some vendors provide multiple ePortfolio applications as another approach.

Having more portfolio options with the new breed of ePortfolio application opens the door to the “front porch” of ePortfolio applications to offer more seats and more conversation while the data churns in the background. With more seats and more conversation, let’s let the students talk.

About the Author

Trent Batson, Ph.D. has served as an English professor, director of academic computing, and has been an IT leader since the mid-1980s. He is executive director of The Association for Authentic, Experiential and Evidence-Based Learning (AAEEBL, www.aaeebl.org), a new professional association for the ePortfolio community. He is the former Chair of the Board of the Open Source Portfolio Initiative, and Senior Contributing Editor for Campus Technology's Web 2.0 e-newsletter. batsontr@mit.edu

Comments

Fri, Nov 20, 2009

I'd certainly agree that outcomes assessment should include student voices and we should prompt students to reflect on their own learning. Absolutely! Yet, in a somewhat ironic twist, the very first step taken by faculty and programs new to outcomes assessment is to survey students about their learning experiences. Surveys are not as technologically sophisticated as portfolios, nor are they necessarily the best way to elicit student reflections, but they are typically quite genuine attempts to include students' voices.

Thu, Nov 5, 2009 Greg Troll, MD Vallejo, CA

Everything you wrote, yes, but even more importantly, because it's the student's own experience, internal reflection and development of motivation and skill that is the most fundamental aspect of educational success. That means the student voice is the essential voice of evaluation and "outcome." Anyone going through the throes of a transformative process like education or growing up or becoming a professional, at times will be quite unable to tell how well they're doing or where they should be going. But the formative guidance is only useful if it matches and relates to the internal experience of the learner. Otherwise, education is just another thing being done to one, of which one is a quasi passive participant. If that happens, the student will have great difficulty developing the ability to keep learning from their experience, the prerequisite for being an effective person, and the truly desired outcome of educational process.

Thu, Nov 5, 2009 Bob Barboza Long Beach, CA

Thank you for this important article. We would love to share this message with K-12 education. Could we continue this important conversation on Kids Talk Radio? We are in a position to conduct a telephone and or Skype interview.

Thu, Nov 5, 2009 Gary Daynes Westminster College, Salt Lake City, UT

I appreciate this statement of support for student voices in e-portfolios. My sense, though, is that most campuses using e-portfolios do include a lot of space for student reflections, both within their portfolios and in the process through which students create them. This was certainly the case for campuses whose e-portfolios were featured at the recent AACU conference on integrative learning. LaGuardia Community College, Spelman College, and several others all showed student portfolios with a strong student voice.

Wed, Nov 4, 2009 Kristofer Motto Charlotte, NC

How are your institutions managing ePorfolios at this time? Are you deploying a college-wide system overall student assessment, a project-based system for course/degree-specific assessment - or some other flavor? I understand that 'student reflections' seem to be one of the most valuable components of a student 'portfolio'. Is this your thought as well? What are some of the software applications that you are using or researching? Thanks for the article - very informative and well written.

Add your Comment

Your Name:(optional)
Your Email:(optional)
Your Location:(optional)
Comment:
Please type the letters/numbers you see above