Scaling Up With Adaptive Learning
Two universities share how they are using adaptive courseware to increase retention and graduation rates — and the challenges they have run into along the way.
Last year, eight universities across the country embarked on a bold experiment to see if they can scale up the use of adaptive courseware to increase retention and graduation rates. With support from the Association of Public Land-grant Universities (APLU), these schools have set a target of using adaptive courseware for 15 to 20 percent of general education course enrollments between spring 2017 and fall 2019. APLU's Personalized Learning Consortium is overseeing the grant program, which is funded by the Bill & Melinda Gates Foundation.
The universities — Arizona State University, Colorado State University, Georgia State University, Northern Arizona University, Oregon State University, Portland State University, University of Louisville and the University of Mississippi — certainly have their work cut out for them. Tailoring a course to adaptive learning can be difficult, as we learned when Campus Technology interviewed faculty members involved in pilot implementations of the technology. Despite being encouraged by the results, those pioneers reported being exhausted by how much work is involved in retrofitting their courses to the adaptive platforms. So how will the APLU grantees tackle the task? We spoke with two executives participating in the grant program about their goals and the early challenges they see.
Focusing on High-Enrollment Courses in Oregon
"The reason we are interested in adaptive courseware is to improve student learning and student success. The adaptive courseware is just one approach to help us increase retention and graduation rates," said Julie Greenwood, associate dean for undergraduate studies at Oregon State University.
OSU is focusing its initial efforts on eight high-enrollment courses that also have high attrition rates, in fields such as college algebra, psychology and chemistry. Greenwood said some OSU faculty members have already experimented with adaptive courseware, but not in an extensive fashion. "It is being used for homework or extra credit," she said, "but the technology is challenging enough that they are not integrating it into the course and not taking full advantage of the analytics."
Greenwood pointed out that the adaptive courseware could help faculty members shift content delivery from lectures to a blended format, where students view course materials online before coming into class — and instructors tap into the data on their progress. "A faculty member can come into the classroom with 200 students and know that a majority struggled with three particular problems and decide to focus on those with their class time," she said. "That is the value of the analytics."
APLU has given its grantees a list of 20 approved adaptive courseware vendors to choose from, and OSU is seeking to develop a model and structure that will allow the university to support faculty members in implementing the courseware that fits the curriculum they teach. The math department, for instance, is planning to do an in-depth evaluation process, starting with development of the metrics and rubrics it will use to make that decision. "We would like to see flexibility from the vendors for the instructors to be able to provide their own content," Greenwood added.
Because of the additional time and effort involved in implementing adaptive learning, one of the challenges is how to motivate faculty members to participate. Schools can offer stipends or other faculty incentives, but timing can be an issue, Greenwood said. "We had one faculty member who had just spent five years redesigning her curriculum. This was not a good time to ask her to throw all that away and start over again."
A positive faculty experience is going to be critical to OSU's ability to scale up. "We have to provide structure and support to help the faculty deal with the technology," Greenwood said. "We want them to focus on curriculum and instruction, not to have to figure out how to get this to work in Canvas, how to access the analytics or worry about students not being able to log on. We have to provide a structure here at the university that eliminates those barriers, so this can run smoothly. We also need a positive student experience. We need to measure the student experience as it goes along, respecting their feedback and monitoring their success."
Going University-wide in Arizona
Northern Arizona University has an even broader mission than the APLU grant entails. "Instead of approaching just general education, high-enrollment courses, I think it is time for a university-wide culture of adaptive learning," said Don Carter, NAU's director of e-learning. Through a combination of blending and flipping classes, the university has redesigned 35 courses over the past five years, and Carter said data shows DFW rates (D-grades, F-grades or withdrawals) have decreased from 23 percent to 19 percent.
In addition to the high-enrollment courses, NAU is looking for courses in areas such as the graduate nursing school or higher-level chemistry that may benefit from adaptive courseware. Of the 20 APLU-approved vendors, Carter has identified five that he thinks are the most promising, and NAU instructional designers and faculty are reviewing their offerings.
"We are going to approach things in three ways: One is a full course redesign with us adopting the offering from a vendor as a full textbook replacement," he said. (NAU's pre-calculus course is already based on Pearson's MyLabsPlus.) The second approach involves finding smaller building blocks of pre-built modules about particular topics or troubling content. "The third approach is adopting a platform in which my instructional design team and faculty can build their own modules," Carter said. One discipline that may try that option is foreign languages, because the vendors have almost no material in that area, he added.
NAU has engaged faculty members in a course redesign effort called "intentional curricular design." But Carter said designing for adaptive technology takes even more work. "Once you add technology, you have to design down to the concept level. You have to sequence and connect things. We are talking about hundreds of minutiae if they want to build their own." Do faculty members realize what a time commitment that is? "Those who haven't been involved before may want to try it, but I don't think it will be very long before they realize how hard it is," Carter said. "We don't have enough money on the grant to pay very many people to build their own [modules]. The approach of the grant program is to buy off-the-shelf things. We are not allowed to develop our own technology system, but we can put our own content in and use someone else's platform. But it is going to be problematic to do very much of that."
Both Carter and Greenwood said the degree of difficulty is also raised by the fact that the vendors themselves are all new to adaptive learning. The best offerings are created in close collaboration with faculty members, they noted.
Carter said the eight universities participating in the APLU grant program are sharing procedures, protocols and results and will try to do some cross-institutional studies. They also plan to sustain their efforts beyond the grant program. "We were a strong candidate for the grant program because we were already doing this," he added. "We had no intention of taking the money and running. We are using it to give us the next-level quantum leap into doing this and we are going to continue."