Evidence of ROI for Alternative Credentials 'Weak'

While alternative pathways and credentials have gained momentum (and headlines) in recent years, evidence of their return to students is scant and quality assurance is "weak." So concluded a report that examined these options that exist outside of or alongside traditional undergraduate degree programs.

A study undertaken by the American Academy of Arts & Sciences and developed by Ithaka S+R sought to understand this form of postsecondary learning. It takes five basic forms:

  • Certificate programs for labor market training and credentialing. These typically run for less than two years and are stock-in-trade for community colleges, for-profit trade schools and for-profit degree-granting colleges;
  • Work-based training, such as apprenticeships;
  • Skills-based short courses, which may be short-term certificate programs or "just-in-time" training opportunities, such as those offered by coding boot camps;
  • Massive open online courses and online micro-credentials; and
  • Competency-based education programs, which tend to "more personalized, flexible, and aligned with in-demand skills."

The researchers found that while alternative credentials "have proliferated over the past 15 years," the idea behind them is hardly new. "While alternatives have grown in recent years, options like trade schools, distance education, work-based training and assessment of prior learning have been around for decades or centuries, and their popularity has ebbed and flowed with contextual forces," the report stated.

Credentials awarded by Title IV postsecondary institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

Credentials awarded by Title IV postsecondary institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

Also, while these types of programs show a "great deal of variation," the researchers noted, they do tend to require less time, use more flexible formats and maintain alignment with the skills employers want more closely than traditional degree programs.

For their part, the research found, those traditional schools are taking good ideas such as work experience from the alternative programs and incorporating them in their institutions' programs.

The most telling finding of the report, however, is the researchers' declaration that while alternative pathways and credentials may have appeal for all kinds of reasons, "evidence of their efficacy is thin and quality assurance is weak." Data is lacking on "features, costs, enrollment and outcomes," the authors wrote, and few have been "rigorously assessed"; where they have, the evidence "is not promising."

Certificates awarded by institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

Certificates awarded by institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

The report urges the higher ed community, funders and policy people to undertake research to examine the return on investment of the existing programs. Doing so, however, will require those same entities to invest in a "more comprehensive data system" to capture longitudinal information on students' experiences and details about the providers. Likewise, thorough examinations of programs will also require development of quality assurance processes to ensure "accurate and comparable evaluation" across providers.

The report is openly available in digital form on the academy's website here.

About the Author

Dian Schaffhauser is a former senior contributing editor for 1105 Media's education publications THE Journal, Campus Technology and Spaces4Learning.

Featured

  • college students in a classroom focus on a silver laptop, with a neural network diagram on the monitor in the background

    Report: 93% of Students Believe Gen AI Training Belongs in Degree Programs

    The vast majority of today's college students — 93% — believe generative AI training should be included in degree programs, according to a recent Coursera report. What's more, 86% of students consider gen AI the most crucial technical skill for career preparation, prioritizing it above in-demand skills such as data strategy and software development.

  • laptop with a neural network image, surrounded by books, notebooks, a magnifying glass, a pencil cup, and a desk lamp

    D2L Lumi AI Updates Add Personalized Study Supports

    Learning platform D2L has announced new artificial intelligence features for D2L Lumi that help provide more personalized study supports for students.

  • three glowing stacks of tech-themed icons

    Research: LLMs Need a Translation Layer to Launch Complex Cyber Attacks

    While large language models have been touted for their potential in cybersecurity, they are still far from executing real-world cyber attacks — unless given help from a new kind of abstraction layer, according to researchers at Carnegie Mellon University and Anthropic.

  • young man in a denim jacket scans his phone at a card reader outside a modern glass building

    Colleges Roll Out Mobile Credential Technology

    Allegion US has announced a partnership with Florida Institute of Technology (FIT) and Denison College, in conjunction with Transact + CBORD, to install mobile credential technologies campuswide. Implementing Mobile Student ID into Apple Wallet and Google Wallet will allow students access to campus facilities, amenities, and residence halls using just their phones.