Evidence of ROI for Alternative Credentials 'Weak'

While alternative pathways and credentials have gained momentum (and headlines) in recent years, evidence of their return to students is scant and quality assurance is "weak." So concluded a report that examined these options that exist outside of or alongside traditional undergraduate degree programs.

A study undertaken by the American Academy of Arts & Sciences and developed by Ithaka S+R sought to understand this form of postsecondary learning. It takes five basic forms:

  • Certificate programs for labor market training and credentialing. These typically run for less than two years and are stock-in-trade for community colleges, for-profit trade schools and for-profit degree-granting colleges;
  • Work-based training, such as apprenticeships;
  • Skills-based short courses, which may be short-term certificate programs or "just-in-time" training opportunities, such as those offered by coding boot camps;
  • Massive open online courses and online micro-credentials; and
  • Competency-based education programs, which tend to "more personalized, flexible, and aligned with in-demand skills."

The researchers found that while alternative credentials "have proliferated over the past 15 years," the idea behind them is hardly new. "While alternatives have grown in recent years, options like trade schools, distance education, work-based training and assessment of prior learning have been around for decades or centuries, and their popularity has ebbed and flowed with contextual forces," the report stated.

Credentials awarded by Title IV postsecondary institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

Credentials awarded by Title IV postsecondary institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

Also, while these types of programs show a "great deal of variation," the researchers noted, they do tend to require less time, use more flexible formats and maintain alignment with the skills employers want more closely than traditional degree programs.

For their part, the research found, those traditional schools are taking good ideas such as work experience from the alternative programs and incorporating them in their institutions' programs.

The most telling finding of the report, however, is the researchers' declaration that while alternative pathways and credentials may have appeal for all kinds of reasons, "evidence of their efficacy is thin and quality assurance is weak." Data is lacking on "features, costs, enrollment and outcomes," the authors wrote, and few have been "rigorously assessed"; where they have, the evidence "is not promising."

Certificates awarded by institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

Certificates awarded by institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

The report urges the higher ed community, funders and policy people to undertake research to examine the return on investment of the existing programs. Doing so, however, will require those same entities to invest in a "more comprehensive data system" to capture longitudinal information on students' experiences and details about the providers. Likewise, thorough examinations of programs will also require development of quality assurance processes to ensure "accurate and comparable evaluation" across providers.

The report is openly available in digital form on the academy's website here.

About the Author

Dian Schaffhauser is a former senior contributing editor for 1105 Media's education publications THE Journal, Campus Technology and Spaces4Learning.

Featured

  • college student sitting at a laptop writing a college essay

    How Can Schools Manage AI in Admissions?

    Many questions remain around the role of artificial intelligence in admissions as schools navigate the balance between innovation and integrity.  

  • a hobbyist in casual clothes holds a hammer and a toolbox, building a DIY structure that symbolizes an AI model

    Ditch the DIY Approach to AI on Campus

    Institutions that do not adopt AI will quickly fall behind. The question is, how can colleges and universities do this systematically, securely, cost-effectively, and efficiently?

  • person signing a bill at a desk with a faint glow around the document. A tablet and laptop are subtly visible in the background, with soft colors and minimal digital elements

    California Governor Signs AI Content Safeguards into Law

    California Governor Gavin Newsom has officially signed off on a series of landmark artificial intelligence bills, signaling the state’s latest efforts to regulate the burgeoning technology, particularly in response to the misuse of sexually explicit deepfakes. The legislation is aimed at mitigating the risks posed by AI-generated content, as concerns grow over the technology's potential to manipulate images, videos, and voices in ways that could cause significant harm.

  • laptop screen showing Coursera course

    Coursera Introduces New Gen AI Skills Training and Credentials

    Learning platform Coursera is expanding its Generative AI Academy training portfolio with an offering for teams, as well as adding new generative AI courses, specializations, and certificates.