Evidence of ROI for Alternative Credentials 'Weak'

While alternative pathways and credentials have gained momentum (and headlines) in recent years, evidence of their return to students is scant and quality assurance is "weak." So concluded a report that examined these options that exist outside of or alongside traditional undergraduate degree programs.

A study undertaken by the American Academy of Arts & Sciences and developed by Ithaka S+R sought to understand this form of postsecondary learning. It takes five basic forms:

  • Certificate programs for labor market training and credentialing. These typically run for less than two years and are stock-in-trade for community colleges, for-profit trade schools and for-profit degree-granting colleges;
  • Work-based training, such as apprenticeships;
  • Skills-based short courses, which may be short-term certificate programs or "just-in-time" training opportunities, such as those offered by coding boot camps;
  • Massive open online courses and online micro-credentials; and
  • Competency-based education programs, which tend to "more personalized, flexible, and aligned with in-demand skills."

The researchers found that while alternative credentials "have proliferated over the past 15 years," the idea behind them is hardly new. "While alternatives have grown in recent years, options like trade schools, distance education, work-based training and assessment of prior learning have been around for decades or centuries, and their popularity has ebbed and flowed with contextual forces," the report stated.

Credentials awarded by Title IV postsecondary institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

Credentials awarded by Title IV postsecondary institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

Also, while these types of programs show a "great deal of variation," the researchers noted, they do tend to require less time, use more flexible formats and maintain alignment with the skills employers want more closely than traditional degree programs.

For their part, the research found, those traditional schools are taking good ideas such as work experience from the alternative programs and incorporating them in their institutions' programs.

The most telling finding of the report, however, is the researchers' declaration that while alternative pathways and credentials may have appeal for all kinds of reasons, "evidence of their efficacy is thin and quality assurance is weak." Data is lacking on "features, costs, enrollment and outcomes," the authors wrote, and few have been "rigorously assessed"; where they have, the evidence "is not promising."

Certificates awarded by institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

Certificates awarded by institutions between 2000 and 2013. Source: "The Complex University of Alternative Postsecondary Credentials and Pathways," published by the American Academy of Arts & Sciences.

The report urges the higher ed community, funders and policy people to undertake research to examine the return on investment of the existing programs. Doing so, however, will require those same entities to invest in a "more comprehensive data system" to capture longitudinal information on students' experiences and details about the providers. Likewise, thorough examinations of programs will also require development of quality assurance processes to ensure "accurate and comparable evaluation" across providers.

The report is openly available in digital form on the academy's website here.

About the Author

Dian Schaffhauser is a former senior contributing editor for 1105 Media's education publications THE Journal, Campus Technology and Spaces4Learning.

Featured

  • hand with glowing networking lines and bokeh lights

    Call for Speakers Now Open for Tech Tactics in Education: Thriving in the Age of AI

    The annual virtual conference from the producers of Campus Technology and THE Journal will return on May 7, 2025, with a focus on AI, cybersecurity, and student success.

  • From Fire TV to Signage Stick: University of Utah's Digital Signage Evolution

    Jake Sorensen, who oversees sponsorship and advertising and Student Media in Auxiliary Business Development at the University of Utah, has navigated the digital signage landscape for nearly 15 years. He was managing hundreds of devices on campus that were incompatible with digital signage requirements and needed a solution that was reliable and lowered labor costs. The Amazon Signage Stick, specifically engineered for digital signage applications, gave him the stability and design functionality the University of Utah needed, along with the assurance of long-term support.

  • Microsoft

    Microsoft Introduces Its First Quantum Computing Chip

    Microsoft has unveiled Majorana 1, its first quantum computing chip, aimed at deployment in datacenters.

  • glowing digital brain made of blue circuitry hovers above multiple stylized clouds of interconnected network nodes against a dark, futuristic background

    Report: 85% of Organizations Are Using Some Form of AI

    Eighty-five percent of organizations today are leveraging some form of AI, according to the latest State of AI in the Cloud 2025 report from Wiz. While AI's role in innovation and disruption continues to expand, security vulnerabilities and governance challenges remain pressing concerns.