Skip to main content
Add as a preferred source on Google


Linux Foundation Launches New Open Source AI & Data Platform to Democratize Gen AI Tech

In an effort to "democratize" AI tech, the Linux Foundation has launched a new open source AI/data platform in partnership with Intel, Anyscale, Cloudera, Datastax, Domino Data Lab, Hugging Face and other industry players.

The Open Platform for Enterprise AI (OPEA) is a "Sandbox Project" from the organization's LF AI & Data arm, an umbrella foundation that supports open source innovation in AI and data. The goal is to facilitate and enable the development of flexible, scalable generative AI (Gen AI) systems that harness the best open source innovations from across the ecosystem.

The OPEA aims to address fragmentation in the swiftly evolving Gen AI space by collaborating with the industry to standardize components, including frameworks, architecture blueprints and reference solutions that showcase performance, interoperability, trustworthiness and enterprise-grade readiness.

Specifically, the OPEA platform includes:

  • Detailed framework of composable building blocks for state-of-the-art generative AI systems including LLMs, data stores, and prompt engines
  • Architectural blueprints of retrieval-augmented generative AI component stack structure and end-to-end workflows
    Addressing RAG
    [Click on image for larger view.] Addressing RAG (source: LF AI & Data Foundation).
  • A four-step assessment for grading generative AI systems around performance, features, trustworthiness and enterprise-grade readiness

AI democratization was mentioned by multiple partners, including:

  • Red Hat: "As gen AI continues to advance, open source is playing a critical role in the standardization and democratization of models, frameworks, platforms and the tools needed to help enterprises realize value from AI."
  • Hugging Face: "Hugging Face's mission is to democratize good machine learning and maximize its positive impact across industries and society. By joining OPEA's open source consortium to accelerate Generative AI value to enterprise, we will be able to continue advancing open models and simplify Gen AI adoption."

Democratization of AI has been a continuing theme since heavy industry investments have steered many AI efforts away from research and development and toward commercial, money-making applications (see "Cloud Giants Sign On to 'Democratizing the Future of AI R&D'").

"OPEA is emerging at a crucial juncture when Gen AI projects, particularly those utilizing RAG [Retrieval-Augmented Generation], are becoming increasingly popular for their capacity to unlock significant value from existing data repositories," said LF AI & Data Foundation in an April 16 blog post.

"The swift advancement in Gen AI technology, however, has led to a fragmentation of tools, techniques, and solutions. OPEA intends to address this issue by collaborating with the industry to standardize components, including frameworks, architecture blueprints and reference solutions that showcase performance, interoperability, trustworthiness and enterprise-grade readiness," the foundation said.

About the Author

David Ramel is an editor and writer at Converge 360.

Featured

  • Abstract polygonal hacker with laptop on technology dark background

    Cybersecurity Researchers Identify First Fully Autonomous AI-Driven Ransomware Attack

    Threat researchers at cloud security firm Sysdig have disclosed what they describe as the first documented ransomware operation carried out end-to-end by an autonomous AI agent, with no human typing commands or directing individual steps once the attack was underway.

  • CIS Sandbox Tutor Eli Blouin at Bentley University imagines a future technology learning partner that supports curiosity, critical thinking, feedback, and personalized learning.

    Student Voices: Technology as a Future Learning Partner

    A data analytics and marketing major at Bentley University and a distinguished lecturer at the university explore the future of "technology learning partners" — technologies that participate in the learning process by asking questions and giving feedback, not just information search results.

  • Silhouettes of business professionals stand against a blurred futuristic city skyline at night, with a glowing digital network data connection

    It's Time for Higher Ed to Get Serious About AI Strategy

    Without a coordinated strategy that involves multiple academic and administrative units across the entire campus, colleges risk wasting resources, duplicating efforts, and ultimately failing to deliver on the promise of deploying technology to improve learning and operations.

  • Hootsuite

    Beyond the Feed: How Higher Ed Turns Social Media Into a Measurable Enrollment Engine

    More than half of prospective students research programs on social media before visiting a university website, and nearly half will skip applying to a school that looks inactive online. Hootsuite, the all-in-one social OS platform trusted by more than 2,000 higher education institutions, helps campus teams turn everyday posts into measurable outcomes, from applications to alumni giving.