NIST Launches Generative AI Testing Program

The National Institute of Standards and Technology (NIST) is taking incremental steps toward establishing a more standardized national approach to AI safety. The government agency has announced the launch of NIST GenAI, described as an "evaluation program to support research in Generative AI technologies."

The launch comes six months after the Biden White House signed an Executive Order requiring LLM makers to implement guardrails around AI technologies that protect the privacy and security of consumer data. For instance, the order mandated the development of "standards, tools, and tests to help ensure that AI systems are safe, secure, and trustworthy," and of "standards and best practices for detecting AI-generated content and authenticating official content."

The NIST GenAI program is part of the department's effort to address those mandates.

A companion NIST program, dubbed Aria, is set to launch soon. Aria's stated goal is "to advance measurement science for safe and trustworthy AI."

In a press release Monday, the U.S. Department of Commerce, of which NIST is part, described the GenAI program as a platform to "evaluate and measure generative AI technologies."

"The NIST GenAI program will issue a series of challenge problems designed to evaluate and measure the capabilities and limitations of generative AI technologies," said the agency. "These evaluations will be used to identify strategies to promote information integrity and guide the safe and responsible use of digital content."

The first of these challenges aims to evaluate the efficacy of text-to-text (T2T) AI models -- those that generate human-like text ("generators"), as well as those that purport to detect AI-generated text ("discriminators"). Findings from the challenge will help guide the NIST's eventual recommendations to LLM makers for how to convey the provenance of content made using their AI systems. This is how NIST describes the challenge in its Overview page:

NIST GenAI T2T is an evaluation series that supports research in Generative AI Text-to-Text modality. Which generative AI models are capable of producing synthetic content that can deceive the best discriminators as well as humans? The performance of generative AI models can be measured by (a) humans and (b) discriminative AI models. To evaluate the "best" generative AI models, we need the most competent humans and discriminators. The most proficient discriminators are those that possess the highest accuracy in detecting the "best" generative AI models. Therefore, it is crucial to evaluate both generative AI models (generators) and discriminative AI models (discriminators).

The challenge is open to academics, researchers and LLM makers; those interested can read the participation guidelines here. A similar challenge to evaluate text-to-image models is set to start soon.

Besides the GenAI program launch, NIST this week released preliminary versions of four papers about the secure development and implementation of AI. These papers, which are described as "initial drafts," are as follows:

Each draft is still subject to change based on public input. The NIST is accepting feedback for each publication until June 2. Final versions will be published "later this year," the agency said.

About the Author

Gladys Rama (@GladysRama3) is the editorial director of Converge360.

Featured

  • Global AI vibrancy ranking

    United States Leads in Stanford HAI Global AI Ranking

    A new ranking tool from the Stanford Institute for Human-Centered AI (HAI) AI Index puts the United States in the No. 1 spot for global AI leadership.

  • person signing a bill at a desk with a faint glow around the document. A tablet and laptop are subtly visible in the background, with soft colors and minimal digital elements

    California Governor Signs AI Content Safeguards into Law

    California Governor Gavin Newsom has officially signed off on a series of landmark artificial intelligence bills, signaling the state’s latest efforts to regulate the burgeoning technology, particularly in response to the misuse of sexually explicit deepfakes. The legislation is aimed at mitigating the risks posed by AI-generated content, as concerns grow over the technology's potential to manipulate images, videos, and voices in ways that could cause significant harm.

  • pattern featuring interconnected lines, nodes, lock icons, and cogwheels

    Red Hat Enterprise Linux 9.5 Expands Automation, Security

    Open source solution provider Red Hat has introduced Red Hat Enterprise Linux (RHEL) 9.5, the latest version of its flagship Linux platform.

  • MathGPT

    MathGPT AI Tutor Now Out of Beta

    Ed tech provider GotIt! Education has announced the general availability of MathGPT, an AI tutor and teaching assistant for foundational math support.