While artificial intelligence (AI) can transform government operations, decision makers need confidence that AI-enabled systems will operate effectively with acceptable levels of risk before adopting them. On March 25, McLean, VA-based MITRE was joined by Sen. Mark Warner, Rep. Donald Beyer, and Rep. Gerry Connolly as it opened its AI Assurance and Discovery Lab with the mission to discover and mitigate critical risks in AI-enabled systems that need to operate in increasingly complex, uncertain, and high-stakes environments.
“Government use of AI will have consequential impacts on the nation and world, in areas such as efficient transportation, effective healthcare, and strengthened national security,” said Charles Clancy, MITRE senior vice president and chief technology officer. “However, in adopting these systems, we also need to mitigate risks. Providing an independent assessment of the security, safety, and efficacy of AI systems will play a critical role toward helping government and business realize the transformational power of AI in benefits processing, intelligence analysis, autonomous vehicles, and more. This lab will demonstrate a repeatable engineering approach and infrastructure that could serve as a blueprint for a national network of AI assurance facilities.”
MITRE defines AI assurance as a process for discovering, assessing, and managing risk throughout the lifecycle of an AI-enabled system so that it operates effectively to the benefit of its stakeholders and end users. The new AI Assurance and Discovery Lab will evaluate AI-enabled systems intended for use in consequential applications including national security, healthcare, and transportation. Government agencies can also use the lab to inform requirements development for new AI-enabled systems, create and evaluate proposed risk mitigation plans, and develop long-term AI assurance strategies for their organizations.
The lab, which is based at MITRE’s McLean, Virginia headquarters, features configurable space for risk discovery in simulated environments, AI red teaming, large language model evaluation, human-in-the-loop experimentation, and assurance plan development. The lab’s physical space can be tailored and instrumented for specific mission scenarios and workflows.
“For federal agencies and private companies, this new lab delivers an objective, independent analysis to complement and validate their own testing and evaluation of AI-enabled systems, helping establish confidence for end users,” said Cedric Sims, MITRE senior vice president. “Ensuring that AI provides transformational benefits for our government sponsors is a top priority as we solve problems for a safer world.”
MITRE’s team of scientists and engineers includes expertise in computational sciences, linguistics, robotics, human cognitive science, systems neuroscience, and government mission domains. Federal agencies, and soon private companies, can bring AI-enabled systems to the lab to explore potential risks including whether they perform effectively, consistently, and safely in real-world contexts. MITRE will also use the lab to evaluate factors such as whether systems are secure and free from harmful bias, and allow users to control how their information is used.
Source: MITRE
Stay in the know with breaking news from across the IC and IC contracting landscape by becoming a paid subscriber to IC News. Your support makes our work possible.
By 
