Skip to content
Longterm Wiki
Back

DARPA Assured Autonomy Program

web

DARPA's Assured Autonomy program is a U.S. government research initiative relevant to technical AI safety, particularly formal verification of learning systems in high-stakes autonomous contexts; notable as a real-world institutional effort to operationalize safety guarantees.

Metadata

Importance: 45/100homepage

Summary

DARPA's Assured Autonomy program aims to develop methods for continuous assurance of learning-enabled autonomous systems operating in dynamic environments. It focuses on providing mathematical guarantees and formal verification for machine learning components in safety-critical autonomous systems such as aircraft and ground vehicles. The program seeks to ensure that autonomous systems behave safely and as intended even as they adapt and learn.

Key Points

  • Develops techniques to provide formal, provable guarantees on the safety and reliability of learning-enabled autonomous systems
  • Targets safety-critical military applications including autonomous aircraft and ground vehicles operating in complex environments
  • Addresses the challenge of verifying behavior of machine learning components that adapt over time
  • Aims to integrate automated verification and testing throughout the system development and operation lifecycle
  • Represents government-funded research bridging AI safety, formal methods, and real-world autonomous systems deployment

Cited by 1 page

PageTypeQuality
Autonomous Weapons Escalation ModelAnalysis62.0

Cached Content Preview

HTTP 200Fetched Mar 20, 20269 KB
[Skip to main content](https://www.darpa.mil/research/programs/assured-autonomy#main-content)

![](https://www.darpa.mil/themes/custom/darpa_uswds/assets/js/packages/usa_banner/img/icon-dot-gov.svg)

**Official websites use .mil**

A
**.mil** website belongs to an official U.S.
Department of War organization.


![](https://www.darpa.mil/themes/custom/darpa_uswds/assets/js/packages/usa_banner/img/icon-https.svg)

**Secure .mil websites use HTTPS**

A
**lock** (
LockLocked padlock icon ) or **https://** means you’ve safely connected to the .mil website. Share sensitive information only on official, secure websites.


## Breadcrumb

1. [Home](https://www.darpa.mil/)
2. [Research](https://www.darpa.mil/research)
3. [Programs](https://www.darpa.mil/research/programs)
4. Assured Autonomy


# Assured Autonomy

#### Summary

Autonomy refers to a system’s ability to accomplish goals independently, or with minimal supervision from human operators in environments that are complex and unpredictable.

DARPA Assured Autonomy Seeks to Guarantee Safety of Learning-enabled Autonomous Systems - YouTube

[Photo image of DARPAtv](https://www.youtube.com/channel/UCOIHBHRbvncMo7Bf0Vx1zEQ?embeds_referring_euri=https%3A%2F%2Fwww.darpa.mil%2F)

DARPAtv

177K subscribers

[DARPA Assured Autonomy Seeks to Guarantee Safety of Learning-enabled Autonomous Systems](https://www.youtube.com/watch?v=VX0vFZF3c2w)

DARPAtv

Search

Watch later

Share

Copy link

Info

Shopping

Tap to unmute

If playback doesn't begin shortly, try restarting your device.

More videos

## More videos

Share

Include playlist

An error occurred while retrieving sharing information. Please try again later.

[Watch on www.youtube.com](https://www.youtube.com/watch?v=VX0vFZF3c2w)

Watch on

Autonomous systems are increasingly critical to several current and future Department of Defense (DoD) mission needs. For example, the U.S. Army Robotics and Autonomous Systems (RAS) strategy report for 2015-2040 identifies a range of capability objectives, including enhanced situational awareness, cognitive workload reduction, force protection, cyber defense, logistics, etc, that rely on autonomous systems and higher levels of autonomy.

Tremendous advances have been made in the last decade in constructing autonomous Cyber Physical Systems (CPS), as evidenced by the proliferation of a variety of unmanned systems: air, ground, sea, and undersea vehicles. These advances have been driven by innovations in several areas, such as sensor and actuator technologies, computing technologies, control theory, design methods and tools, modeling and simulation technologies, among others. In spite of these advances, deployment and broader adoption of such systems in safety-critical DoD applications remains challenging and controversial.

Several factors impede the deployment and adoption of autonomous systems:

1. In the absence of an adequately high level of autonomy that can be relied upon, substantial operator involvement is re

... (truncated, 9 KB total)
Resource ID: 822fa24c1716fe53 | Stable ID: NjQ4OGIyNW