Describe a reproducible agentic environment

To get started and run a scenario, see LilRÆ.

RAES, the Reproducible Agentic Environments System, helps you describe an agentic environment, check it before anything runs, and keep evidence about what a run realized. RAES SDL is its YAML language for authored scenarios.

A RAES scenario records the nodes, links, participants, objectives, workflows, variation, and evidence needs of an environment. RAES checks the scenario against published rules. A backend that supports the features it needs can then run it. The backend’s reports show what was realized and observed.

RAES validates an authored scenario and compiles a plan. An external backend, such as Shifter, LilRAE, or your own backend, realizes and runs it. Simulator and gym adapters are unreleased. Reports and evidence describe the result.

How a scenario reaches a run:

  1. Author a scenario in RAES SDL. RAES validates it and compiles a plan.

  2. Choose an external backend that supports what the scenario needs. Shifter and LilRAE (formerly APTL) are examples. You can also write your own backend. Simulator and gym adapters are unreleased.

  3. The backend builds the environment, and participants act in it.

  4. Reports and evidence describe what was realized and observed.

Validate your first scenario

Complete the quickstart first. You install RAES, validate a small SDL file, and print its name. You need standard CPython 3.14. You do not need a backend or a repository checkout. The exercise creates no infrastructure.

To explore research questions, read the research context. To cite RAES in your work, use the citation guide.

Choose what you need

Choose your route

What RAES provides

RAES owns the meaning of an authored scenario and the formats around it:

  • the RAES SDL language, its specifications, and published schemas;

  • published contracts for the data that tools and backends exchange;

  • validation and processing that check a scenario and compile plans;

  • conformance tests that check whether a backend honors a stated boundary;

  • reference tools: the Python package, the raes command, examples, and test doubles for backend authors; and

  • evidence structures that record what was requested, realized, and observed.

These parts make scenario intent portable, checkable, and shareable. They also tie that intent to evidence about what a backend realized.

Cyber, AI security, AI safety, testing, research, and evaluation are non-exhaustive application areas. Additional domains can add their own profiles, assets, examples, vocabularies, backends, and evidence rules.

Run a scenario on a backend

This repository includes contracts, stubs, and conformance tests. It does not include a concrete deployment backend or a managed environment service. External backends realize scenarios outside this repository: Shifter, LilRAE, or your own backend. To write a backend, start with the backend and conformance guide.

OpenRAE/adapters holds adapter projects for simulators and cyber gyms. None is released. Each adapter’s own conformance reports and evidence records state what it can run.

Shifter, LilRAE, and the adapters are separate projects with their own documentation. This repository does not ship or certify them. A backend’s own reports and conformance evidence state what it supports.

Package and share scenarios

OpenRAE/env-packs owns environment pack structure, schemas, templates, and the tools to author, validate, and release packs. A pack carries RAES SDL scenarios and other reusable assets. RAES remains authoritative for the SDL, concept, and reusable-asset trust-policy meanings a pack relies on. Catalogs make packs easier to find. They do not add SDL semantics.

Know the limits

An authored scenario records intent. A backend may realize only the parts it supports. Reports and evidence show what was accepted, changed, observed, or left unsupported.

RAES can support a bounded reproduction attempt. It does not promise deterministic runtime behavior, equal outcomes, exact replay, scientific validity, or reproducibility. Read the current limits before choosing RAES for a study or integration.

Cite RAES

Use the citation guide. It gives the software citation. Also record the release or commit, scenario, backend, and run evidence that you used.

RAES is released under the MIT License. Third-party notices are in THIRD_PARTY_NOTICES.md.