Skip to content

PLAT-212: Experiment Protocol and Run Evidence

Statement

The platform shall support a declarative experiment protocol that records the scenario, DSL identity, experimental conditions, run count, timeout policy, success criteria, assigned script or prompt, and any condition-specific configuration. Each experiment run shall produce durable run evidence including the resolved protocol, lifecycle events, artifacts captured during execution, result summary, and enough metadata to reproduce or audit the run.

Rationale

PLAT-205 covers experiment orchestration at a product-capability level. LilRAE (formerly APTL) adds the missing research-grade contract: runs must be specified and archived in a way that supports repeatability, audit, and comparison.

Traceability

  • DOCUMENTS → GITHUB_ISSUE Brad-Edwards/bigrae#399 (Experiment management / orchestration tracking)
  • DOCUMENTS → GITHUB_ISSUE Brad-Edwards/bigrae#466 (Experiment run orchestration tracking)
  • DOCUMENTS → SPEC aptl:SCN-008 (LilRAE specification, former APTL identifier SCN-008: Append-Only Event Timeline)
  • DOCUMENTS → SPEC aptl:EXP-002 (LilRAE specification, former APTL identifier EXP-002: Experiment Protocol Specification)
  • DOCUMENTS → SPEC aptl:EXP-009 (LilRAE specification, former APTL identifier EXP-009: Structured Experiment Result Summary Export)
  • DOCUMENTS → SPEC aptl:REP-001 (LilRAE specification, former APTL identifier REP-001: Experiment Manifest for Reproducibility)
  • DOCUMENTS → SPEC aptl:SCN-006 (LilRAE specification, former APTL identifier SCN-006: Run Archive Packaging and S3 Export)
  • DOCUMENTS → PULL_REQUEST 780 (Experiment orchestration implementation PR)