Skip to content
Paula Livingstone writing · projects · tools

Projects

Attestable

When probabilistic AI feeds safety-critical systems, unproven output can drive physical action unchecked. Attestable is a discipline for marking a claim's basis, so it cannot.

OT SecurityCyber-Physical AssuranceIEC 62443ProvenanceSafety CaseLLM Agents

Evaluation

10 entries

Scenario-based evaluation against success and failure criteria declared in advance. The scenario protocol is fixed; the case set and the results are still to come.

  1. Evaluation Questions, and Why Representation Precedes Discrimination
  2. Three Classes of Evidence, and Why They Are Not Interchangeable
  3. The Pre-Execution Protocol: Freeze, Sources, Strata and Sealing
  4. The Domain Corpus: Thirty-Nine Requirements, Fixed in the Domain's Own Words
  5. Translation: Mapping Frozen Requirements onto Demands, and Measuring What Is Lost
  6. Representation Results: What the Demand Language Could and Could Not Express
  7. Discrimination Results: Five Cases, and What Five Cases Can Support
  8. Failure Analysis: Two Failures of Different Kinds
  9. Threats to Validity
  10. Implications: A Classified Failure Set, and Why No Repair Was Attempted