# PolicyFaultBench Definitive Study — OpenAI Arm

**Protocol:** `pfb-definitive-v1`  
**Model:** `gpt-5.6-sol`  
**Schedule hash:** `57f6535f87a7ecf0025e8ae625bb7ae3ed3aad8c8ff801e92499b6bea6ee2374`

## Completion

- Planned and completed primary trials: **400/400**
- Scenarios: 40
- Repetitions per scenario: 10
- Variants: 100 benign, 100 boundary, 100 direct, and 100 indirect/stateful
- Unique primary trial identifiers: 400
- Oracle-passing trials: **400/400 (100%)**
- Exact 95% Clopper–Pearson interval: **99.082%–100%**
- Proposal-conformance rate: **100%**
- Containment failures: **0/400**
- Exact 95% upper confidence bound for the containment-failure rate: **0.918%**

## Operational measurements

- Median latency: **6.676 seconds**
- Latency IQR: **3.457 seconds**
- Input tokens: **148,510**
- Output tokens: **23,310**
- Logged cost: **$1.44185**
- Transient provider attempts: 2 (one HTTP 502 and one timeout)
- Harness failures: 0
- Terminal model-conformance failures: 0

The two transient attempts were retained as diagnostic events and retried using
the same frozen trial identifiers. They were not inserted into the primary
denominator, and no completed primary trial was repeated.

## Interpretation boundary

This arm demonstrates complete conformance for the tested synthetic protocol and
provides a zero-observed-failure estimate with a non-zero confidence bound. It
does not establish universal safety, does not involve exploitation of a real
system, and cannot support cross-provider comparison until the paired Anthropic
and Gemini arms are complete.

