# Nonnormal RL Closed Loops Bilingual Paper Package

This is an independent bilingual paper package for:

**Nonnormality in Reinforcement Learning Closed Loops: From Action Smoothing to Source-Amplifier Diagnostics**

Chinese title:

**强化学习闭环中的非正规性：从动作平滑到源-放大器诊断**

## Package Purpose

This package turns the previous PaperSpine working folder into a standalone article bundle with English and Chinese paper versions. The article type is a 6-page conference/workshop short paper, technical note, or arXiv-style position-plus-evidence paper.

Core thesis:

> Action jitter in continuous-control RL is not the final risk. Residual actions, exploration noise, execution noise, and actuator disturbances become risky when propagated through a nonnormal closed-loop amplifier, where they appear as state covariance, safety-margin loss, posterior Bellman-Lyapunov residuals, and projection burden.

## Main Outputs

| Output | Path | Status |
|---|---|---|
| English LaTeX source | `paper_en/main_en.tex` | Ready |
| English PDF | `paper_en/main_en.pdf` and root copy `paper_en.pdf` | Compiled |
| English Markdown | `paper_en/main_en.md` | Generated |
| Chinese LaTeX source | `paper_zh/main_zh.tex` | Ready |
| Chinese PDF | `paper_zh/main_zh.pdf` and root copy `paper_zh.pdf` | Compiled |
| Chinese Markdown | `paper_zh/main_zh.md` | Generated |
| Figures | `figures/` | Copied into package |
| Evidence files | `evidence/` | Copied into package |
| Reference reports | `references/` | Copied into package |

## Claim Level

The paper is intentionally conservative:

- local surrogate diagnostics;
- numerical simulation evidence;
- controlled interventions separating source and amplifier;
- no global nonlinear safety guarantee;
- no hardware validation;
- no claim that P-ALE directly reduces nonnormality.

## Best-Supported Evidence In The Paper

1. **CI-1 amplifier scan:** fixed eigenvalues, spectral radius, input channel, and source covariance; changed eigenvector geometry. State covariance trace rises from about `0.37` to `15.66`.
2. **CI-2 source intervention:** fixed nonnormal amplifier; filtered source reduces action variance from `0.03992` to `0.00317` and state covariance from `15.849` to `12.393`.
3. **2D constrained RL ablation:** ordinary `Var(u)` and action-diff penalties do not remove dense violations or posterior residuals; the full response reaches dense violation `0.0000` and B-L max about `5.24`.
4. **Projection burden:** normalized correction drops from about `0.09362` for projection-only to `0.01093` for the full response.
5. **Residual-feedback diagnostic:** finite-difference actor-Jacobian proxy drops from about `16.23` for Direct TD3 to `0.274` for the full method.

## Directory Layout

```text
nonnormal_rl_closed_loops_bilingual_paper_package_20260523/
  README.md
  MANIFEST.md
  build_report.md
  citation_todo.md
  package_audit.md
  paper_en.pdf
  paper_zh.pdf
  paper_en/
    main_en.tex
    main_en.pdf
    main_en.md
  paper_zh/
    main_zh.tex
    main_zh.pdf
    main_zh.md
  figures/
    source_amplifier_layers.png
    fig1_ci1_amplifier_isolation.png
    fig2_ci2_source_intervention.png
    suite_high_noise_comparison.png
    caps_style_method_comparison_v4_1.png
    conditional_variance_proxy_summary.png
    controlgym_suite_high_noise_comparison.png
    full3d_5seed_high_noise_summary.png
  evidence/
    paper_plan.md
    paper_options_report.md
    experiment_claim_matrix.md
    evidence_bank.md
    project_evidence_dossier.md
    project_evidence_index.md
    figure_asset_map.md
    claim_register.md
    source_inventory.md
  references/
    REFERENCE_INDEX.md
    deep-research-report (49).md
    final_report.md
```

## How To Rebuild PDFs

From `paper_en/`:

```bat
C:\Users\wuyue\.codex\plugins\cache\openai-bundled\latex\0.2.0\bin\tectonic.exe main_en.tex
```

From `paper_zh/`:

```bat
C:\Users\wuyue\.codex\plugins\cache\openai-bundled\latex\0.2.0\bin\tectonic.exe main_zh.tex
```

The Chinese version uses `ctexart`. In the current environment it compiled successfully with bundled Tectonic.

## Submission Caveats

Before submission, do the following:

- verify formal citations from original DOI-level papers rather than generated reports;
- link each final figure to the exact raw data and plotting script;
- decide whether CI-3/source-direction scan remains future work or is newly run;
- tighten overfull table warnings if a camera-ready venue has strict layout rules.
