papers/hanzo-aso/sections/14-reproducibility-checklist.tex

\section{Reproducibility Checklist}

\label{app:reproducibility}

All experiments include:
\begin{itemize}[leftmargin=1.5em]
    \item \textbf{Environment:} Docker image with exact versions (Python 3.11,
          LanceDB 0.3.0, Claude API 2024.01).
    \item \textbf{Seeds:} Fixed random seeds for sampling (42, 123, 456 for
          three runs; we report mean $\pm$ std).
    \item \textbf{Logs:} Complete API call logs with timestamps and token counts.
    \item \textbf{Artifacts:} Generated patches, test outputs, prior banks.
    \item \textbf{Replay:} Verifier can re-run from logs to validate results.
    \item \textbf{Cost Tracking:} Per-experiment API cost breakdown.
\end{itemize}