cc-steer eval

Compute the mechanical metrics for the current prompt version. No LLM calls.

cc-steer eval [OPTIONS]

Recomputes everything from raw verdicts: the golden-set gate, audited precision and reject contamination over the reproduced uniform core, the cumulative-pool secondary estimates, per-kind tables, and (with --compare-to) verdict flips against an earlier prompt version.

Full --help output

Usage: cc-steer eval [OPTIONS]

  Compute the mechanical metrics for the current prompt version. No LLM calls.

  Recomputes everything from raw verdicts: the golden-set gate, audited
  precision and reject contamination over the reproduced uniform core, the
  cumulative-pool secondary estimates, per-kind tables, and (with ``--compare-
  to``) verdict flips against an earlier prompt version.

Options:
  --seed INTEGER        The seed the audit ran with.  [default: 1]
  --accepts INTEGER     The audit's accept budget.  [default: 60]
  --rejects INTEGER     The audit's reject budget.  [default: 60]
  --compare-to INTEGER  Earlier prompt version for flip analysis.
  --json                Emit the full metrics as JSON.
  --db FILE             Database path. Defaults to ~/.cc-steer/feedback.db.
  --help                Show this message and exit.

Options

--seed: INTEGER = 1

The seed the audit ran with.

--accepts: INTEGER = 60

The audit’s accept budget.

--rejects: INTEGER = 60

The audit’s reject budget.

--compare-to: INTEGER

Earlier prompt version for flip analysis.

--json

Emit the full metrics as JSON.

--db: FILE

Database path. Defaults to ~/.cc-steer/feedback.db.