cc-steer score-watcher
Score one watcher recipe under the uniform Tinker-frame instrument and write .athome-metric.json.
cc-steer score-watcher [OPTIONS]The pure-observer metric command the base-model sweep’s ExperimentSpec invokes: it fits and scores the recipe against the pinned arm and reports the sentinel AUC on the athome metric channel, with no registry, retrain-journal, or promotion side effects. Refuses before any spend if the recipe drifts off the pinned arm or its spend cap exceeds --spend-cap-usd. Run from the experiment working directory so the metric and score report land beside it.
Full --help output
Usage: cc-steer score-watcher [OPTIONS]
Score one watcher recipe under the uniform Tinker-frame instrument and write
``.athome-metric.json``.
The pure-observer metric command the base-model sweep's ExperimentSpec
invokes: it fits and scores the recipe against the pinned ``arm`` and
reports the sentinel AUC on the athome metric channel, with no registry,
retrain-journal, or promotion side effects. Refuses before any spend if the
recipe drifts off the pinned arm or its spend cap exceeds ``--spend-cap-
usd``. Run from the experiment working directory so the metric and score
report land beside it.
Options:
--recipe FILE JSON recipe to score; defaults to the packaged
E8-winner recipe.
--arm TEXT The BASE_MODELS arm this spec pins; the recipe's base
ids must resolve to it. [required]
--spend-cap-usd FLOAT Harness-pinned cap on the fit+score spend of one
unit; a recipe cap above it is refused. [required]
--help Show this message and exit.
Options
--recipe: FILE- JSON recipe to score; defaults to the packaged E8-winner recipe.
--arm: TEXT- Required. The BASE_MODELS arm this spec pins; the recipe’s base ids must resolve to it.
--spend-cap-usd: FLOAT- Required. Harness-pinned cap on the fit+score spend of one unit; a recipe cap above it is refused.