"DART Model Upgrade: audit and update DART AI infrastructure for model or coding-agent upgrades, including named models, reasoning modes, migrations, compatibility reviews, and visual simulation-debugging evaluations"
Install
npx skillscat add dartsim/dart/dart-model-upgrade Install via the SkillsCat registry.
dart-model-upgrade
Use this skill in Codex to run the DART dart-model-upgrade workflow. The editable
workflow source lives in .claude/commands/; this file is its generated adapter
in the shared .agents/skills/ catalog.
Invocation
- Claude Code/OpenCode:
/dart-model-upgrade <arguments> - Codex:
$dart-model-upgrade <arguments>
Treat the text after the skill name as $ARGUMENTS. When the workflow
references $1, $2, etc., map those to the positional values supplied by the
user.
Command Body
Audit or update DART's AI infrastructure for: $ARGUMENTS
Objective
Use live upstream evidence and representative DART tasks to decide what to
preserve, update, remove, consolidate, or add. Prefer the smallest change that
improves the target model or tool without weakening safety, evidence, public
paths, or cross-tool capability parity. Do not equate a larger harness with a
better harness. Keep the reusable intake, comparison, verification, and
closeout core model-agnostic. The workflow itself is an audit surface: improve
it when a target exposes a reusable gap, and replace obsolete target-specific
guidance instead of accumulating one branch or command per model family.
Because DART is a 3D physics simulator, every target must also demonstrate how
well it investigates simulation state with text-first and visual/debug evidence.
Required Reading
@AGENTS.md
@docs/ai/principles.md
@docs/ai/components.md
@docs/ai/sessions.md
@docs/ai/workflows.md
@docs/ai/verification.md
@docs/AGENTS.md
@docs/README.md
@docs/information-architecture.md
@docs/onboarding/ai-tools.md
@docs/onboarding/agent-sim-verification.md
@docs/dev_tasks/README.md
Workflow
Normalize the target and scope. Preserve an explicitly named model,
reasoning mode, tool version, branch, andaudit-onlyorapplyboundary.
Record which DART branch is being audited and whether GitHub mutations are
approved. Do not silently substitute a different model or pin the repository
to the audit target. Treataudit-onlyas read-only for tracked checkout and
external state: do not edit, regenerate, create a dev-task folder, run
auto-fixing lint, commit, push, or mutate GitHub.applypermits scoped local
implementation; external mutations still need their own approval.Capture the control. Before any apply-mode edit, record
gitstate,
installed tool versions,pixi run ai-doctor --json, current model/config
references, prompt and instruction sizes, generated skill metadata size,
custom-agent inheritance, hooks, scenarios, durable context and project-state
owners, active plan/dev-task handoff surfaces, and the branch-localdart-verify-simroute and rendering/image-evaluation availability.Record docs-policy freshness advisories and baseline read-only focused gates.
If anapplytask is multi-session, create or refreshdocs/dev_tasks/<task>/. Inaudit-only, report the recommended handoff path
without creating it.Refresh primary guidance. Read the current official model, prompting,
migration, configuration, skills, agents, and hook guidance relevant to the
target. Record source URLs, retrieval date, and installed-version evidence.
Treat repository wording and remembered limits as hypotheses when upstream
behavior can drift. Separate reusable procedure from target-specific
evidence, and flag assumptions in this workflow that the new target
invalidates.Classify every finding. Use these verdicts:
- preserve — current design is intentional and evidence-backed;
- update — guidance or configuration is stale or incorrect;
- remove/consolidate — repeated detail costs context without changing
behavior; - add — a missing trigger, contract, diagnostic, or gate has a distinct
owner and representative failure it prevents.
Check model routing and effort, project and custom-agent pins, this workflow
source and its generated adapters, other workflow sources,AGENTS.md
chains, skill descriptions, tool descriptions, hooks, scenarios, tests, and
branch-profile differences.Audit the durable context and project-state layer: the north star,
docs/ai/sessions.md,docs/plans/dashboard.md, activedocs/dev_tasks/*/RESUME.mdhandoffs, and the handbook, design, or plan
owners routed into task sessions. Treat missing discovery, stale state,
duplicated facts, and excessive default loading as harness findings.Design a controlled comparison. Keep model, prompt, configuration,
reasoning effort, and optional agent features as separate variables. When
access permits, compare:- the existing model with existing prompt/settings;
- the target model with the same prompt and preserved settings;
- the target at the preserved effort and one lower effort;
- only then, the smallest justified prompt or configuration change;
- optional delegation, concurrency, or tool changes in a separate lane.
If an old model or behavioral runner is unavailable, use structural
comparison and say so; never promote structural checks into model-quality
claims.For every target, run a representative DART 3D physics investigation through
the branch'sdart-verify-simcapability. Give the control and target the
same scene or behavior claim. Require a text correctness oracle such as step
metrics, scene/trajectory/contact comparison, profiling output, or a focused
behavioral test, then corroborate it with an assessed headless capture and
only the debug layers needed by the claim. Compare whether each model:- asks for missing evidence instead of guessing;
- repairs or rejects cropped, occluded, or ambiguous views;
- selects claim-tied views and debug layers;
- reconciles text/image disagreement; and
- states what the image does not prove.
Images are never the sole correctness oracle. If rendering or image-capable
review is unavailable, exercise the text path andverification-bundle
where possible, record the exact limitation, and do not turn structural tool
availability into a model-quality claim.Route model and reasoning by task shape. Derive routing for the target
family from its refreshed official guidance, then record the result in the
model-routing owner,docs/ai/README.md§ "Model Routing", which keeps one
bounded entry per validated tool lane. Match capability tiers to task
shape: the top tier for the hardest ambiguous work, the middle tier for
everyday or read-heavy work, and the light tier for clear repeatable work.
Do not carry one family's tier or reasoning-mode names into another
family's guidance.
Deeper reasoning modes give one difficult task more time; parallel lanes
need explicit user authorization for delegation; most tasks need neither.
An explicitly requested top-tier evaluation must exercise that lane, not
turn it into a global default. Replace a stale per-family entry in the
owner doc; do not clone the workflow or append a section per model family
here.Implement only in
applymode. Inaudit-only, skip implementation and
continue only with non-mutating verification and the evidence report. Inapply, implement the smallest supported delta. Keep outcome, success
criteria, domain constraints, safety, permissions, evidence, tool routing,
output, and stop conditions explicit. Remove repeated procedural detail one
coherent group at a time. Edit.claude/commands/or.claude/skills/
sources and regenerate adapters withpixi run sync-ai-commands; do not
hand-edit generated.agents/skills/or.opencode/command/files. Improve
owner routing and progressive disclosure instead of loading every plan,
task, or handbook page by default. When evidence exposes a reusable weakness
in the model-upgrade procedure, improve this maintained source in the sameapplychange. Preserve its model-agnostic core.Remove superseded model-specific guidance.
Regenerate adapters after updating the maintained source.Exercise trigger and failure boundaries. Cover direct, indirect,
incomplete, non-trigger, and edge prompts. Include a negative case that must
retain the existing route, plus failure-sensitive checks for model pins,
configuration aliases, generated parity, instruction discovery, and
approval boundaries when touched. Include a fresh-session case that must
find current project state and the correct cross-session resume surface
without hidden chat history. Include visual-debug failure cases for an
unavailable renderer, a poor view, text/image disagreement, and a static
geometry defect that visual-only inspection must not pass. Inaudit-only,
assess existing coverage and report missing cases without adding them.Verify and review. Run focused checks,
pixi run check-ai-infra,pixi run exercise-agent-scenarios,pixi run test-ai-infra, relevant
docs/AI checks fromdocs/ai/verification.md, includingpixi run check-docs-policywhen the durable context layer is touched.audit-onlymust use read-only lint gates such aspixi run check-lint;
onlyapplyruns auto-fixingpixi run lintbefore a commit. Complete the
principle audit and two clean role-separated reviews. Label unavailable
behavioral, cross-tool, or hosted evidence explicitly.Close out by mode and branch. In
audit-only, stop with findings,
recommendations, limitations, proposed gates, and a branch-local
apply/adapt/omit recommendation; do not perform change-oriented closeout.
Only inapplymode, make the changelog decision, promote durable guidance,
and remove the temporary dev-task folder in the completing change. Loaddocs/onboarding/changelog.mdfor that closeout decision instead of
carrying it through the audit. For shared infrastructure, finish and merge
DART 7 first; then inspectrelease-6.20from its own current base and
record an apply/adapt/omit verdict. Never copy DART 7-only paths or
assumptions into the intentionally smaller release catalog. Pushes, PRs,
comments, review re-triggers, and other GitHub mutations require explicit
maintainer/user approval.
Output
- Target, branch, installed versions, upstream sources, and control state
- Preserve/update/remove/consolidate/add findings with evidence
- Durable context, project-state, session-handoff, and freshness findings
- Comparison matrix, limitations, prompt/config changes, and unchanged choices
- 3D physics investigation and visual/debug evaluation results, artifacts,
failure-boundary outcomes, and unavailable-evidence limitations - Direct, indirect, incomplete, non-trigger, and edge-case results
- Mode, mutations performed (none for
audit-only), gates, principle audit, two
review passes, and blockers - For
audit-only, recommendations and proposed change/validation scope; forapply, the changelog decision and branch completion state - For shared changes, the DART 7 then DART 6 apply/adapt/omit verdict