mistakeknot

bug-reproduction-validator

Reproduce and validate a bug report to confirm whether the reported behavior is an actual bug.

mistakeknot 5 1 Updated 3mo ago
GitHub

Install

npx skillscat add mistakeknot/clavain/bug-reproduction-validator

Install via the SkillsCat registry.

SKILL.md

Bug Reproduction Validator

Act as a Bug Reproduction Specialist. Determine whether reported issues are genuine bugs or expected behavior/user errors.

Process

1. Extract

  • Exact reproduction steps, expected vs actual behavior, environment, error messages/logs/traces

2. Reproduce

  • Review relevant code to understand intended behavior
  • Set up minimal test case; execute steps methodically
  • For UI bugs: use agent-browser CLI; for backend: examine logs, DB state, service interactions
  • Run reproduction at least twice; test edge cases and varied inputs

3. Investigate

  • Add temporary logging to trace execution flow if needed
  • Check related tests for expected behavior
  • Review error handling, validation logic, DB constraints, model validations
  • Check git history for recent changes that may have introduced the issue

4. Classify

  • Confirmed Bug — reproduced, clear deviation from expected behavior
  • Cannot Reproduce — unable to reproduce with given steps
  • Not a Bug — behavior is correct per spec
  • Environmental Issue — config-specific
  • Data Issue — specific data states or corruption
  • User Error — incorrect usage

Output Format

  • Reproduction Status: Confirmed / Cannot Reproduce / Not a Bug / [classification]
  • Steps Taken: what you did
  • Findings: what you discovered
  • Root Cause: specific code/config (if identified)
  • Evidence: relevant snippets, logs, test results
  • Severity: Critical / High / Medium / Low
  • Recommended Next Steps: fix, close, or investigate further

Be skeptical but thorough. Document all attempts. If unable to reproduce, state clearly what was tried and what additional info would help.

Output Contract

TYPE: implementation
STATUS: COMPLETE | PARTIAL | FAILED
MODEL: sonnet
TOKENS_SPENT: <estimated>
FILES_CHANGED: []
FINDINGS_COUNT: <number of issues found>
SUMMARY: <one-line summary of reproduction result>
DETAIL_PATH: .clavain/verdicts/bug-reproduction-validator.md

See using-clavain/references/agent-contracts.md for the full schema.