Catalog
Yeachan-Heo/ultraqa

Yeachan-Heo

ultraqa

QA cycling workflow - test, verify, fix, repeat until goal met

global
New~1.1k
v1.1Saved May 11, 2026

UltraQA Skill

[ULTRAQA ACTIVATED - AUTONOMOUS QA CYCLING]

Overview

You are now in ULTRAQA mode - an autonomous QA cycling workflow that runs until your quality goal is met.

Cycle: qa-tester → architect verification → fix → repeat

Goal Parsing

Parse the goal from arguments. Supported formats:

Invocation Goal Type What to Check
/oh-my-claudecode:ultraqa --tests tests All test suites pass
/oh-my-claudecode:ultraqa --build build Build succeeds with exit 0
/oh-my-claudecode:ultraqa --lint lint No lint errors
/oh-my-claudecode:ultraqa --typecheck typecheck No TypeScript errors
/oh-my-claudecode:ultraqa --custom "pattern" custom Custom success pattern in output

If no structured goal provided, interpret the argument as a custom goal.

Cycle Workflow

Cycle N (Max 5)

  1. RUN QA: Execute verification based on goal type

    • --tests: Run the project's test command
    • --build: Run the project's build command
    • --lint: Run the project's lint command
    • --typecheck: Run the project's type check command
    • --custom: Run appropriate command and check for pattern
    • --interactive: Use qa-tester for interactive CLI/service testing:
      Task(subagent_type="oh-my-claudecode:qa-tester", model="sonnet", prompt="TEST:
      Goal: [describe what to verify]
      Service: [how to start]
      Test cases: [specific scenarios to verify]")
      
  2. CHECK RESULT: Did the goal pass?

    • YES → Exit with success message
    • NO → Continue to step 3
  3. ARCHITECT DIAGNOSIS: Spawn architect to analyze failure

    Task(subagent_type="oh-my-claudecode:architect", model="opus", prompt="DIAGNOSE FAILURE:
    Goal: [goal type]
    Output: [test/build output]
    Provide root cause and specific fix recommendations.")
    
  4. FIX ISSUES: Apply architect's recommendations

    Task(subagent_type="oh-my-claudecode:executor", model="sonnet", prompt="FIX:
    Issue: [architect diagnosis]
    Files: [affected files]
    Apply the fix precisely as recommended.")
    
  5. REPEAT: Go back to step 1

Exit Conditions

Condition Action
Goal Met Exit with success: "ULTRAQA COMPLETE: Goal met after N cycles"
Cycle 5 Reached Exit with diagnosis: "ULTRAQA STOPPED: Max cycles. Diagnosis: ..."
Same Failure 3x Exit early: "ULTRAQA STOPPED: Same failure detected 3 times. Root cause: ..."
Environment Error Exit: "ULTRAQA ERROR: [tmux/port/dependency issue]"

Observability

Output progress each cycle:

[ULTRAQA Cycle 1/5] Running tests...
[ULTRAQA Cycle 1/5] FAILED - 3 tests failing
[ULTRAQA Cycle 1/5] Architect diagnosing...
[ULTRAQA Cycle 1/5] Fixing: auth.test.ts - missing mock
[ULTRAQA Cycle 2/5] Running tests...
[ULTRAQA Cycle 2/5] PASSED - All 47 tests pass
[ULTRAQA COMPLETE] Goal met after 2 cycles

State Tracking

Track state in .omc/ultraqa-state.json:

{
  "active": true,
  "goal_type": "tests",
  "goal_pattern": null,
  "cycle": 1,
  "max_cycles": 5,
  "failures": ["3 tests failing: auth.test.ts"],
  "started_at": "2024-01-18T12:00:00Z",
  "session_id": "uuid"
}

Cancellation

User can cancel with /oh-my-claudecode:cancel which clears the state file.

Important Rules

  1. PARALLEL when possible - Run diagnosis while preparing potential fixes
  2. TRACK failures - Record each failure to detect patterns
  3. EARLY EXIT on pattern - 3x same failure = stop and surface
  4. CLEAR OUTPUT - User should always know current cycle and status
  5. CLEAN UP - Clear state file on completion or cancellation

STATE CLEANUP ON COMPLETION

IMPORTANT: Delete state files on completion - do NOT just set active: false

When goal is met OR max cycles reached OR exiting early:

# Delete ultraqa state file
rm -f .omc/state/ultraqa-state.json

This ensures clean state for future sessions. Stale state files with active: false should not be left behind.


Begin ULTRAQA cycling now. Parse the goal and start cycle 1.

Files1
1 files · 1.0 KB

Select a file to preview

Overall Score

82/100

Grade

B

Good

Safety

84

Quality

81

Clarity

88

Completeness

75

Summary

UltraQA is an autonomous QA cycling skill that iteratively runs quality checks (tests, build, lint, typecheck, or custom patterns), diagnoses failures using an architect subagent, applies fixes via an executor, and repeats until the goal is met or max cycles (5) is reached. It orchestrates multiple subagent types (qa-tester, architect, executor) and tracks state across cycles with early exit on repeated failures.

Detected Capabilities

subagent orchestrationstate file managementbuild/test/lint command executionfailure diagnosis and analysisinteractive CLI testingfile system access for state trackingcleanup and session management

Trigger Keywords

Phrases that MCP clients use to match this skill to user intent.

fix failing testsdebug build errorsresolve lint failurescycle until passingautomated qa repair

Risk Signals

INFO

Deletion of state file with `rm -f` in cleanup step

STATE CLEANUP ON COMPLETION section
INFO

Subagent spawning with dynamic prompts containing user-supplied goal patterns

Cycle Workflow, step 1 (CUSTOM goal handling)
INFO

State file persistence with session_id and active flag used for workflow coordination

State Tracking section, .omc/ultraqa-state.json

Use Cases

  • Iteratively fix failing tests until suite passes
  • Troubleshoot build failures and apply corrections automatically
  • Cycle through lint/typecheck errors with diagnosis and fixes
  • Verify custom success patterns with automated remediation
  • Interactive service/CLI testing with structured test cases and auto-fixes

Quality Notes

  • Excellent structure: clear cycle workflow with numbered steps and well-documented exit conditions
  • Comprehensive observability: detailed progress output examples show user exactly what each cycle logs
  • Strong state tracking: JSON schema provided for .omc/ultraqa-state.json with all necessary fields (cycle count, failure history, session_id)
  • Good use of tables for goal types, exit conditions, and cycle actions — highly scannable
  • Practical command examples for each goal type (tests, build, lint, typecheck)
  • Interactive mode well-specified: includes subagent task structure with model selection and prompt template
  • Safety-conscious: explicit rules for early exit on repeated failures (3x same failure) to prevent infinite loops
  • Minor: Cancellation via `/oh-my-claudecode:cancel` mentioned but no detailed spec for how cancel interacts with state
  • Missing: No explicit handling of what happens if a file listed in FIX step doesn't exist or is read-only
  • Missing: No guidance on how to interpret 'same failure' — string equality? Pattern matching? Causes potential loop if detection is too strict
Model: claude-haiku-4-5-20251001Analyzed: May 11, 2026

Reviews

Add this skill to your library to leave a review.

No reviews yet

Be the first to share your experience.

Version History

v1.1

Content updated

2026-04-20

Latest
v1.0

No changelog

2026-04-12

Add Yeachan-Heo/ultraqa to your library

Command Palette

Search for a command to run...