← Back to Dashboard
1. Prompt Versioning and Promotion2. CI/CD Quality Gates for AI

Prompt Versioning and Promotion

📚 MLOps and PromptOps10 min110 XP

PromptOps as Engineering Discipline

Prompts, guardrails, and routing rules are release artifacts. Store them in version control with tests and changelogs - a one-word prompt edit can shift production behavior more than a thousand-line code change, yet most teams ship prompt edits with less review than a CSS tweak.

Version by Behavioral Impact

BumpExample changeRequired validation
Patch (3.2.1)Typo fix, formatting - no behavioral intentSmoke eval subset
Minor (3.3.0)New instruction, added example, tone shiftFull golden + safety suites
Major (4.0.0)Output schema change, role redefinition, model swapFull suites + canary rollout + consumer coordination

Repository Layout That Works

prompts/
  ticket-triage/
    v3.2.0.md          # the prompt text, immutable once tagged
    changelog.md       # what changed and WHY ("reduced P1 over-escalation")
    evals/
      golden.jsonl     # task cases + expected properties
      scores-v3.2.0.json
routes/
  routing-matrix.yaml  # task → model tier, versioned alongside
guardrails/
  gr-support-x7.json   # exported config, reviewable in PRs

Promotion Flow

  1. PR with prompt diff + changelog rationale - reviewed like code.
  2. CI runs regression + safety suites against the candidate.
  3. Promote through dev → staging → prod with the same artifact (no prod-only edits, ever).
  4. On Bedrock, Prompt Management can hold versioned prompt resources your runtime references by version - promotion becomes a pointer update.
  • Semantic-version prompts by behavior impact.
  • Run regression and safety suites per change - no exceptions for "tiny" edits.
  • Promote through staged environments with the exact artifact you tested.
Anti-pattern: prompts living in a dashboard textbox, edited live in production. If the current prompt isn't reproducible from version control, you don't have a rollback - you have an archaeology project.
🧪 Knowledge Check
Press 1-4 to select1 of 2
PromptOps treats prompts as:
Temporary notes
Versioned deployment artifacts
Secrets
UI-only text