Occupation manual 013 / Data warehouse operations

Trace the data before you trust the result.

A proof-first desk for immutable source contracts, field-level lineage, classification, validation receipts, bounded reconciliation, transparent quality, query-cost review, warehouse change evidence, and incident/rollback handoffs.

Short answer: AI can prepare warehouse change evidence from approved contracts and synthetic fixtures. It cannot obtain production secrets/data, invent source truth, execute SQL, alter objects/data, grant access, backfill, merge, deploy, pause pipelines, accept incidents, approve cost, restore, roll back, or message users.

A green quality score is not source truthEvery metric needs its population, denominator, exclusions, query version, window, threshold owner, evidence, and blind spots. Passing a threshold does not prove real-world accuracy or downstream business correctness.

Separate evidence preparation from authority

AI and specialists may prepare

  • versioned source and consumer contract drafts
  • field lineage, schema diffs, and change-impact maps
  • reviewed test designs and retained execution receipts
  • bounded reconciliation, quality, and query-cost evidence
  • incident facts and rollback/restore handoff requirements

Named owners retain

  • source/data/business owners: truth, semantics, metrics, and waivers
  • privacy/security: classification, access, anonymity, and risk
  • FinOps: ceilings, budget, and spending approval
  • release/platform: SQL, access grants, migration, backfill, merge, and deployment
  • incident/operations: pause, restore, reprocess, rollback, and communications

Build the nine-part Warehouse Change & Data Evidence Desk

01

Lock authority and candidate identity

Name data/source/business/platform/privacy/security/quality/FinOps/release/incident owners. Bind repository, commit, build, artifact, config, engine, environment, fixture, and prohibited actions.

Output: candidate authority card
02

Version source and consumer contracts

Record purpose, authoritative fields, types, keys, units, timezone, cadence, late/duplicate/delete/update semantics, idempotency, retention, classification, compatibility, samples, owner, approval, and hash.

Output: controlled contract baseline
03

Trace every field to every consumer

Map source field → job/run → landing → transformation revision/config → warehouse field → semantic metric → consumer. Preserve offsets/windows, partitions, checksums, and missing/stale edges.

Output: lineage and blast-radius map
04

Classify data and minimize access

Apply approved field/dataset classification, purpose, residency, retention, masking/tokenization, row/column policy, export control, and downstream propagation. Separate metadata, test, deploy, and break-glass roles.

Output: classification/access receipt
05

Bind tests to execution evidence

Human-review parsing, schema, integrity, duplicate/replay, deletion, timezone, precision, transformations, incremental/idempotent behavior, failure/recovery, privacy/access/logging, performance, concurrency, and cost tests. No receipt means no pass.

Output: validation evidence chain
06

Reconcile one bounded window

Compare source, accepted, rejected/quarantined, and target counts; totals, keys, nulls, duplicates, and checksums; disclose tolerances, exclusions, late windows, and owners. Mismatches stay unexplained until approved.

Output: reconciliation ledger
07

Make quality and cost transparent

Expose quality denominators/queries/limits. For proposed queries, retain plan or dry run, scan/compute/output estimates, sensitive exposure, platform-appropriate ceilings, owner, and expiry. LIMIT is not a universal cost control.

Output: quality and cost review
08

Prepare the warehouse change review

Package contract/schema diffs, lineage gaps, candidate identity, validation, reconciliation, quality, access/privacy, cost, consumer acknowledgments, observability, migration/backfill/rollback plans, and unresolved risk.

Output: bounded change packet
09

Route incidents and preserve history

Separate observed facts from hypotheses, identify affected runs/partitions and lineage candidates, retain hashes/access evidence, name last-known-good state and recovery validation, append corrections, and stop at approval_ready.

Output: incident/rollback handoff and audit

Use only three change recommendations

Permitted

  • do_not_release
  • insufficient_evidence
  • candidate_for_authorized_change_review

Not available

  • approved to deploy
  • safe to backfill
  • lineage complete
  • data accurate or anonymous
  • recovery ready or cost approved

Use this prompt for disconnected preparation

Act as a data-warehouse change evidence-preparation specialist, not a source/data/business owner, privacy/security authority, FinOps approver, production database operator, release manager, incident commander, recovery operator, sender, or account administrator.

Using only approved contracts, metadata, and synthetic fixtures, create the authority card, controlled source/consumer contracts, field lineage and blast radius, classification/access receipt, reviewed validation plan and execution evidence, bounded reconciliation, transparent quality/cost review, warehouse change packet, incident/rollback handoff, append-only audit, and exact approval packet.

Do not obtain production credentials or data; infer source truth; silently change a contract, schema, mapping, metric, rule, or threshold; execute SQL; alter objects/data; grant access; backfill; merge; deploy; pause; restore; roll back; accept an incident; approve cost; or message anyone. Stop at approval_ready.

Final review before authorized change review

Official source desk

Prove the desk with a synthetic warehouse.

Use generated customers/orders, a renamed field, precision change, duplicate, late deletion, missing lineage edge, restricted synthetic email, reconciliation mismatch, and expensive cross join. The desk should expose every gap, block cost review, remain insufficient_evidence, and touch no production system.