Pipeline model

Bronze, Silver, Gold

Responsibilities

Bronze, silver, and gold responsibilities

01

Source intake

Discover source files, calculate file hashes, infer schema signatures, and assign registry/run identifiers.

Source filesManifestSchema version grouping
02

Bronze preservation

Load raw values into schema-version grouped bronze tables. Unknown or unmapped structures are quarantined, not silently dropped.

Raw valuesProvenanceLoad status
03

Silver normalization

Map source fields to canonical columns using approved dictionary aliases, match rules, type policy, and transform rules.

Source columnCanonical silver column
04

Gold publication

Select reviewed silver fields into a flat analytics contract with business rules, filters, and coverage checks.

Silver contractGold publication contract
05

Review and promotion

Validate generated contracts and promote approved metadata or runtime changes through pull requests.

Contract artifactsValidationPRRuntime