Metadata model

Fields Collected By Layer

Layer evidence

Metadata fields collected by layer

Bronze metadata

  • Provenance: registry id, source system, file path, file name, file hash, file modified timestamp.
  • Run evidence: ingestion run id, ingested timestamp, load status, row count, validation errors.
  • Schema evidence: source schema version, structure bucket, raw table name, source column, ordinal, inferred type.
  • Exception handling: quarantine reason, unmapped structure, ignored path, failed parse evidence.

Silver metadata

  • Lineage: source schema version, bronze table, source column, target silver table, target column.
  • Mapping: mapping status, match rule, confidence score, evidence, reviewer status.
  • Policy: target data type, nullable policy, semantic group, effective version range.
  • Transform: cast/normalize/parse rule, validation status, lineage key.

Gold metadata

  • Contract: source silver table, target gold table, published columns, included/excluded status.
  • Business logic: filters, derived rules, metric definitions, review notes.
  • Consumer coverage: Power BI fields, missing fields, available silver/gold mappings.
  • Promotion: contract version, artifact path, validation result, approval status.