Data quality · Python · CI
Data Contract Monitor
A data-quality engine that turns business expectations into repeatable checks. Exact cross-file validation, readable reports, and run comparisons help teams catch unreliable inputs and explain what changed before those inputs reach reports or models.
Open case note
- Need
- Catch quiet data failures before they become reporting, modeling, or operational problems.
- What I built
- A local-first validator for CSV, Excel, JSON, JSON Lines, and optional Parquet. One rule engine serves the dashboard, command line, API, package, and GitHub Action; streaming keeps supported checks exact across batches.
- Result
- Compare runs and contract versions, trace findings to readable rules, and retain the same evidence across local review and CI. A failed data contract stays distinct from a program failure.
- Proof
- The v0.3.4 source qualification records 71 passing tests. A documented Linux benchmark exercised exact streaming checks on a synthetic one-million-row CSV; its timing is specific to that environment.
Public alpha v0.3.4 · Synthetic demos · Trusted-workstation dashboard · Privacy signals require human review · Native Windows and endpoint-protection qualification remain separate release checks.