Quality control
Quality control and audit trail
A blocking failure keeps yesterday's good data in use; a warning publishes the data with a flag.
Checks
Six rules on every load
| Check | Example rule | Level |
|---|---|---|
| Completeness | All listed HOSE tickers have a close today | Blocking |
| Freshness | The file date equals the expected trading date | Blocking |
| Range | Move beyond the limit (7% HOSE, 10% HNX, 15% UPCoM) with no corporate action | Warning |
| Consistency | High is at least open, close and low; volume not negative | Blocking |
| Cross-source | Close differs by more than 0.5% between two sources | Warning |
| Identifiers | A new ticker with no NXW code | Blocking |
Audit trail
Every correction, approved and logged
Raw files are never edited. Every check and correction goes to DQ_LOG with user, time and reason; a correction is live only after a second person approves it. Any table can be rebuilt as it stood on a past date.
DQ_LOG
Every check, correction and approval, with user, time and reason.
Four eyes
A correction goes live only after a second person approves it.
Where is it going?
The stack, the four phases and the first steps.