Live Engineering Dashboard
Data Pipeline
ETL pipeline flow and data transformations
Extract
Waiting
PostgreSQLCSV FilesREST API
Transform
Waiting
NormaliseDeduplicateEnrichValidate
Load
Waiting
Data WarehouseVector StoreAnalytics DB
Transformation Log
| Step | Operation | Input | Output | Duration | Status |
|---|---|---|---|---|---|
| 1 | Schema Normalisation | 12,450 | — | 0.8s | Pending |
| 2 | Deduplication | 12,450 | — | 1.2s | Pending |
| 3 | Data Enrichment | 12,120 | — | 0.9s | Pending |
| 4 | Validation & Filtering | 12,120 | — | 0.6s | Pending |
Recent Runs
Today 11:45
11,890 records4.2sSuccess
Today 08:30
10,234 records3.9sSuccess
Yesterday 22:00
15,678 records5.1sSuccess
Yesterday 14:15
13,456 records4.8sSuccess
Apr 4 18:00
18,901 records6.2sWarning