ETL Pipeline Architecture Designer
Designs an end-to-end ETL pipeline with source mappings, transformations, scheduling, and monitoring.
Design an ETL pipeline. Sources: {{source_systems}}. Target: {{target_warehouse}}. Volume: {{data_volume}}. Rules: {{transformation_rules}}. Design: (1) architecture diagram description, (2) source-to-target mapping table, (3) incremental loading strategy per source, (4) scheduling with dependencies and SLAs, (5) data quality checks, (6) error handling, (7) monitoring spec. Recommend an orchestration tool.