04.1
Data Engineering & Pipeline Development
ETL/ELT architecture and development · Data lake and warehouse design · Streaming data pipelines · Data quality and validation frameworks · Data catalogue and lineage management. Tools: Azure Data Factory · Azure Synapse Analytics · Apache Spark · dbt · Airflow · Fivetran · Snowflake · Databricks · Talend
