Job Description
Project Description:
We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize enterprise-scale data platforms using modern cloud technologies. The role involves building robust ELT pipelines, scalable data models, and analytics-ready datasets leveraging Snowflake, Azure Data Factory (ADF), DBT, Python, and SQL. The ideal candidate will play a key role in enabling data-driven decision making by delivering high-quality, governed, and performant data solutions.
Responsibilities:
Key Responsibilities
• Design and develop scalable ELT pipelines using Snowflake, ADF, DBT, and Python.
• Build and maintain enterprise data models including 3NF, Star Schema, and Snowflake Schema.
• Optimize Snowflake performance through query tuning, clustering, micro-partitioning, and warehouse management.
• Develop reusable and modular data transformation frameworks using DBT (Jinja, Macros, Testing, Documentation).
• Automate data ingestion, transformation, and operational processes using Python, Pandas, and PySpark.
• Implement workflow orchestration using tools such as Apache Airflow, Prefect, or Dagster.
• Establish data quality, governance, monitoring, and CI/CD best practices.
• Collaborate with Data Analysts, Data Scientists, Product Owners, and Business Stakeholders to deliver trusted data products.
• Create and maintain technical documentation, deployment procedures, and operational runbooks.
Mandatory Skills Description:
Mandatory Skills
• Snowflake Data Warehouse
• Azure Data Factory (ADF)
• DBT
• Python
• Advanced SQL
• Data Modeling (3NF, Star Schema, Snowflake Schema)
• Apache Airflow / Prefect / Dagster
• Cloud Platforms (Azure preferred)
• Git and CI/CD
• Data Quality and Governance Frameworks
• Agile/Scrum Methodology