Job Description
Location: Hyderabad
Experience: 2–5 years
Notice Period: Immediate to 15 days
We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have strong experience in building data pipelines, working with modern data platforms, and implementing scalable cloud-based solutions. This role requires hands-on expertise in SQL, Python, PySpark, and AWS, along with solid understanding of data modelling and transformation frameworks.
Key Responsibilities
· Design, develop, and optimize scalable data pipelines and ETL workflows.
· Build and manage data models using DBT and integrate datasets for analytics and reporting.
· Work with Snowflake to write efficient SQL queries and manage data warehousing activities.
· Develop distributed data processing solutions using PySpark on Databricks.
· Implement data ingestion frameworks using Python, APIs, and AWS services.
· Collaborate with cross-functional teams to understand data requirements and deliver solutions.
· Ensure data quality, reliability, and performance across pipelines.
· Deploy and maintain data workflows using CI/CD and version control best practices.
Mandatory Skills
· Minimum 2 years of hands-on experience in:
o SQL (Snowflake)
o DBT
o PySpark (Databricks)
o Python with strong understanding of OOP concepts
o AWS services: S3, ECS, SQS, Lambda, EMR
· Experience with file formats: CSV, JSON, Parquet
· Experience with API integrations using Python
· Strong communication skills
Secondary / Good-to-Have Skills
· Experience with Sigma or Tableau for data visualization
· Linux CLI proficiency
· Python web scraping experience
· Exposure to Datadog for monitoring
· Experience with GitHub for version control and CI/CD
· Knowledge of Terraform
· Computer Science degree from a reputed academic institution