Job Description
Job Description
JOB DETAILS:
\nPosition - DATA ENGINEER
\nRelevant Experience - 4 to 7 years
\nLocation Option – Pune / Gurgaon / Bangalore
\nSkills:
\n- \n
- Hands on experience on Data bricks, AWS Serverless stack (APIGW, Lambda, S3, Glue) \n
- RDS,SQL, PostgtreSQL \n
- Python \n
- Working knowledge of APIs \n
- Exposure to working with AI Agents \n
- Data products \n
SQL – Must Have
\n1. Window functions (ROW_NUMBER, RANK, LEAD, LAG).
\n2. joins and query optimization.
\nJD:
\nSpecialized in building scalable pipelines using GitHub, optimizing ETL workflows using native Databricks capabilities and Amazon web services
\n- Build and maintain API integrations
\n- Develop SFTP pipelines and automated file ingestion
\n- Create error handling, notifications, and monitoring workflows
\n- Implement low-complexity ingestions (e.g., file drops, partner data shares)
\n- Maintain scripts and GitHub repositories
\n- Test pipelines and Document flows