AWS Data Engineer - ETL/Data Pipeline

AWS Data Engineer

Location : Pune

Min years of experience : 7 Years

Budget : 35 LPA

Job Description :

- Collaborate and partner with Business Analyst teams located in US and EMEA regions.

- Interface across our Business Analyst and Data Science teams.

- Play a key role in integrating new data sources into our data & analytical ecosystem over AWS cloud

- Implement data lake solutions while addressing common data concerns, such as data quality, data governance

- Set the standard for technical excellence as we move / build our data ecosystem into the cloud

- understanding their common data problems and deliver scalable solutions

Responsibilities and Duties :

- Expert in programming languages, preferably Python.

- Expert in delivering end-to-end analytic solutions using AWS services (EMR, Airflow, S3, Athena, Kinesis, Redshift).

- Experience in batch technologies like Hadoop, Hive, Athena, Presto.

- Strong SQL skills, including query optimization, schema design, complex analytics.

- Expert in data modeling and metadata management like Glue Catalog etc.

- Experience in deployment tools like GitHub actions, Jenkins, AWS Code Pipeline etc.

- Experience in data quality tools like Deque or Great Expectations is Nice To Have