Data Engineer - AWS, Glue & PySpark

Job Summary :

We are looking for a skilled Data Engineer with strong experience in AWS and PySpark to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate should have hands-on experience in data engineering, data transformation, and cloud-based data processing. Knowledge of Apache Flink, AWS Glue, and Python will be an added advantage.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines using AWS and PySpark.

- Build and optimize ETL/ELT processes for data ingestion, transformation, and processing.

- Work with large datasets and implement efficient data processing solutions using PySpark.

- Develop and maintain data workflows and ensure data quality, accuracy, and reliability.

- Leverage AWS services to build and manage cloud-based data engineering solutions.

- Troubleshoot and optimize data pipelines to improve performance and scalability.

- Collaborate with cross-functional teams to understand business requirements and deliver effective data solutions.

- Implement best practices for data security, monitoring, and pipeline performance.

Required Skills :

- Strong hands-on experience in Data Engineering.

- Good experience with AWS cloud services.

- Strong expertise in PySpark for large-scale data processing and transformation.

- Experience in developing and maintaining ETL/ELT pipelines.

- Understanding of data warehousing, data modelling, and distributed data processing concepts.

- Strong problem-solving and analytical skills.

Experience : 6 - 8 Yrs

Notice : Immediate to 15 Days