Data Engineer - Python/AWS

Required Skills :

- AWS Glue, Amazon EMR, Amazon Redshift, Pyspark, Python, SQL

Cloud and AWS Expertise :

- In-depth knowledge of AWS services related to data engineering : EC2, S3, RDS, DynamoDB, Redshift, Glue, Lambda, Step Functions, Kinesis, Iceberg, EMR, and Athena.

- Strong understanding of cloud architecture and best practices for high availability and fault tolerance.

Data Engineering Concepts :

- Expertise in ETL/ELT processes, data modeling, and data warehousing.

- Knowledge of data lakes, data warehouses, and big data processing frameworks like Apache Hadoop and Spark.

- Proficiency in handling structured and unstructured data.

Programming and Scripting :

- Proficiency in Python, Pyspark and SQL for data manipulation and pipeline development.

- Expertise in working with data warehousing solutions like Redshift.