Data Engineer - Python/PySpark

Job Title : Data Engineer

Job Summary :

We are seeking an experienced and highly skilled Data Engineer to join our data team. The ideal candidate will have strong programming skills in Python and PySpark, hands-on experience with cloud platforms (Azure, AWS, GCP), and proficiency with data integration tools like Snowflake, Databricks, and Informatica. Knowledge of reporting and visualization tools such as Power BI, Tableau, Spotfire, Alteryx, and MicroStrategy is highly desirable.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines using Python and PySpark.

- Build and optimize data architectures on cloud platforms (Azure, AWS, or GCP).

- Develop ETL/ELT workflows using tools like Informatica, Databricks, and Snowflake.

- Collaborate with data analysts, data scientists, and business users to deliver clean, accurate, and timely data.

- Ensure data quality, governance, and compliance throughout the data lifecycle.

- Support reporting and dashboarding efforts using Power BI, Tableau, Spotfire, Alteryx, and MicroStrategy.

- Monitor and troubleshoot data workflows and performance issues.

- Document technical designs, architectures, and solutions.

Required Qualifications :

- Bachelors or Masters degree in Computer Science, Information Systems, Engineering, or related field.

- 3+ years of hands-on experience in data engineering.

- Proficient in Python and PySpark for data manipulation and transformation.

- Strong experience with cloud services : Azure, AWS, or GCP.

- Proven track record working with Snowflake, Databricks, and Informatica.

- Experience with reporting/BI tools : Power BI, Tableau, Spotfire, Alteryx, and MicroStrategy.

- Familiarity with data modeling, data warehousing, and performance tuning.

- Strong understanding of data security and privacy principles.