e-Zest Solutions - Senior Data Engineer - Python/PySpark

Description :

Role & Responsibilities :

- Design, develop, and optimize scalable ETL/ELT pipelines

- Build reusable data frameworks using Databricks, PySpark, Python, and SQL

- Integrate multiple source systems with high data throughput

- Perform advanced code optimization and performance tuning

- Ensure data quality, governance, and reliability

- Mentor junior engineers and guide technical delivery

- Participate in solution discussions, estimations, and planning

- Maintain detailed technical and operational documentation

- Provide production support and release management support

Mandatory Skills :

Strong hands-on experience with :

- Databricks

- PySpark

- Python

- SQL

- Git

- Experience working on multiple integration systems

- Proven expertise in performance tuning and optimization

- Experience delivering multiple end-to-end data engineering projects

- 5- 8 years of relevant experience

Good to Have :

- Strong knowledge of data modelling (dimensional modelling, schema design)

- Experience with Power BI or reporting tools

- Exposure to cloud platforms (AWS, Azure, or GCP)

- Understanding of CI/CD pipelines

- Experience with Delta Live Tables (DLT)