Data Engineer - PySpark/Python

What Youll Drive

As a Data Engineer (Drive), you will be responsible for :

- Lead the design, build, and continuous maintenance of robust batch and real-time data pipelines.

- You'll be the force behind ensuring data flows efficiently and reliably across our systems.

- Take charge of maintaining and optimizing our data infrastructure.

- Be the primary point of contact and collaborator for our data scientists and data analysts.

- You will proactively work to understand their evolving data needs and drive solutions that ensure the highest level of data availability, quality, and integrity for their analytical models and reports.

- Champion data governance, quality assurance, and documentation practices, ensuring our data assets are well-managed and reliable.

- Continuously explore new tools, technologies, and methodologies in the data engineering space to recommend and drive improvements to our existing architecture and processes.

What You Bring to the Drive :

- 4 to 9 years of hands-on experience as a Data Engineer, with at least 5 years specifically demonstrating leadership and ownership in a complex data ecosystem.

- Proven strength in data engineering using Python and PySpark for complex data manipulation and processing.

- Strong expertise in SQL, capable of writing and optimizing complex queries.

- Hands-on experience with cloud data platforms, specifically Databricks.

- Proficient with code management tools such as Git and GitHub, adhering to strong version control

practices.

- Extensive experience working effectively in an Agile development environment, contributing to sprint cycles and adapting to evolving requirements.

- A highly analytical and proactive problem-solver, with meticulous attention to detail and a drive to find efficient solutions.

Location : Bengaluru, Karnataka, India