Python Lead - PySpark/ETL

Description :

Python Lead

Location : Hyderabad

Experience : 13+ Years

Must-Have :

- Experience with Python(Lead Level) and PySpark + ETL

Key Responsibilities :

- Lead the design, development, and optimization of Python- and PySpark-based data pipelines and ETL workflows.

- Collaborate with data scientists and analysts to gather requirements and ensure data accuracy, quality, and consistency.

- Build scalable and high-performance data solutions to support analytics and business operations.

- Monitor data pipeline performance, identify bottlenecks, and troubleshoot issues proactively.

- Drive architecture improvements and contribute to long-term data platform strategy.

- Ensure compliance with data governance, security, and regulatory standards.

- Prepare and maintain clear technical documentation for all data processes and systems.

- Mentor, guide, and lead the data engineering team to deliver high-quality outcomes.

Required Skills & Qualifications :

- Minimum 8+ years of hands-on experience in Python, with strong expertise in writing optimized and modular code.

- Strong experience with PySpark, distributed processing, and big data technologies.

- Proven experience leading engineering teams and delivering complex technical projects.

- Strong understanding of ETL development, data modeling, and pipeline orchestration.

- Experience with cloud platforms (AWS/Azure/GCP) is a plus.

- Excellent problem-solving skills and ability to work in a fast-paced environment.

- Strong communication and documentation skills.