Job Description :

Location - Hyderabad & Bangalore.

Hybrid Work Mode.

Should be available for Face To Face interview.

We are looking for someone only who is serving notice period and can join by mid of July.

We are looking for an experienced Senior Data Engineer with 7+ years of hands-on experience in designing, developing, and maintaining scalable data pipelines and big data solutions. The ideal candidate will have strong expertise in Python, PySpark, Apache Spark, and SQL, along with extensive experience processing and optimizing large-scale datasets.

The candidate should be passionate about building robust data platforms, improving data quality, and delivering high-performance data solutions that support business and analytics requirements.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL processes.

- Build and optimize data processing frameworks using Python, PySpark, and Apache Spark.

- Develop efficient data models and data integration solutions for large-scale datasets.

- Write complex SQL queries and optimize database performance.

- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.

- Ensure data quality, reliability, and governance across data platforms.

- Monitor, troubleshoot, and resolve data pipeline and processing issues.

- Implement best practices for data engineering, performance tuning, and code quality.

- Work closely with cross-functional teams in an Agile development environment.

Mandatory Skills :

Data Engineering :

- 7+ years of experience in Data Engineering or Big Data Development.

- Strong hands-on experience in designing and building data pipelines.

- Extensive experience with ETL development and large-scale data processing.

Programming & Big Data Technologies :

- Strong proficiency in Python.

- Hands-on experience with Apache Spark and/or PySpark.

- Advanced SQL expertise, including query optimization and performance tuning.

- Experience processing and managing large datasets in distributed environments.

Operating Systems :

- Strong working knowledge of Linux/Unix environments.

Preferred Skills :

- Experience with cloud platforms such as :

1. Amazon Web Services (AWS)

2. Microsoft Azure

3. Google Cloud Platform (GCP)

- Experience with workflow orchestration tools such as Apache Airflow.

- Familiarity with modern data lake and data warehouse architectures.

- Exposure to Agile development methodologies.

Desired Candidate Profile :

- Strong analytical and problem-solving skills.

- Excellent communication and stakeholder management abilities.

- Ability to work independently and collaboratively within cross-functional teams.

- Proven experience delivering scalable and high-performance data solutions.

- Strong focus on quality, reliability, and continuous improvement.

Educational Qualification :

- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

Additional Requirements :

- Must be currently serving notice period.

- Must be able to join by mid-July.

- Must be willing to attend an in-person interview.

- Open to working in a hybrid model from Hyderabad or Bangalore.