Job Title : PySpark Developer

Experience : 5+ Years

Location : Bangalore / Pune / Chennai

Employment Type : Full-Time, Permanent

Industry : IT Services & Consulting

Department : Engineering Software & QA

About the Role :

We are seeking a highly skilled PySpark Developer with 5+ years of experience in building and optimizing large-scale data processing solutions. The ideal candidate will have strong expertise in PySpark, Python, SQL, and Big Data technologies, with hands-on experience in developing scalable data pipelines and transforming complex datasets into actionable insights.

Key Responsibilities :

- Design, develop, and maintain scalable data processing applications using PySpark.

- Build and optimize ETL/ELT pipelines for processing large volumes of structured and unstructured data.

- Develop efficient data transformation, cleansing, and validation processes.

- Collaborate with data engineers, analysts, and business stakeholders to gather and understand data requirements.

- Optimize Spark jobs for performance, scalability, and reliability.

- Work with distributed computing environments and big data ecosystems.

- Perform data analysis, troubleshooting, and debugging of production issues.

- Ensure data quality, integrity, and consistency across data platforms.

- Participate in code reviews, testing, deployment, and documentation activities.

- Follow best practices for software development, data engineering, and cloud-based solutions.

Required Skills & Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

- 5+ years of experience in Data Engineering or PySpark development.

- Strong hands-on experience with PySpark and Python.

- Proficiency in SQL and database concepts.

- Experience working with large-scale distributed data processing frameworks.

- Strong understanding of data warehousing, ETL processes, and data modeling.

- Experience with Hadoop ecosystem components and Big Data technologies.

- Familiarity with version control systems such as Git.

- Strong problem-solving, analytical, and communication skills.

Preferred Skills :

- Experience with cloud platforms such as AWS, Azure, or GCP.

- Knowledge of workflow orchestration tools like Airflow.

- Exposure to Spark optimization techniques and performance tuning.

- Understanding of CI/CD pipelines and Agile development methodologies.

- Experience with data lakes and modern data architectures.

What We Offer :

- Opportunity to work on enterprise-scale data engineering projects.

- Exposure to cutting-edge Big Data and cloud technologies.

- Collaborative and growth-oriented work environment.

- Continuous learning and career advancement opportunities.

Role : PySpark Developer

Experience : 5+ Years

Locations : Bangalore, Pune, Hyderabad, Bhubaneswar, Chennai, Kochi

Employment Type : Full-Time, Permanent