Big Data Developer - Python/Scala

Job Title : Big Data Developer (Python/PySpark/Scala)

Experience : 5 - 9 Years

Location : Hyderabad

Work Mode : Hybrid 3 days work from office

Job Overview :

We are looking for an experienced Big Data Developer to design, build, and optimize large-scale data processing solutions. The role involves working with modern big data frameworks to enable high-performance analytics and data-driven decision-making.

Key Responsibilities :

- Design, develop, and maintain scalable big data pipelines using PySpark / Spark / Scala

- Process large volumes of structured and unstructured data efficiently

- Build and optimize ETL/ELT workflows for batch and real-time data processing

- Work closely with data engineers, analysts, and business teams to deliver data solutions

- Optimize performance, scalability, and reliability of data platforms

- Write clean, maintainable, and well-documented code

- Participate in code reviews and contribute to architecture discussions

Required Skills & Qualifications :

- 5 - 9 years of experience in Big Data development

- Strong hands-on experience with Python (PySpark) or Scala

- Solid understanding of Apache Spark and distributed data processing

- Experience working with large datasets and data transformation pipelines

- Good understanding of data structures, algorithms, and performance tuning

- Familiarity with SQL and data warehousing concepts

- Experience working in agile development environments

Good to Have :

- Exposure to Kafka, Airflow, or other data orchestration tools

- Experience with cloud platforms (AWS / Azure / GCP)

- Knowledge of Hive, HDFS, Delta Lake, or similar big data technologies

- Understanding of real-time streaming architectures