Senior Big Data Engineer - Python/Spark

Description :

Job Title : Senior Big Data Engineer Python & Spark

F2F drive for Big Data + Python + spark.

NP : Immediate to 30 days

Job Location : Chennai/ Bangalore

Drive Location : Chennai

Exp :4 to 12 years

JD :

Skill : Python Spark Developer

Primary Skills : Python, Spark, SQL, Unix Shell Scripting, Airflow or Control M ( Highlighted in red are mandate)

Exp : 4 - 12 Yrs

Location : Tech M Office Chennai Sholinganallur

Work Mode : Hybrid 12 Days a month

Job Description :

- Through and hands on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code.

Well versed with :

- Very good proficiency in Python and Spark programming.

- Pandas : Experience with data manipulation and analysis using Pandas.

- Implementation experience of Spark Core, Spark SQL and Spark Streaming

- Working with Spark in combination Hadoop Ecosystem

- Design and implementation of low-latency, high-availability, and performance applications.

- Should lead and guide a team of junior Python developers.

- As Sr Python Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process.

- Performance tuning, improvement, balancing, usability, and automation.

- Collaborate with other team members and stakeholders.

Educational Qualification :

- Proficiency in Python programming.

- Experience with Pandas for data manipulation and analysis.

- Knowledge of Polars for efficient data processing.

- Strong problem-solving skills and attention to detail.

- Ability to work collaboratively in a team environment