RSquareSoft Technologies - Senior Data Engineer - Python/PySpark

Description :

Job Title : Senior Data Engineer (Hands-on Technical Lead)

Location : Pune (Wakad) - 5 Days Work from Office

Experience : 6-10 Years

Role Overview :

We are looking for a highly hands-on Senior Data Engineer who will act as a technical lead for the data engineering team. This role is focused on day-to-day development, owning complex data pipelines, and setting strong technical standards, while also mentoring junior engineers. This is not a people-management role; the expectation is deep involvement in coding and solution design.

Key Responsibilities :

- Design, build, and maintain scalable and reliable data pipelines using Python and PySpark.

- Lead hands-on development on Databricks, including job orchestration, performance tuning, and cost optimization.

- Work extensively with AWS services for data ingestion, storage, and processing.

- Write, optimize, and review complex SQL queries for large-scale analytical workloads.

- Own end-to-end delivery of data engineering features, from requirement understanding to production rollout.

- Perform thorough code reviews and enforce best practices across the team.

- Mentor team members on data engineering concepts, performance optimization, and production readiness.

- Troubleshoot and resolve complex data, performance, and scalability issues in production environments.

- Collaborate closely with analytics, product, and downstream consumers to deliver high-quality data solutions.

Required Skills :

- Strong hands-on experience with Python, PySpark, and Databricks in production environments.

- Solid practical experience with AWS (e.g., S3, IAM, EC2, Glue, EMR or equivalent).

- Strong SQL skills, including query optimization and handling large datasets.

- Proven experience building and operating large-scale ETL/ELT pipelines.

- Ability to work independently and take ownership of complex technical problems.

Good to Have :

- Experience in the financial services / capital markets / trade surveillance domain.

- Exposure to data quality checks, data validation frameworks, and production monitoring.

- Experience with Delta Lake or similar transactional data storage layers.

What We Offer :

- A hands-on, technically challenging role with real ownership of data platforms.

- Opportunity to shape technical direction while remaining deeply involved in coding.