Calsoft - Senior Data Engineer - ETL/Python

Job Title : Senior Data Engineer

Experience : 6 - 7 Years

Location :

- Pune - P2

Role Summary :

We are looking for a skilled Senior Data Engineer with 6-7 years of experience to design, build, and maintain scalable data infrastructure. The role involves developing robust ETL/ELT pipelines, enabling real-time data processing, and integrating data from diverse sources. You will collaborate closely with cross-functional teams to modernize data platforms, implement best practices, and deliver high-performance data solutions on cloud environments.

Mandatory Skill Set :

- Data Engineering

- Python

- ETL / ELT Pipelines

- Data Integration

- Cloud Platforms : AWS / Azure / GCP

Key Responsibilities :

- Build and optimize ETL/ELT workflows for batch and real-time processing

- Integrate structured and unstructured data from multiple data sources

- Enable real-time data ingestion and streaming solutions

- Collaborate with application, analytics, and data science teams

- Ensure scalability, reliability, and performance of data platforms

- Establish and follow data engineering best practices and standards

Must-Have Skills :

- Proficiency in Python (Java/Scala is a plus)

- Hands-on experience with ETL/ELT pipelines and data integration frameworks

- Strong knowledge of distributed computing and real-time data processing/streaming frameworks

- Experience working with cloud data platforms (AWS, Azure, or GCP)

- Ability to parse unstructured log data and normalize heterogeneous data sources

Good-to-Have Skills :

- Experience with POC development and prototype-to-production workflows

- Exposure to mentoring junior engineers and contributing to architectural decisions

- Experience in technical strategy planning and solution design

- Understanding of ML/AI data workflows and collaboration with data science teams