Icertis - Senior Software Engineer - Data Engineering

Job Summary :

We are looking for a highly skilled Senior Software Engineer Data Engineering to design, build, and maintain scalable data platforms and pipelines that support business intelligence, analytics, and data-driven applications. The ideal candidate will have strong expertise in data engineering, software development, cloud technologies, and distributed data processing.

Key Responsibilities :

- Design, develop, and maintain scalable ETL/ELT data pipelines for structured and unstructured data.

- Build reliable and high-performance data processing solutions using Python, SQL, Spark, or similar technologies.

- Develop and maintain data platforms, data warehouses, and data lakes on cloud environments such as AWS, Azure, or GCP.

- Integrate data from multiple sources including APIs, databases, applications, and third-party systems.

- Ensure data quality, accuracy, availability, security, and governance across data pipelines.

- Optimize data processing jobs and pipelines for performance, scalability, and cost efficiency.

- Collaborate with Data Scientists, Analysts, Product Managers, and Software Engineers to deliver high-quality data solutions.

- Implement monitoring, logging, testing, and alerting mechanisms for production data pipelines.

- Contribute to architecture decisions, technical design, coding standards, and engineering best practices.

- Participate in code reviews and mentor junior engineers while promoting a strong engineering culture.

- Troubleshoot complex production issues and ensure timely resolution of data-related incidents.

- Stay updated with emerging technologies in cloud data engineering, AI/ML platforms, data architecture, and distributed computing.

Required Skills & Qualifications :

- Bachelors degree in Computer Science, Engineering, Information Technology, or a related field.

- 5 - 8 years of experience in software engineering/data engineering.

- Strong proficiency in Python and SQL.

- Hands-on experience with Apache Spark, Kafka, Airflow, or similar data engineering technologies.

- Strong understanding of data warehousing, data lakes, ETL/ELT, and distributed systems.

- Experience with cloud platforms such as AWS, Azure, or GCP.

- Good understanding of relational and NoSQL databases.

- Experience with Git, CI/CD, Docker, and modern software development practices.

- Strong problem-solving, communication, and analytical skills.