Description :

We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain scalable data pipelines and modern data platforms that support analytics, business intelligence, and AI/ML initiatives.

The ideal candidate will have strong expertise in big data technologies, cloud data ecosystems, ETL/ELT processes, and distributed data processing frameworks.

This role requires close collaboration with data scientists, analysts, product teams, and business stakeholders to enable reliable, high-quality, and efficient data solutions across the organization.

Key Responsibilities :

- Design, build, and maintain scalable ETL/ELT pipelines for structured and unstructured data processing.

- Develop and optimize data architectures, data lakes, and data warehouse solutions.

- Build robust batch and real-time data processing systems.

- Integrate data from multiple internal and external sources while ensuring data quality and consistency.

- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.

- Work with cloud-based data platforms such as AWS, Azure, or GCP.

- Implement data governance, security, monitoring, and compliance best practices.

- Collaborate with data scientists and analysts to support reporting, analytics, and machine learning use cases.

- Troubleshoot production data issues and perform root cause analysis.

- Automate workflows, scheduling, and orchestration using modern data engineering tools.

- Maintain technical documentation and data lineage standards.

- Mentor junior engineers and contribute to engineering best practices.

Required Skills & Qualifications :

Technical Skills :

- Strong experience with SQL and database technologies

- Hands-on expertise in Python, Scala, or Java

- Experience with ETL/ELT tools and frameworks

- Strong knowledge of big data technologies such as Spark, Hadoop, or Kafka

- Experience with cloud data services on AWS, Azure, or GCP

- Familiarity with data warehouses such as Snowflake, Redshift, BigQuery, or Synapse

- Experience with workflow orchestration tools like Airflow or Prefect

- Knowledge of data modeling, schema design, and data governance

- Experience with REST APIs and data integration techniques

- Familiarity with containerization and CI/CD practices is preferred