Description :

We are looking for a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines and platforms that power analytics, machine learning, and business intelligence initiatives.

You will work with cross-functional teams to ensure the timely ingestion, transformation, and delivery of high-quality data for operational and analytical use cases.

This role requires expertise in modern data engineering technologies, cloud platforms, and strong problem-solving skills to architect robust, efficient, and maintainable data solutions.

Key Responsibilities :

- Design, build, and maintain ETL/ELT pipelines for structured and unstructured data.

- Develop scalable data ingestion workflows from multiple sources (databases, APIs, streaming platforms).

- Implement data transformation, enrichment, and aggregation for analytics and ML models.

- Ensure data quality, integrity, and consistency across pipelines and systems.

- Design data models, schemas, and data warehouses/lakes for analytical and operational use cases.

- Implement dimensional modeling, star/snowflake schemas, and normalization best practices.

- Optimize data storage and query performance for large-scale datasets.

- Maintain metadata, lineage, and documentation for all data assets.

- Build and manage pipelines on cloud platforms : AWS, GCP, or Azure.

- Work with big data ecosystems : Spark, Hadoop, Kafka, Databricks, Snowflake, Redshift, BigQuery.

- Implement real-time/streaming data pipelines using tools like Kafka, Kinesis, or Pub/Sub.

- Collaborate with DevOps to implement CI/CD for data pipelines and automated deployments.

- Ensure data pipelines comply with data governance, security, and privacy policies.

- Implement role-based access control, encryption, and auditing for sensitive datasets.

- Support regulatory and compliance requirements (GDPR, HIPAA, CCPA).

- Work with data scientists, analysts, product managers, and engineers to understand data requirements.

- Mentor junior data engineers and promote best practices in coding, testing, and pipeline management.

- Participate in architecture reviews, design discussions, and technical roadmap planning.

Required Qualifications :

- 7- 10 years of experience in data engineering or related roles.

- Strong programming skills in Python, Java, or Scala.

- Expertise in SQL and relational databases (PostgreSQL, MySQL, SQL Server).

- Experience with ETL/ELT frameworks (Airflow, dbt, Talend, Informatica).

- Hands-on experience with cloud data platforms (AWS Redshift, GCP BigQuery, Azure Synapse, Snowflake).

- Familiarity with big data technologies : Spark, Hadoop, Kafka, Flink.

- Knowledge of data modeling, warehousing, and pipeline orchestration.

- Strong problem-solving, debugging, and performance tuning skills