About the Role :

We are looking for a highly skilled Senior Data Engineer to design, develop, and optimize scalable data pipelines and data infrastructure.

The ideal candidate will have strong expertise in big data technologies, cloud platforms, ETL frameworks, and data warehousing solutions.

You will work closely with data scientists, analysts, and business teams to enable data-driven decision-making across the organization.

Key Responsibilities :

- Design, build, and maintain scalable ETL/ELT pipelines for structured and unstructured data.

- Develop and optimize data architectures, data lakes, and data warehouses.

- Build robust batch and real-time data processing systems.

- Ensure data quality, integrity, governance, and security across platforms.

- Collaborate with cross-functional teams including Data Science, Product, Analytics, and Engineering.

- Optimize database performance, query tuning, and data storage solutions.

- Implement monitoring, logging, and troubleshooting mechanisms for data pipelines.

- Work on cloud-based data platforms and distributed computing frameworks.

- Automate data workflows and deployment processes using CI/CD practices.

- Mentor junior engineers and contribute to best engineering practices and architecture discussions.

Required Skills & Qualifications :

Technical Skills :

- Strong proficiency in SQL and Python/Scala/Java.

- Experience with ETL tools and frameworks.

- Hands-on experience with :

1. Apache Spark

2. Hadoop Ecosystem

3. Kafka

4. Airflow

5. dbt

- Strong knowledge of data warehousing concepts and dimensional modeling.

Experience with cloud platforms such as :

- Amazon Web Services (AWS)

- Google Cloud (GCP)

- Microsoft (Azure)

- Experience with databases such as Snowflake, Redshift, BigQuery, PostgreSQL, or MongoDB.

- Familiarity with Docker, Kubernetes, and CI/CD pipelines is preferred