Description :

Qualifications & Skills :

- University or advanced degree in engineering, computer science, mathematics, or a related field

- 10+ years' experience developing and deploying data pipelines both batch and streaming into production.

- Strong experience working with a variety of relational SQL and NoSQL databases.

- Extensive experience with the cloud-native data services of Google Cloud Platform (BigQuery, Vertex AI, Pub/Sub, Cloud Functions, etc.). (Mandatory exp)

- Deep expertise in one of the popular data warehousing tools such as Snowflake, Big Query, RedShift, etc

- Hands-on experience with dbt (Data Build Tool) for data transformation (mandatory)

- Experience working with big data tools and frameworks such as Hadoop, Spark, Kafka, etc. Familiarity with Databricks is a plus.

- Experience with object-oriented/object function scripting languages : Python, Java, C++, Scala, etc.

- Hands-on experience in the Data engineering Spectrum, e.g. developing metadata-based framework-based solutions for Ingestion, Processing, etc., building Data Lake/Lake House solutions.

- Strong knowledge of Apache Airflow for orchestration and workflow management.

- Working knowledge of Github /Git Toolkit.

- Experience with providing operational support to stakeholders.

- Expertise in standard software engineering methodology, e.g. unit testing, test automation, continuous integration, code reviews, design documentation.

- Experience working with CI/CD pipelines using Jenkins and Github Actions.

- Experience with data visualization using Tableau, PowerBI, Looker or similar tools is a plus