Description :

We are seeking an experienced Data Engineer with 4 to 5 years of experience, and at least 3+ years of expertise in designing and implementing data solutions using the Databricks platform.

The ideal candidate will have a solid background in distributed computing, big data technologies, and cloud platforms.

Key Responsibilities :

- Design, implement, and maintain scalable data solutions using Databricks.

- Work with programming languages such as Python, SQL, or Scala.

- Collaborate with cross-functional teams to deliver data-driven solutions.

- Optimize and manage data pipelines using Apache Spark and cloud services (AWS, Azure, or GCP).

- Leverage DevOps practices to automate deployments and monitor data pipelines.

Key Skills :

- Proficiency in Python, SQL, or Scala.

- Hands-on experience with Databricks and Apache Spark.

- Strong knowledge of cloud platforms like AWS, Azure, or GCP.

- Good understanding of distributed computing and big data technologies.

- Familiarity with containerization (Docker, Kubernetes) and DevOps practices.

Good to Have :

- Experience with containerization technologies (Docker, Kubernetes).

- Knowledge of automated deployment and monitoring for data pipelines.

Qualifications :