Role Overview:

As a Senior / Lead Data Engineer, you will serve as a technical anchor for our data platform initiatives, architecting scalable solutions that handle high-volume data ingestion and transformation. You will work closely with cross-functional teams, including data scientists, product managers, and infrastructure engineers, to build robust pipelines that power business-critical analytics. Your contribution will directly influence the reliability and performance of our data products, ensuring that stakeholders have seamless access to high-quality, governed data to support their strategic objectives in a fully remote environment.

Required Qualifications:

- Strong hands-on Data Engineering experience.

- Expert-level experience with Databricks.

- Strong hands-on experience with Databricks Unity Catalog.

- Strong experience designing Medallion Architecture (Bronze/Silver/Gold) data pipelines.

- Advanced Python/PySpark and SQL skills.

- Strong experience with AWS, particularly S3 and AWS Glue.

- Hands-on experience with Databricks Asset Bundles (DABs).

- Strong Git experience with GitHub Enterprise and GitHub Actions.

- Experience implementing CI/CD for data engineering and Databricks workloads.

- Strong understanding of data engineering best practices, data modeling, and pipeline optimization.

- Experience working in Agile/Scrum development environments.

Ideal Candidate:

The ideal candidate is a senior-level, hands-on Databricks Data Engineer. They should be comfortable writing code, building pipelines, troubleshooting production issues, implementing CI/CD, and working directly in Databricks and AWS on a daily basis.