HamburgerMenu
hirist

Senior Data Engineer - AWS/Databricks/Python

VOPAIS
Multiple Locations
5 - 7 Years

Posted on: 01/12/2025

Job Description

Vopais invites applications for a Senior Data Engineer role. We are searching for talent with proven experience (5+ years) in designing and managing advanced data lake and analytic solutions using AWS, Databricks, and Python.

Responsibilities :

- Design, develop & maintain scalable AWS data lakes/pipelines with Databricks

- Integrate, transform, and centralize large-scale data from varied sources

- Implement/manage Delta Lake architecture (Databricks Delta or Apache Hudi)

- Build end-to-end data workflows with PySpark, Databricks Notebooks, Python

- Develop data warehouses/marts (Snowflake, Redshift, etc.)

- Optimize data storage, queries, and cost across Databricks/AWS

- Build CI/CD for Databricks/Python, maintain version control (Git)

- Collaborate with cross-functional teams for high-performance data solutions

- Drive technical/architectural decisions, troubleshoot clusters & ETL jobs

Core Skills & Requirements :

- 5+ years building/managing AWS Data Lake Architectures

- 3+ years with AWS services (S3, Glue, Redshift, etc.)

- 3+ years with Databricks, Delta Lake, PySpark, ETL

- Hands-on with Python, data automation, API integration

- CI/CD, Git best practices (Terraform/CloudFormation a plus)

- Bachelor's in Computer Science, IT, Data Science, or related

- Experience in Agile environments

- Strong SQL, RDBMS, data modeling, governance (Unity Catalog/DLT/MLflow a plus)

- AWS/Databricks certifications, security/compliance knowledge are valued

Why Join Vopais?

Be part of a future-driven analytics team, solve complex business problems, and fuel growth through data! Your expertise will directly impact our next phase of innovation.

info-icon

Did you find something suspicious?