Posted on: 01/12/2025
Vopais invites applications for a Senior Data Engineer role. We are searching for talent with proven experience (5+ years) in designing and managing advanced data lake and analytic solutions using AWS, Databricks, and Python.
Responsibilities :
- Design, develop & maintain scalable AWS data lakes/pipelines with Databricks
- Integrate, transform, and centralize large-scale data from varied sources
- Implement/manage Delta Lake architecture (Databricks Delta or Apache Hudi)
- Build end-to-end data workflows with PySpark, Databricks Notebooks, Python
- Develop data warehouses/marts (Snowflake, Redshift, etc.)
- Optimize data storage, queries, and cost across Databricks/AWS
- Build CI/CD for Databricks/Python, maintain version control (Git)
- Collaborate with cross-functional teams for high-performance data solutions
- Drive technical/architectural decisions, troubleshoot clusters & ETL jobs
Core Skills & Requirements :
- 5+ years building/managing AWS Data Lake Architectures
- 3+ years with AWS services (S3, Glue, Redshift, etc.)
- 3+ years with Databricks, Delta Lake, PySpark, ETL
- Hands-on with Python, data automation, API integration
- CI/CD, Git best practices (Terraform/CloudFormation a plus)
- Bachelor's in Computer Science, IT, Data Science, or related
- Experience in Agile environments
- Strong SQL, RDBMS, data modeling, governance (Unity Catalog/DLT/MLflow a plus)
- AWS/Databricks certifications, security/compliance knowledge are valued
Why Join Vopais?
Be part of a future-driven analytics team, solve complex business problems, and fuel growth through data! Your expertise will directly impact our next phase of innovation.
Did you find something suspicious?
Posted By
Posted in
Data Engineering
Functional Area
Data Engineering
Job Code
1583152
Interview Questions for you
View All