Senior Data Engineer - Azure Databricks

Description :

Job Title : AWS Databricks + Mongo DB

Location : Mumbai/Pune/Bangalore/Hyderabad/Chennai/ Kolkata/ Noida

Experience : 8-12 Years

Notice Period : Immediate to 30 days

Job Description :

We are looking for a highly skilled Senior Data Engineer to design, develop, and maintain scalable data engineering solutions. The ideal candidate will have strong experience in building robust data pipelines, working with big data technologies, and collaborating with cross-functional teams to deliver high-quality data solutions.

Key Responsibilities :

- Design, develop, and maintain scalable and reliable data pipelines

- Understand business requirements and translate them into ETL solutions

- Build and optimize Spark / PySpark jobs for large-scale data processing

- Write complex transformations using Spark SQL

- Develop reusable, modular, and maintainable code

- Perform unit testing and ensure data quality and accuracy

- Work with both relational and NoSQL databases

- Deploy and manage data solutions using cloud and DevOps tools

- Monitor, troubleshoot, and optimize data pipelines

- Collaborate with stakeholders, data analysts, and engineering teams

- Automate manual processes wherever possible

Required Skills & Qualifications :

- Strong experience in Data Engineering

- Hands-on experience with Apache Spark, PySpark, and Spark SQL

- Proficiency in Python (Data Engineering use cases)

- Experience with Databricks

- Good understanding of ETL concepts and data modeling

- Experience working with relational databases (Oracle, SQL Server, etc.)

- Experience with NoSQL databases (MongoDB or similar)

- Familiarity with cloud platforms (AWS preferred)

- Experience with Docker and Kubernetes is a plus

- Knowledge of DevOps practices

- Strong problem-solving and debugging skills

- Good communication and collaboration skills