Posted on: 02/11/2026
About the Opportunity:
We are looking for experienced Big Data Engineers and Databricks professionals who can design, develop, and optimize scalable data engineering solutions using modern Big Data technologies and cloud platforms.
The ideal candidate should have strong hands-on experience with Apache Spark, Python, and Databricks, along with practical exposure to Azure or AWS cloud environments. You will work on large-scale data processing systems, building reliable data pipelines and contributing to high-performance data platforms.
Key Responsibilities:
- Design, develop, and maintain scalable Big Data processing solutions using Apache Spark, Python, and Databricks.
- Build and optimize data pipelines for processing structured and unstructured datasets.
- Work with distributed computing frameworks to handle large-scale data processing requirements.
- Develop data ingestion and transformation workflows from relational databases, ERP systems, files, and other data sources.
- Optimize Spark jobs, troubleshoot performance bottlenecks, and improve data processing efficiency.
- Implement real-time and streaming data solutions using technologies such as Spark Streaming and Kafka.
- Work with cloud-native data services and integrate Databricks with Azure or AWS environments.
- Collaborate with architects, data engineers, and cross-functional teams to deliver robust data solutions.
- Contribute to technical design, solution architecture, code reviews, and engineering best practices.
- Support Agile delivery practices and provide technical guidance to team members where required.
Mandatory Technical Skills:
- Strong hands-on experience with Azure Databricks or AWS Databricks.
- Excellent programming skills in Python.
- Strong expertise in Apache Spark and PySpark.
- Practical experience with Azure or AWS cloud platforms.
- Good understanding of Big Data architecture and distributed computing.
- Experience in Spark performance tuning and optimization.
- Strong SQL knowledge, including joins, stored procedures, and relational database concepts.
Additional Skills:
- Hadoop ecosystem: HDFS, MapReduce, Sqoop.
- Streaming technologies: Spark Streaming, Apache Storm.
- Messaging platforms: Kafka, RabbitMQ.
- Data processing tools: Hive, Impala.
- NoSQL databases: HBase, Cassandra, MongoDB.
- ETL development and data integration.
- Experience integrating data from RDBMS, ERP systems, and file-based sources.
- Big Data solution design and technical leadership experience.
What We Are Looking For:
- Professionals with strong hands-on development experience rather than application support-only backgrounds.
- Candidates who have worked on enterprise-scale Big Data platforms.
- Engineers capable of designing and implementing efficient data processing solutions.
- Candidates with good problem-solving, analytical, and collaboration skills.
- Technical leads who can contribute to architecture and guide engineering teams.
Hiring Drive Details:
- Date: 14 November 2026
- Location: Gurgaon
- Venue: 1st Floor, Block 2, DLF Downtown, Commercial Site, Block V, DLF City, Phase
Did you find something suspicious?
Posted by
Posted in
Data Engineering
Functional Area
Big Data / Data Warehousing / ETL
Job Code
1681733