Data Engineer / Big Data technologies

Location : Bangalore| Work from Office | Experience: 6-8 Years

Role Overview :

We are looking for a skilled Data Engineer to design, build, and optimize scalable data platforms using modern cloud-based and open architecture technologies. The ideal candidate will have strong expertise in distributed data processing, performance optimization, and building robust data pipelines.

Key Responsibilities :

- Design and develop scalable data pipelines using Python, PySpark, and modern data frameworks

- Build and manage data platforms using Snowflake and Databricks

- Implement open architecture and open data formats (e.g., Apache Iceberg) for interoperability

- Develop and manage data transformation workflows using DBT or similar tools

- Enable data cataloging and query federation across multiple data sources

- Optimize I/O and compute performance for large-scale data processing

- Support transactional capabilities on open-source data platforms

- Build and enhance analytics solutions, including OLAP workloads

- Integrate real-time data processing using Kafka and event-driven architectures

Required Skills & Qualifications :

- 6-8 years of experience in Data Engineering / Big Data technologies

- Strong hands-on experience with Python and PySpark

- Expertise in Snowflake and Databricks

- Experience with DBT or similar data pipeline tools

- Knowledge of Apache Iceberg or open table formats

- Understanding of data federation (catalog & query)

- Experience in performance tuning and distributed computing

- Familiarity with Kafka or event-driven systems

- Strong understanding of analytics and OLAP concepts

Preferred Skills (Good to Have) :

- Experience working in cloud-based data ecosystems

- Exposure to large-scale enterprise data platforms

- Understanding of modern data architecture patterns (lakehouse, open data stack)

Why Join Us?

- Opportunity to work on modern data platforms and cutting-edge technologies

- Exposure to large-scale, high-performance data systems

- Collaborative and fast-paced work environment

Application Process :

If you are passionate about building scalable data platforms and working with modern data technologies, we would love to hear from you. Apply now or share your profile for further discussion.