HamburgerMenu
hirist

Big Data Architect - Spark/Hadoop

Consulting Pandits
Pune
10 - 12 Years

Posted on: 05/10/2025

Job Description

Big Data Architect - Build the Future of Data Management

Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of data management.

Key Responsibilities :

- Design and implement scalable and resilient data architectures for both batch and streaming data processing

- Develop data models and database structures to ensure efficient data storage and retrieval

- Ensure data security, integrity, and compliance with relevant regulations

- Integrate data from various sources, including legacy systems, into the big data infrastructure

- Monitor and optimize the performance of the big data infrastructure

- Collaborate with data scientists, engineers, and business stakeholders to understand requirements and translate them into technical solutions

- Evaluate and recommend new technologies and tools for data management and processing

- Provide guidance and mentorship to junior team members

- Identify and resolve complex data challenges

- Participate in the pre and post sales process, helping both the sales and professional services teams

Qualifications :

- Bachelor's or Master's degree in computer science, computer engineering, or a relevant field

- 10+ years of experience, with at least 2 years of experience as a Big Data Architect

- Strong understanding of big data technologies, including Hadoop, Spark, NoSQL databases, and cloud-based data services (AWS, Azure, GCP)

- Experience with open-source ecosystem programming languages, such as Python, Java, Scala, and Spark

- Proficiency in data modeling and database design, including SQL and NoSQL

- Experience with ETL processes, data security and governance principles, and API design and development

- Strong analytical and problem-solving skills, with good communication and collaboration skills


info-icon

Did you find something suspicious?