Hadoop Architect - Customer Data Platform

Job Title : Hadoop Solution Architect.

Experience : 10-18 years in Analytics and Big Data with at least the last 3-4 years in CDP Hadoop solution Architect role.

Location : Mumbai, India.

Department : Big Data, Analytics and Cloud.

Company : Smartavya Analytica Private limited is niche Data and AI company.

Experience : 12-18 years of experience in Analytics and Big Data, with at least the last 6 years or more in a senior role specifically focusing on Hadoop architecture and administration.

Key Responsibilities :

- Lead the end-to-end architecture, design, and implementation of Hadoop-based Cloudera CDP on-prem data solutions.

- Ensure data availability, scalability, and reliability across Hadoop clusters.

- Collaborate with data engineers, data scientists, and business stakeholders to gather requirements and deliver tailored big data solutions.

- Optimize and tune Hadoop systems for performance and scalability.

- Maintain and document Hadoop environments to ensure reproducibility and reliability of data processes.

- Oversee the integration of Hadoop with other data systems and tools.

- Implement and manage data security, privacy, and governance frameworks within Hadoop ecosystems.

- Mentor and guide junior team members, fostering a culture of continuous learning and improvement.

- Drive continuous improvement initiatives to enhance Hadoop capabilities and operational efficiency.

- Communicate complex technical concepts and solutions to non-technical stakeholders effectively.

Requirements :

- Extensive proficiency in Hadoop ecosystems, including HDFS, Ozone, Kudu, Spark Streaming, YARN, Hive, and Spark.

- Excellent Performance tuning skills is a must.

- Strong leadership and project management skills, with a demonstrated ability to manage large-scale data projects.

- Client Engagement and Presentation skills are mandatory.

- Experience with Hadoop administration and optimization on various operating environments.

- Excellent problem-solving skills and the ability to manage failures in a production setting.

- Familiarity with Reporting tools, Data Integration Tools and ETL processes.

- Strong communication and collaboration skills to work effectively with business users and cross-functional teams.

- Ability to work in high-pressure situations and handle multiple priorities.

Academic Qualifications :

- Bachelors degree in computer science, Information Technology, or a related field.

- Relevant certifications (e.g., Cloudera Certified Architect, Hortonworks Data Platform Certified) are a plus.