Top 20+ NumPy Interview Questions and Answers

Job Title : Big Data Architect Experience : 8+ Years Location : Nagpur / Pune (Onsite 5 Days Working) Notice Period : 0 to 30 days max About the Role : We are looking for a highly skilled Big Data Architect to design and deliver scalable, production-grade big data solutions integrating Hadoop ecosystems with cloud platforms. The ideal candidate will have hands-on experience in architecting, optimizing, and deploying complex data pipelines while ensuring performance, cost efficiency, and best practices in data engineering. Key Responsibilities : - Deliver reference architecture for Hadoop + Cloud integration tailored to enterprise-scale environments. - Deploy production-grade pipelines using HDFS, Spark, and Kafka for batch and real-time data processing. - Set up best practices and implement CI/CD frameworks for data engineering workflows. - Lead data performance optimization and cost-reduction strategies across the big data stack. - Collaborate with cross-functional teams (data engineers, data scientists, DevOps) to ensure robust, scalable solutions. - Provide technical leadership and mentor junior engineers in big data technologies. Required Skills & Qualifications : - 8+ years of experience in Big Data architecture and engineering. - Expertise in the Hadoop ecosystem: HDFS, Hive, Sqoop, Oozie, Pig, Impala. - Strong knowledge of real-time processing frameworks: Kafka, Spark Streaming, Flink. - Hands-on experience with cloud platforms (AWS, GCP, or Azure) EMR, Dataproc, .HDInsight. - Proficiency in Python, Scala, or Java for big data solutions. - Experience with orchestration tools like Airflow or Prefect. - Familiarity with Lakehouse technologies: Delta Lake, Apache Iceberg. - Strong understanding of data modeling, data security, and governance best practices. - Excellent problem-solving, communication, and collaboration skills. Preferred Qualifications : - Experience in cost-optimization strategies for large-scale data platforms. - Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes). - Familiarity with CI/CD tools like Jenkins, GitLab CI/CD. - Prior experience mentoring and leading engineering teams.

Pune

Nagpur

Big Data Architect - HDFS/Scala 

Job Description for Big Data Architect - HDFS/Scala  in TALENT VELOCITY in  Pune Nagpur for (7-15) years of experience. Apply Now!

Jobs by location