Sunware Technologies - Cloudera Technical Lead

Description :

Role : Cloudera Technical Lead

Experience : 6+ years

Location : Vijayawada

Key Responsibilities :

1) Platform Ownership :

- Manage Cloudera Manager, parcels/packages, services, roles, and service configurations.

- Capacity planning : nodes, memory/CPU, disks, network, HA/DR.

2) Reliability & Performance :

- Tune YARN, Spark, Hive, Impala, and HDFS for performance and cost.

- Troubleshoot job failures, skew/shuffle, Name Node/Data Node issues, GC pauses.

3) Security & Governance :

- Implement Kerberos, TLS/SSL, Ranger/Sentry policies, KMS, encryption zones.

- Drive data governance (lineage, catalogs, metadata), compliance and access controls.

4) Data Operations :

- Support ETL/ELT pipelines, batch & streaming (Spark, Kafka, NiFi).

- Optimize ingestion (DistCp, Sqoop, APIs), partitioning, bucketing, storage formats

(Parquet/ORC).

5) Automation & DevOps :

- Automate infra via Ansible/Terraform/Shell/Python; CI/CD for platform configurations.

- Backup/restore strategies, snapshots, disaster recovery runbooks.

6) Leadership & Collaboration :

- Partner with Data Engineering, Analytics, Security, and Cloud teams on roadmaps.

- Vendor management and license compliance; drive upgrades/migrations (e.g., CDH CDP).

Other Requirements :

- Strong knowledge of HDFS, YARN, Hive/LLAP, Impala, Spark, Kafka, Oozie/Airflow, Hue.

- Experience with data lake and warehouse architectures; storage formats (Parquet, ORC, Avro).

- Exposure to cloud environments (AWS/Azure/GCP) and hybrid deployments