About the Role :

LendingKart is seeking a highly motivated and hands-on Tech Architect to join their Data Engineering team. The ideal candidate will possess deep technical expertise, a proven track record of implementing robust data pipelines, ensure data quality, and the ability to mentor and guide team members.

Responsibilities :

- Architect the Roadmap : Define and own the technical vision for the data platform.

- Lakehouse Implementation : Lead the design and implementation of a robust Lakehouse Architecture.

- Data Modeling : Collaborate with stakeholders to translate complex business logic into efficient, scalable data models.

- High-Performance ETL/ELT : Lead the design, development, and maintenance of scalable pipelines.

- Real-Time Ingestion : Architect modern data ingestion strategies, focusing on CDC and event-driven architectures.

- Spark Optimization : Serve as the subject matter expert on Apache Spark.

- Lead by Example : Remain hands-on (approx. 30-50% coding) in Python, Scala, and SQL.

- Technical Excellence : Foster a culture of engineering rigor by conducting code reviews and enforcing CI/CD best practices.

- Mentorship : Mentor junior and mid-level engineers.

- Governance & Security : Implement protocols for data quality, lineage, and RBAC.

Requirements :

- 5 - 9 years experience in Data Engineering.

- Expert-level proficiency in Python and Scala.

- Advanced SQL knowledge.

- Deep hands-on expertise with Apache Spark (AWS EMR, GCP Data Proc).

- Experience with LakeHouse Architecture (Medallion Model).

- Proficiency in choosing data stores (S3/GCS/ADLS, MySQL, PgSQL, MongoDB).

- Understanding of Kappa and Lambda architectures.

- Experience with CDC tools (Debezium) and Message Brokers (Kafka/PubSub).

- Knowledge of Data Modelling principles and Kubernetes deployment.

- Experience with Data Observability (Grafana, Prometheus) and Query Engines (BigQuery, Trino, RedShift).