About organisation :

- Boutique consultancy ? Presence : India, Canada, USA, Singapore, Dubai. 5 years of sustained growth.

- 100% practitioner led company, with a strong footprint in real-time data & ai platforms. Strong history of open-source contributions and thought leadership

- Award winning Confl uent delivery partner. Partnerships with AerospikeDB, DBRX, Clickhouse, Temporal and several other technologies

What youll do

- Work as a lead engineer on customer projects, involving Confluent, Databricks, Clickhouse, Aerospike and a host of other data platform and infrastructure technologies

- Put on a product hat, to help evolve a data platform suitable for marketing data in a complex landscape with multi-national conglomerates. Challenges intersecting data quality, lineage, real-time analytics and more

- Work on building data pipelines, using Kafka, Flink, Spark and other technologies

- Mentor junior engineers on the DBRX path

- Participate in POCs, pre-sales and consulting assignments at large.

What you must bring :

- High degree of competence in Python (OR) Java/Scala stack, SQL and ETL/ELT (minimum). Deeper conceptual experience outside the notebook.

- Solid concepts and understanding of Databricks stack, along with Spark, Delta Lake, Apache Iceberg and the broad spectrum of big data storage and processing technologies

- Deep understanding of building enterprise grade data lakehouses (medallion architecture), but a POV on pata quality, lineage and catalogue

- Stretch : Exposure to Docker, Kubernetes and infrastructure on the cloud. Be able to deploy and operate a stack to a reasonable extent

- Stretch : ML Engineering and

- Stretch : Exposure to the Apache Kafka / Confluent, Flink and stream processing