Responsibilities :

Platform Expertise :

- Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platform to guide NextGen customers (domain teams) on data and analytics implementations

- Design and validate well-architected solutions and plans for productiongrade implementations based on NextGen best practices.

- Discover new use case patterns that are emerging within various Domains and convert them to technical capability requirements and incorporate it back in the NextGen platform.

Development & Production Deployment :

- Implement and operationalize data pipelines using Delta Live Tables (DLT) while ensuring production readiness.

- Develop and sustain Continuous Integration/Continuous Deployment (CI/CD) pipelines for effective code promotion and release management.

- Ensure alignment of implemented solutions with NextGen best practices.

Workflows & Serverless :

- Design and manage data and analytics workflows using Databricks Workflows

- Advise on serverless architecture planning and implementation to promote scalability and cost efficiency

Programming and Solution Design :

- Develop solutions using Python and SQL, ensuring scalability, reliability, and robustness.

- Provide architectural and design oversight for efficient data pipelines, workflows, and data quality practices.

Customer Leadership and Advisory :

- Serve as an escalation point for technical challenges while ensuring timely resolution.

- Collaborate with cross-functional teams (e.g., Platform Engineering, Domain Teams, Platform Architecture) to define and achieve customer success goals.

- Coach and upskill Domain teams on Databricks capabilities and best practices

Documentation and Communication :

- Create and present technical stories, architecture designs, and technical documentation

Requirements :

- Strong hands-on experience with the Databricks platform.

- Strong expertise in using Delta Live Tables (DLT) for building and managing data pipelines.

- Proven track record of operationalizing code through CI/CD pipelines in data engineering contexts.

- Proficiency in Python and SQL programming

- Familiarity with Databricks Workflows and/or serverless implementations

- Demonstrated experience in data solution architecture with scalable and maintainable designs.

Additional Qualifications :

- Experience working with stakeholders to understand business requirements, deduct business needs from existing technical implementation and deliver solutions tailored to business needs

- Excellent problem-solving skills and the ability to adapt to various domain team environments quickly