Role Overview :

As a Data Scientist/Data Engineer, you will bridge the gap between complex data architecture and actionable machine learning insights. You will work closely with cross-functional product teams and stakeholders to design robust data pipelines, optimize distributed computing workflows, and deploy predictive models that drive business efficiency. This role is pivotal in transforming raw, high-volume data into strategic assets, ensuring that our technical infrastructure remains both scalable and performant in a fast-paced environment.

Key Responsibilities :

- Architect and maintain scalable data pipelines using PySpark and Scala to ensure seamless data flow for downstream analytical applications.

- Develop and deploy machine learning models within the Databricks environment to solve complex business problems and improve predictive accuracy.

- Collaborate with engineering teams to optimize cluster performance and resource allocation, reducing latency in data processing tasks.

- Translate business requirements into technical specifications to ensure that data products align with the strategic goals of our clients.

- Implement best practices for code versioning, automated testing, and continuous integration to maintain high standards of software quality.

Required Skillset :

- Demonstrated expertise in building distributed data systems using PySpark and Scala, with a deep understanding of Spark internals and performance tuning.

- Proven ability to design, train, and deploy machine learning models in production environments, leveraging the Databricks platform for collaborative development.

- Strong proficiency in SQL and Python for data manipulation, feature engineering, and complex query optimization.

- Excellent communication skills with the ability to articulate technical concepts to non-technical stakeholders and influence project direction.

- A minimum of 5 to 9 years of professional experience in data engineering or data science roles, ideally within a fast-paced product or consulting environment.

- Ability to work effectively in an on-site capacity in Gurgaon, collaborating within a high-performing, agile team structure.