Sr Data Engineer

Hybrid in Pune office (2x/week onsite)

6-12+ Months Contract

Project Details:

Looking for an engaged and experienced Senior Data Engineer to build our analytics and ML platform to collect, store, process, and analyze huge sets of data spread across the organization. The platform will provide frameworks for quickly rolling out new data analysis for data-driven products and micro-services. The platform will also enable machine/deep learning infrastructure that operationalizes data science models for broad consumption. As a Senior Software Engineer in the Big data Analytics organization, you'll join a small team focused on the delivery of the platform and actionable insights which moves the needle.

Must Have:

- 5 years of experience as a professional software engineer

- 3 - 5 years of experience with big data technologies

- Experience in building, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time

- Exposure to & strong knowledge of Snowflake, Databricks and Azure

- Strong knowledge of programming languages/tools including Spark, SQL, Python, Java

- Strong knowledge of Linux CI/CD & how it's used to move things to production

- Experience with various messaging systems such as Kafka

- Proven track record of leveraging AI tools to drive automation and improve efficiency

- Experience implementing Lambda Architecture to support both real-time and batch analytics use cases

- Familiarity with ML and Deep Learning

- An understanding of software development best practice

- Enthusiasm for constant improvement as a Data Engineer

- Ability to review and critique code and proposed designs, and offer thoughtful feedback in a collegial fashion

- Skilled in writing and presenting - able to craft needed messages so they are clearly expressed and easily understood

- Ability to work independently on complex problems of varying complexity and scope

- Bachelor's degree in Computer Science, Engineering or equivalent demonstrable experience

Duties:

- Demonstrate a deep knowledge of, and ability to operationalize, leading data technologies and best practice

- Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production

- We develop real products. You need to be an expert in design, coding, and scripting

- Facilitate problem diagnosis and resolution in technical and functional areas

- Encourage change, especially in support of data engineering best practices and developer satisfaction

- Write high-quality code that is consistent with our standards, creating new standards as necessary

- Demonstrate correctness with pragmatic automated tests

- Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices

- Develop strong working relationships with others across levels and functions

- Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest

- Participate in continuing education programs to grow your skills both technically and in the Williams-Sonoma business domain

- Serve as a member of an agile engineering team and participate in the team's workflow