We are hiring for the position of Data Engineer with one of the leading organizations.

Experience : 5-7 years

Location : Bangalore

Responsibilities :

- Be a key player in a cross-functional team of engineers who build software for a large-scale data processing ecosystem, supporting real-time and batch data pipelines for analytics, data science, and operations.

- Maintain software engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation.

- Evangelize and evolve the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption.

- Build out a robust observability, alerting, logging, and system control plane that allows easy diagnosis of any issues across all our data pipelines.

- Contribute to maintaining, updating, and expanding existing software deployments while maintaining strict uptime SLAs.

- Maintain detailed documentation of your work and changes to support data quality and data governance requirements.

- Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team.

- Be a part of the magic : Collaborate with product managers, architects, and other engineers to drive the success of the Foundational Platform.

Basic Qualifications :

- 5+ years of data engineering experience in software engineering in the data space.

- Strong software algorithmic problem-solving expertise.

- Strong fundamental Scala and Python software programming skills.

- Good understanding of AWS or other cloud provider resources (S3).

- Strong SQL skills and ability to creatively problem solve and dive deep into our data and software ecosystem.

- Hands-on production environment experience with distributed processing systems such as Apache Spark.

- Hands-on production experience with workflow orchestration systems such as Airflow for creating and maintaining data pipelines.

- Scripting language experience (Bash, PowerShell).

- Technologies such as OneTrust, Databricks, Jupyter, Snowflake, Redshift, Airflow, DynamoDB, Redis, Kubernetes, Kinesis, REST APIs, Terraform, Go.

- SQL, Python, Scala, other computer software languages.

- Willingness and ability to learn and pick up new skillsets.

- Self-starting problem solver with an eye for detail and excellent analytical and communication skills.

Preferred Qualifications :

- Masters Degree in Computer Science, Information Systems preferred.

- Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query).

- Experience in developing APIs with GraphQL.

- Deep Understanding of AWS or other cloud providers as well as infrastructure as code.

- Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices.

- Familiar with Scrum and Agile methodologies.

- Familiarity with privacy regulations and/or data subject rights.

Required Education :

- Bachelors degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.