Job profile and Role: Data Engineer

Job description :

- Strong experience with Postgres and SQL and experience working with, supporting and maintaining relational databases.

- Experience building and optimizing 'big data' data pipelines, architectures, and data sets.

- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

- Experience with AWS cloud services

- Experience in migrating data across the database/environments with zero downtime.

- Experience with AWS integration tool, AWS Glue.

- Experience supporting complex ETL & ; Integration Projects

- Create and maintain comprehensive documentation for advanced analytics models, data dictionaries, and data flows.

- Hands on engineering of solutions and data pipelines utilizing CI/CD and automation.

- Design and maintain testing processes and automation workflows for data feature changes, upgrades, and releases.

- Strong analytic skills related to working with semi structured datasets.

- Build processes supporting data transformation, data structures, metadata, dependency and workload management.

- A successful history of manipulating, processing and extracting value from large, disconnected datasets.

- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.

- Strong project management and organizational skills.

- Experience supporting and working with cross-functional teams in a dynamic environment.

Required Skills

- Bachelor's degree in Computer Science or equivalent degree.

- 5+ years of software experience

- Experience with Machine learning frameworks and models. Pytorch experience preferred

- Strong understanding of statistical analysis and mathematical data manipulation

- Work with web technology including Java, Python, JavaScript, React/Redux, Kotlin.

- Follow best practices for software development and deployment

- Understanding of relational database, big data, and experience in SQL

- Proficient at using GIT, GitFlow, JIRA, Gitlab and Confluence.

- Strong analytical and problem solving skills.

- Open-minded and passionate to learn and grow technology skills

- Strong sense of accountability

- Solution-focused and ability to drive change within the organization

- Experience in writing unit/integration tests including test automation.

- Strong testing and debugging abilities, functional, analytical and technical abilities, ability to find bugs, attention to detail, troubleshooting