Key Technologies / Stack :

- Python, Javascript, SQL and Advanced SQL, HTML/CSS, Git, PySpark, Shell scripting

- Databricks, MySQL, MongoDB, Kafka,

- ETL/ELT

- API Integration

Nice to have :

- Go, Java, Scala

- Linux/Ubuntu

- Docker, Kubernetes, DevOps

- Pentaho Data Integration, Debezium, Apache Flink, Apache Pinot, Argo

- Retail/ Logistics or Finance domain knowledge

Roles and Responsibilities:

You will be someone who loves and can analyze raw data, build real-time and batch pipe and exploit SQL and algorithms to bring out crucial insights to tackle complex questions. You will be responsible for developing the data pipeline, creating stunning reports and visualizations and developing real world machine learning appliances. You will be taking the bottom-line of managing a range of database (SQL, NoSQL) platforms in cloud and scaling to needs of our internal applications and SaaS platforms.

- Develop and build software solutions.

- Conducting data analysis, ETL/ELT solution development and deployments and report generation.

- Doing a thorough requirement analysis.

- Manage entire project coordination and deliverables

Skill Sets :

- Data pipeline development - batch, streaming and distributed processing fundamentals with on-job experience. Working knowledge of ETL, ELT tools, map-reduce, spark. Knowledge and hands-on experience with Databricks, Apache Flink, Apache Pinot.

- Information models design and development - analyze, design and build relational, dimensional and document models.

- Reports and visualization - Should be able convey data story to end users with impact. Hands on at least one of PowerBI, Tableau, Qlik, D3.

- Distributed databases - Experience with Hadoop, MongoDB, Full text search engine configuration and management.

- Machine learning - Python, SciKit, Pandas.

- Strong Computer Science fundamentals on Data structures, algorithm, programming.

- Operating system concepts, networking fundamental.

- Good handle on at least one programming language -Python, Javascript, SQL

- Good understanding of Software design and engineering practices.

- Knowledge of design patterns, MVC architecture, REST APIs.

- Knowledge of / experience in any of any security standards like ISMS, PCI DSS would be preferred.

- Communication: Appropriate and effective communication to others, articulate your problems, solutions and ideas, communicate issues in a timely manner.

- Knowledge of Information Security procedures and processes