Job Summary :

- Understanding of how to design technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions

- Understand, implement, and automate ETL pipelines with better industry standards

- Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, design infrastructure for greater scalability, etc.

- Developing, integrating, testing, and maintaining existing and new applications

- Design, and create data pipelines (data lake / data warehouses) for real world energy analytical solutions

- Expert-level proficiency in Python (preferred) for automating everyday tasks

- Strong understanding in distributed computing frameworks, particularly Spark, Spark-SQL, Kafka, Spark Streaming, Hive, Azure Databricks etc

- Knowledge in using other leading cloud platforms preferably Azure.

- Knowledge of Azure data factory, logic app, Analysis service, Azure blob storage etc.

- Ability to work in a team in an agile setting, familiarity with JIRA and clear understanding of how Git works