Business Intelligence Developer - Data Engineering

Responsibilities and Mandatory Capabilities :

1. Technical Expertise in Data Engineering & Cloud Platforms

- You have experience in data engineering and possess solid knowledge of T-SQL, Python, SparkSQL, and ideally DAX and M.

- You are familiar with Microsoft Fabric and its services or have worked with comparable cloud data platforms.

- You have experience in data integration and understand ETL/ELT processes

2. Data Pipeline Development & Performance Optimization

- Design, development, and maintenance of data pipelines in Microsoft Fabric.

- Performance tuning of data models in Microsoft Fabric.

- Principles of Data Domains / Data Mesh.

3. Collaboration & Solution Development

- Collaboration with data scientists, BI developers, and other stakeholders to deliver optimized data solutions.

- You have strong analytical thinking skills and enjoy developing data-driven solutions for complex problems.

4. DevOps & Process Automation

- You are familiar with DevOps methodologies and CI/CD processes, preferably with Azure DevOps.

- Experience with Power BI, Power Automate, and Power Apps is desirable.

5. Documentation & Best Practices

- Documentation of data processes and best practices to ensure reusability and scalability.

6. Project Management & Tools

- Experience with Confluence / JIRA.

Experience :

- 4+ years of practical experience as a full-time business intelligence developer in a fast-paced environment

- Prior work as part of an agile and interdisciplinary team within a startup or an international corporate

Beneficial Capabilities :

- Microsoft Fabric Expertise : In-depth knowledge of Microsoft Fabric and its components (or Azure Synapse) and their application in data engineering.

- Data Modelling & Access : Deep know how in modelling data across medallion layers and providing data products

- Problem-Solving : Ability to troubleshoot complex data engineering challenges

- Collaboration : Effective communication and teamwork skills and experience in agile methods

- Data Mesh Principles : Understanding of domain-driven design, data product thinking, and decentralized data ownership

- Big Data Technologies : Exposure to big data technologies (Hadoop, Spark) within the Microsoft ecosystem

- Real-Time Data Processing : Familiarity with streaming platforms (Azure Stream Analytics, Kafka)

- Machine Learning Integration : Knowledge of integrating ML pipelines with data mesh architecture

- DevOps Practices : Experience with containerization (Docker, Kubernetes) and CI/CD pipelines

- Microsoft Purview

- Data Catalogue

- Data Map

- DBT - Its open source software for managing data flows

- For Data Quality - Tool is "Great Expectation "again open source

- Knowledge and experience in Github

- Knowledge of Azure Function is desirable