Azure Data Factory, Data Bricks, SQL, Data Modeling, ETL, Power BI, Python (Good to have), Azure SQL Server, Data Warehousing, CDC, BI Tools

Remote

Role : Data Engineer ADF

Location : Remote

Company : Spectraforce

Responsibilities :

The Data Engineer - ADF will lead and play a key role within the DWBI team and is expected to provide technical leadership related to the data architecture and providing technical solutions to business needs. This person will work closely with Business Analysts, the Product Owner, and the development team and is responsible for developing data pipelines, data models, ETL packages and SQL code for the data warehouse.

The Data Engineer will help the product manager to make Go/ No-Go decision with software releases. Other responsibilities include :

- Manage day-to-day development activities for new data solutions and troubleshooting existing implementations.

- Work with product owners and other technical leads to lead technical discussions and resolve technical issues.

- Apply best practices of data integration for data quality and automation.

- Solve complex data integration and ETL problems.

- Work with project team and technology partners to develop high-level designs and effort estimates for new work efforts.

- Work with business analysts to understand business requirements and use cases.

- Working independently within guidelines, responsible for initiating, planning, executing, controlling, and implementation of projects using a formal project management and agile methodology.

- Oversees the full lifecycle system development process.

Requirements and Experience :

- 6+ years of Data Warehouse and ETL experience is a must.

- Expert knowledge in SQL, Data modeling, ETL is a must have.

- Expert with data warehousing standards, strategies, and tools.

- Extensive experience with Azure Data Factory (ADF) and Data Bricks.

- Extensive experience with Data model designs.

- Strong understanding and experience of Data Warehousing or Data Integration projects is a must have.

- Extensive experience with change data capture (CDC), for identifying and tracking changes to data stored in a database in near-real time.

- Strong knowledge of relational databases preferably Azure SQL Server, and Azure SQL Pools.

- Strong understanding of Power BI or other reporting platform such as Tableau.

- Strong understanding of awareness of industry trends and direction in BI/reporting, and how it can apply to an organizations product strategies.

- Experience with understanding of machine learning and predictive analytics is a plus.

- Collaborate with the BI Dev team members to evaluate, design, and develop BI reports and dashboards according to functional specifications while maintaining data integrity and data quality.

- Work collaboratively with key stakeholders to translate business information needs into well- defined data requirements to implement the BI solutions.

- Analyze and resolve problems and provide technical assistance as necessary.

- Strong interpersonal, analytical, problem-solving, influencing, prioritization, decision- making skills.

- Should have prior experience with Atlassian suite of products (JIRA, Confluence, Bitbucket).

- Python experience is good to have.

- Prior Logistics domain experience is preferred.

- Very good written and oral communication is required