The Data Engineer performs a vital role in building reliable, repeatable data pipelines and aids in modelling data correctly for building end user dashboards/reports.

Acting as an expert in end-to-end data movement and modelling, they use their experience of building expandable, repeatable and forward-looking technical artifacts to propose & implement Data solutions.

Key Responsibilities :

- The Data Engineer will be responsible for the delivery of Data Collection and Transformation workstream within both larger, strategic projects as well as smaller, tactical initiatives.

- Inputs into the Data Modelling workstream, building towards the Information Model as per the overall Data Strategy.

- Create and own the Source to Target document and the ETL technical definition document.

- Be responsible and work with the team to ensure uptime of systems and compliance is adhered to.

- This can include helping with upgrades, infrastructure tuning, research and MVP on unknown technologies.

- Work closely with the Data Architect, Data Visualization engineer and the D&A Product Owner to maintain Source to Target mappings, ETL technical definition documents and Report Technical Definition document.

- Assist D&A Product Owner in Requirements phase to ensure proposed solutions/outputs are aligned to overall Data Strategy.

- Drive ideation and prove solutions & technologies with well thought out Proof of Concepts with clear objectives and timelines.

- Conversant with Agile methodologies like Sprints and Scrums.

- Provide training for internal resources on concepts around data storage, modelling and data access.

- Provide BAU (Business as usual) support, to analysis and fix issues as they arise and are resolved in a timely manner, which could result in working non-core hours when required.

Skills, Knowledge and Expertise :

- Expertise (5+ years) with an Enterprise level ETL tools like Talend, Informatica, Azure Cloud Factory, Matillion etc.

- Expertise working with Analytics databases like Snowflake, MS Synapse, Databricks etc.

- Data Modelling experience.

- Must understand how to structure a data warehouse, modelling techniques and performance optimizations.

- Database skills, including SQL Scripting, Stored Procedures, Java Based Procedures etc.

- PowerBI/Power Query skills, including the ability to create Semantic models/Dataset.

- Experience working in a cloud based environment, MS Azure.

- Understanding of Data Lakes, including partitioning, bucketing and salting of data in Data Lakes.

- Understanding of various data lake storage formats, including Parquet, ORC, Avro etc.

- Intermediate understanding of Big Data technologies like Spark, Databricks etc.

- , including Data Lake and Data Warehousing methodologies.

- Intermediate skills with a programming language, preferably Python.

Benefits :

- Monthly phone bill maximum reimbursement limit is Rs.

- 3000.

- Annual check-up for employee and spouse including Doctor consultation reimbursement up to INR 15,000.

- Medical Insurance 5 lakhs Flat Coverage.

- PF and Gratuity.

- Long Service Policy.

- Life Term Policy.

- Monthly Broadband Bill Reimbursement Rs.

- 2000 or on actual whichever is lower.

- Access to LinkedIn Learning.

- Access to ABF Networking, connect, collaborate, and grow across the ABF Group.

- - - - - - -

post as non-premium