Kanerika Software - Data Engineering Lead - Python/ETL

Job Location : Hyderabad, Indore and Ahmedabad (India)

What You Will Do :

Following are high level responsibilities that you will play but not limited to :

- Develop and maintain data pipelines using Azure Data Factory (ADF) /Databricks for data integration and ETL processes.

- Design, implement, and optimize Power BI /Fabric reports and dashboards to deliver actionable business insights.

- Collaborate with data analysts, business users, and other teams to understand data requirements and deliver solutions using ADF and Power BI.

- Extract, transform, and load (ETL) data from various sources into cloud-based storage systems such as Azure Data Lake or Azure SQL Database.

- Work with large datasets and optimize queries and pipelines for performance and scalability.

- Ensure data quality, integrity, and availability throughout the data lifecycle.

- Automate repetitive data tasks, ensuring timely and accurate reporting.

- Monitor and troubleshoot data pipelines, addressing any performance or data issues promptly.

- Support data visualization and reporting tools, including Power BI, to enable business stakeholders to make data-driven decisions.

- Write clear, efficient, and maintainable code for data transformations and automation.

Required Qualifications :

- Bachelor's degree in computer science, Information Technology, Engineering, or a related field.

- 8+ years of hands-on experience in Data Engineering, BI Developer or a similar role.

- Proficiency with Azure Data Factory (ADF), including the creation of data pipelines and managing data flows.

- Strong experience in Power BI, including report creation, dashboard development, and data modeling.

- Experience with SQL and database management (e.g., Azure SQL Database, SQL Server).

- Knowledge of cloud platforms, especially Microsoft Azure.

- Familiarity with data warehousing concepts and ETL processes.

- Experience working with cloud-based data storage solutions (e.g., Azure Data Lake, Azure Blob Storage).

- Strong programming skills in languages such as Python, SQL, or other relevant languages.

- Ability to troubleshoot and optimize data pipelines for performance and reliability.

Preferred Qualifications :

- Familiarity with data modeling techniques and practices for Power BI.

- Knowledge of Azure Databricks or other data processing frameworks.

- Knowledge of Microsoft Fabric or other Cloud Platforms.

What we need?

- B. Tech computer science or equivalent.

Why join us?

- Work with a passionate and innovative team in a fast-paced, growth-oriented environment.

- Gain hands-on experience in content marketing with exposure to real-world projects.

- Opportunity to learn from experienced professionals and enhance your marketing skills.

- Contribute to exciting initiatives and make an impact from day one.

- Competitive stipend and potential for growth within the company.

- Recognized for excellence in data and AI solutions with industry awards and accolades.