Role Overview :

We are seeking a seasoned Azure Data Engineer to join our high-performing data team in Bangalore. In this role, you will be responsible for architecting and maintaining scalable data pipelines that serve as the backbone for our analytical and machine learning initiatives. You will work closely with data scientists, product managers, and business stakeholders to translate complex requirements into robust data solutions. By leveraging the Medallion Architecture, you will ensure data integrity and accessibility, directly impacting our ability to derive actionable business intelligence and drive data-informed decision-making across the organization.

Key Responsibilities :

- Design and implement end-to-end ETL/ELT pipelines using Azure Databricks and PySpark to process large-scale datasets efficiently for downstream consumption.

- Develop and maintain modular data transformation logic using dbt to ensure consistency and quality across our analytical layers.

- Orchestrate complex data workflows and dependencies using Apache Airflow to guarantee timely and reliable data availability for business users.

- Implement Medallion Architecture patterns to organize data from raw ingestion to curated business-ready formats, enhancing overall data governance.

- Manage CI/CD pipelines within Azure DevOps to automate deployment processes, ensuring high code quality and rapid delivery of new features.

- Optimize SQL queries and database performance to support high-concurrency reporting and dashboarding needs for internal stakeholders.

- Collaborate with cross-functional teams to refine data models that align with evolving business requirements and long-term scalability goals.

Required Skillset :

- Demonstrated expertise in building and managing production-grade data platforms using Azure Databricks, PySpark, and advanced SQL.

- Proven ability to design scalable data models and implement Medallion Architecture in complex, cloud-native environments.

- Strong proficiency in workflow orchestration with Apache Airflow and version control/deployment automation via Azure DevOps.

- Excellent communication skills with the ability to articulate technical data concepts to non-technical stakeholders and influence project direction.

- A proactive, problem-solving mindset with the ability to thrive in a hybrid work environment based in Bangalore.

- A Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field, reflecting a strong foundation in data structures and algorithms.

- Ability to adapt to shifting business priorities while maintaining high standards for code quality, documentation, and system reliability.