Job Title : Data Engineer

Experience Level : 3-6 Years

Location : Bangalore/Gurugram

Job Type : Full-Time

Key Responsibilities :

- Design, develop, and maintain robust data pipelines using Python, SQL, and Apache Spark.

- Build and manage data workflows and ETL/ELT processes in Azure Data Factory or similar tools.

- Optimize data storage and performance using Azure Data Lake, Blob Storage, and SQL-based data warehouses (e.g., Azure Synapse).

- Collaborate with cross-functional teams to understand data needs and translate requirements into scalable solutions.

- Ensure data integrity, governance, and security across platforms.

- Monitor and troubleshoot data pipelines for failures and performance issues.

- Participate in code reviews and adhere to best practices in data engineering and software development.

Required Skills :

- Strong proficiency in Python for scripting and data processing.

- Advanced SQL skills for data manipulation, transformation, and performance tuning.

- Hands-on experience with Apache Spark (PySpark preferred).

- Deep understanding of Azure services like Data Factory, Databricks, Data Lake, Blob Storage, Synapse, etc.

- Experience with CI/CD and version control tools (e.g., Git, Azure DevOps).

- Knowledge of data modeling and data warehousing concepts.