Key Responsibilities:

- Design, develop, and maintain scalable data pipelines for batch and real-time processing.

- Develop and optimize ETL/ELT workflows for data ingestion, transformation, and loading.

- Develop and manage data models, data lakes, and data warehouses.

- Optimize database performance, SQL queries, and query execution plans.

- Develop and maintain solutions using SQL and advanced PL/SQL.

- Use Python or PySpark for data processing and pipeline development.

- Ensure data quality, governance, security, and compliance standards.

- Monitor and troubleshoot data pipeline and database performance issues.

- Implement automation for data validation, monitoring, and reporting.

- Work with Apache Spark, Hadoop, and cloud data services.

- Support cloud platforms and services such as Azure Data Factory, AWS Glue, or GCP Dataflow.

- Develop and manage workflows using Apache Airflow or similar orchestration tools.

- Support cloud migration and data modernization initiatives.

- Follow Git-based version control and work effectively in Linux/Unix environments.

- Collaborate with Data Analysts, Data Scientists, Business Teams, and Application Developers.

- Participate in Agile/Scrum ceremonies and contribute to end-to-end project delivery.

- Leverage coding assistance tools to improve development efficiency and productivity.

Mandatory Skills:

- Strong hands-on experience with SQL and Advanced PL/SQL.

- Strong experience with MySQL/database development.

- Proficiency in Python or PySpark.

- Experience in data pipeline and ETL/ELT development.

- Strong database performance-tuning and query-optimization skills.

Preferred Skills:

- Apache Spark, Hadoop, Azure Data Factory, AWS Glue, GCP Dataflow, Apache Airflow, Data Lakes & Data Warehouses, Git, Linux/Unix, Cloud Migration & Modernization, Data Quality & Governance.

Candidate Profile:

- Strong analytical and problem-solving skills.

- Good understanding of data engineering and database development practices.

- Ability to work independently and collaborate with cross-functional teams.

- Strong communication and stakeholder-management skills.

- Comfortable working with modern development and AI-assisted coding tools.