Role : Data Engineer

Location : Bangalore

Job Summary :

We are seeking a skilled Data Engineer to design, develop, and maintain automated data pipelines and ETL workflows that drive our data-driven operations. The ideal candidate will have strong hands-on expertise in Python, data processing libraries (Pandas, NumPy), and AWS RDS / MySQL. This role involves building reliable automation processes for data extraction, transformation, scheduling, and monitoring, ensuring data accuracy, consistency, and system stability.

Key Responsibilities :

- Develop, deploy, and maintain data pipelines for extraction, transformation, and loading (ETL) from various structured and unstructured sources (APIs, XML, flat files, databases).

- Build and optimize Python-based automation scripts to streamline data workflows.

- Utilize Pandas, NumPy, and Regex for complex data cleaning, validation, and transformation tasks.

- Integrate and manage data within MySQL and AWS RDS environments.

- Design and implement job scheduling and monitoring systems to ensure timely pipeline executions.

- Implement error tracking, logging, and notification mechanisms for proactive issue detection.

- Collaborate with data analysts, software engineers, and business teams to deliver high-quality, ready-to-use datasets.

- Continuously enhance data processes for scalability, performance, and maintainability.

- Maintain comprehensive documentation for data workflows, automation scripts, and monitoring systems.

Required Skills & Qualifications :

- 7 years of experience as a Data Engineer or in a similar data-focused role.

- Strong proficiency in Python and data manipulation libraries (Pandas, NumPy).

- Solid understanding of data extraction and transformation techniques for XML, JSON, and flat files.

- Strong command of Regex for data pattern recognition and text processing.

- Experience with MySQL and AWS RDS for data storage, querying, and integration.

- Practical experience with data pipeline automation, job scheduling (e.g., Cron, Airflow, AWS Lambda), and process monitoring.

- Hands-on experience with error handling, logging frameworks, and pipeline health tracking.

- Strong analytical and problem-solving skills with attention to detail.

- Excellent communication and documentation abilities.