Petonic Infotech - Senior Data Engineer - MySQL/Python

We're seeking a highly motivated Senior Data Engineer with 7-8+ years of experience to design, deploy, and maintain robust data pipelines and cloud-native data solutions. In this critical role, you'll support cutting-edge AI/ML initiatives, optimize complex data systems, and ensure seamless data flow for advanced analytics.

If you're a hands-on engineer with a passion for building scalable data infrastructure in the cloud and optimizing database performance, we encourage you to apply!

Key Responsibilities :

- Data Pipeline Development : Design, develop, and maintain highly scalable and reliable data pipelines for both batch and real-time processing, ensuring data quality and integrity.

- Cloud Data Solution Deployment : Lead the deployment and management of cloud-based data solutions and services on major cloud platforms such as AWS, Azure, or Google Cloud Platform.

- CI/CD & Automation : Implement and optimize CI/CD pipelines for automated deployment of data infrastructure, applications, and configurations using infrastructure-as-code principles.

- Database Management : Administer, manage, and optimize performance for both relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB), ensuring robust backup, recovery, and replication strategies.

- Infrastructure Oversight : Oversee server provisioning, deployment, configuration, and monitoring of the entire data infrastructure in cloud and hybrid environments.

- AI/ML Collaboration : Collaborate closely with AI/ML teams to streamline data workflows, optimize data ingestion for model training, and ensure efficient data delivery for model inference.

- Security & Compliance : Implement and maintain robust security measures, ensure data integrity, and adhere to compliance standards across all data systems and pipelines.

- Performance Monitoring & Troubleshooting : Proactively monitor system performance, identify bottlenecks, and troubleshoot complex data infrastructure and database-related issues to ensure high availability and reliability.

Ideal Candidate Profile :

- Experience : 7-8+ years of progressive experience in data engineering and infrastructure deployment roles.

- Database Expertise : Strong expertise in database management and optimization for PostgreSQL, MySQL, and MongoDB. This includes performance tuning, indexing, backup/restore, and high availability configurations.

- Cloud Platforms : Hands-on experience with at least two major cloud platforms (AWS, Google Cloud Platform, or Azure) and proficiency in deploying and managing data services within these environments.

- Infrastructure as Code : Proven experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Azure Resource Manager).

- CI/CD Proficiency : Proficiency with CI/CD tools and practices using platforms like Jenkins, GitLab CI/CD, or GitHub Actions.

- Scripting Skills : Strong scripting skills in Python for automation, data processing, and infrastructure management.

- Server/Database Administration : Solid understanding of server and database administration principles in cloud and hybrid environments.

- AI/ML & MLOps : Familiarity with AI/ML data workflows, feature engineering, and MLOps concepts is a significant plus.

- Soft Skills : Excellent communication, collaboration, and problem-solving skills, with the ability to work effectively in cross-functional teams.