About the Role:

We are looking for a Mid-Level Data Engineer with 2 - 5 years of experience to develop and maintain scalable, secure, and reliable data solutions. The ideal candidate should have experience in Python, data engineering, cloud platforms, and DevOps practices.

Responsibilities:

- Write clean, efficient, reusable, and testable Python code.

- Develop backend APIs using FastAPI or Django/Django REST Framework.

- Build, maintain, and optimize ETL/ELT pipelines using Python.

- Work with SQL and NoSQL databases.

- Troubleshoot issues and optimize application and pipeline performance.

- Participate in code reviews and maintain technical documentation.

- Work with Linux environments and understand system design fundamentals.

- Develop batch and streaming data workflows, data ingestion pipelines, and data transformation processes.

- Understand data modeling and data warehousing concepts.

Tech Stack:

- AWS: S3, Lambda, Glue, Athena, RDS, ECS, CloudWatch.

- GCP: Cloud Storage, Cloud Functions, Dataflow, BigQuery, Pub/Sub, Cloud Run.

DevOps Skills:

- CI/CD tools: GitHub Actions, Jenkins, AWS CodeBuild, or Cloud Build.

- Docker and container-based development and deployment.

- Infrastructure as Code: Terraform or CloudFormation.

- Familiarity with monitoring, logging, and alerting systems.

Desirable Skills:

- Test-driven development and automated testing.

- Experience with Grafana or CloudWatch dashboards.

- Exposure to digital signage or marketing platforms.