Description :

Job Title : Python Developer / Data Engineer

Experience : 5 to 7 Years

Location : Bangalore or Hyderabad

Job Type : Contract with Client

Job Overview :

We are seeking an experienced Python Developer with strong Data Engineering expertise to join our team. The ideal candidate should have hands-on experience in building data pipelines, developing ETL processes, working with various data storage systems, and deploying solutions on cloud environments (AWS/Azure/GCP). This role will involve designing scalable data workflows, optimizing datasets, and collaborating with cross-functional teams to support data-driven business initiatives.

Key Responsibilities :

Data Engineering & Development :

- Design, develop, and maintain scalable data pipelines using Python and SQL.

- Build and optimize ETL workflows, handling a wide variety of data types and formats.

- Develop solutions to ingest, transform, and process large datasets efficiently.

Database & Storage Management :

- Work with multiple database technologies including :

a. RDBMS/SQL databases

b. NoSQL databases

c. Hive/HBase (added advantage)

- Write efficient, complex SQL queries for data extraction and transformation.

Cloud & DevOps Integration :

- Utilize cloud platforms such as AWS, Azure, or GCP for data processing and storage.

- Work with DevOps tools including Azure DevOps, CI/CD pipelines, and version control.

- Deploy and manage containerized applications using Docker and Kubernetes (preferred).

Data Processing & Workflow Orchestration :

- Use data orchestration and processing tools such as :

Apache Airflow

Hadoop ecosystem

Apache Spark

- Ensure high performance, reliability, and scalability of data workflows.

SDLC & Collaboration :

- Work in Agile environments (Scrum/Kanban) using tools like Jira.

- Collaborate with product owners, data analysts, and engineering teams to understand data requirements.

- Follow best practices for coding, documentation, code review, and testing.

Required Skills :

- Strong proficiency in Python

- Advanced SQL programming skills

- Cloud experience with AWS (preferred), Azure, or GCP

- ETL development experience

- Experience with Azure DevOps, Jira, and CI/CD

- Working knowledge of NoSQL databases (Hive/HBase preferred)

Good to Have :

- Hands-on experience with Docker & Kubernetes

- Experience with Big Data technologies : Hadoop, Spark

- Exposure to large-scale data processing pipelines

Additional Information :

- Work Mode : Onsite/Hybrid (as per client requirement)

- Contract Duration : Based on client needs

- Notice Period : Immediate to 15 Days (preferred)