Data Engineer - Python/SQL

Description :

Job Title : Data Engineer (AWS / GCP Cloud)

Experience : 8 14 years

Location : Hyderabad (On-site Interview 31st October)

Employment Type : Full-time

About the Role :

We are seeking a highly skilled Data Engineer with strong experience in cloud-based data platforms (AWS or GCP), Python, and SQL. The ideal candidate will design, develop, and optimize scalable data pipelines and architectures to support advanced analytics and data-driven decision-making.

Key Responsibilities :

- Design, build, and maintain ETL/ELT data pipelines using modern cloud technologies (AWS / GCP).

- Develop scalable data ingestion and transformation workflows from diverse data sources.

- Work closely with data architects, analysts, and stakeholders to define and implement robust data models.

- Optimize and automate existing data workflows for performance and cost efficiency.

- Implement data quality, governance, and security best practices across the data ecosystem.

- Troubleshoot and resolve data-related issues, ensuring system reliability and accuracy.

- Stay current with emerging data engineering tools and cloud technologies.

Required Skills :

- Cloud Platforms : Strong hands-on experience with AWS (Glue, Redshift, S3, Lambda, EMR) or GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage).

- Programming : Proficient in Python for scripting, automation, and data transformation.

- Databases : Strong SQL skills for complex queries, optimization, and data modeling.

- Data Pipelines : Experience with tools like Airflow, Apache Beam, Spark, or similar frameworks.

- Data Modeling : Knowledge of Dimensional Modeling, Data Warehousing, and Schema Design.

- Version Control : Experience with Git, CI/CD, and modern DevOps practices.

- Strong understanding of data integration, API-based ingestion, and streaming data.

Preferred Qualifications :

- Experience with Terraform / CloudFormation for infrastructure as code (IaC).

- Exposure to containerization (Docker, Kubernetes).

- Understanding of Data Governance and Data Security principles.

- Excellent problem-solving and communication skills.

Soft Skills :

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration abilities.

- Ability to work independently and as part of a team in a fast-paced environment.