Job Title : Senior Data Engineer / Junior Solution Architect

Location : Noida / Pune / Bengaluru / Chennai / Mumbai

Shift : 12 : 00 PM - 10 : 00 PM

Work Mode : Hybrid (3 Days Work from Office)

Notice Period : Immediate to 30 Days

Experience : 8 to 10 Years

Role Summary :

We are looking for a highly skilled Senior Data Engineer / Junior Solution Architect with strong hands-on expertise in Google Cloud Platform (GCP) and big data technologies.

This role requires deep experience in building scalable data platforms, designing robust ETL/ELT pipelines, and contributing to solution architecture discussions.

The ideal candidate will combine strong technical execution capabilities with architectural thinking, client interaction skills, and the ability to mentor teams while evolving into a Solution Architect role.

Key Responsibilities :

Solution Design & Architecture :

- Design scalable and secure cloud-native solutions on GCP based on business requirements.

- Contribute to High-Level Design (HLD) and Low-Level Design (LLD) documents.

- Participate in architecture discussions and technical solution walkthroughs with clients.

- Ensure best practices for performance, reliability, scalability, and cost optimization.

Data Engineering & Pipeline Development :

- Build and manage batch data pipelines using PySpark / Apache Spark.

- Develop and manage Dataproc jobs and clusters for distributed processing.

- Design and implement robust ETL and ELT workflows.

- Optimize and manage datasets and queries in BigQuery.

- Debug, troubleshoot, and resolve production data pipeline issues.

Cloud & Platform Engineering :

- Develop backend and event-driven components using Cloud Functions.

- Deploy and manage containerized workloads on Google Kubernetes Engine (GKE).

- Implement monitoring, logging, and alerting using Cloud Monitoring tools.

- Ensure governance and security using IAM, networking, and cloud security fundamentals.

AI/ML & Advanced Capabilities :

- Support AI/ML and Generative AI initiatives using Vertex AI.

- Basic understanding of LLMs, RAG architecture, and ML lifecycle management.

DevOps & Collaboration :

- Work with DevOps teams on CI/CD pipelines.

- Contribute to Infrastructure as Code implementations (Terraform preferred).

- Collaborate closely with data teams, application teams, and cross-functional stakeholders.

- Engage with clients for requirement gathering and solution validation.

Mandatory Skills :

- 8 to 10 years of overall IT experience.

- 2 to 3+ years of strong hands-on experience in GCP.

- Strong programming skills in Python.

- Hands-on experience with PySpark / Apache Spark (Mandatory).

- Experience managing Dataproc jobs and clusters.

- Strong SQL skills with practical experience in BigQuery.

- Solid understanding of ETL/ELT pipeline design (batch and basic streaming).

- Exposure to GKE and container-based deployments.

- Familiarity with monitoring, logging, and debugging distributed systems.

- Understanding of cloud fundamentals (IAM, networking, security basics).

Good to Have

- Exposure to Vertex AI and ML concepts.

- Knowledge of Generative AI concepts (LLMs, RAG).

- Experience with Terraform and Infrastructure as Code.

- Experience in handling production environments and real-world system issues.

Behavioral Competencies

- Strong analytical and problem-solving skills.

- Ability to communicate complex technical concepts clearly.

- Client-facing experience preferred.

- Proactive attitude with willingness to grow into a Solution Architect role.