About the role :

We are looking for a Senior Platform Engineer to join our data/platform engineering team. This role is ideal for someone who has worked extensively on distributed systems, cloud-native architectures on AWS, and has hands-on experience building and optimizing large-scale data or platform pipelines.

Key Responsibilities :

- Design, build, and maintain scalable, reliable, and high-performance data/platform infrastructure on AWS.

- Architect and optimize distributed data processing pipelines to handle large volumes of data efficiently.

- Own end-to-end orchestration workflows using Airflow, and manage serverless components via AWS Lambda and Glue.

- Work closely with data engineering and product teams to translate business requirements into robust technical solutions.

- Identify performance bottlenecks and drive optimization efforts across compute, storage, and orchestration layers.

- Ensure platform reliability, scalability, and cost-efficiency through sound architectural decisions.

- Contribute to code reviews, technical design discussions, and best practices for distributed systems.

- Troubleshoot and resolve production issues, ensuring high availability of platform services.

- Mentor junior engineers and contribute to raising the technical bar across the team.

Required Skills (Choose one track) :

Option A :

- Strong hands-on experience with Apache Spark (batch/streaming data processing).

- Solid working knowledge of AWS, including Glue, Lambda, Airflow, and S3.

Option B :

- Strong working knowledge of AWS, including Glue, Lambda, Airflow, and S3.

- Proficiency in Go for building performant backend/platform services.

Common Requirements :

- 6 - 8 years of overall engineering experience, with significant exposure to distributed systems.

- Proven experience in performance optimization - profiling, tuning, and scaling systems under load.

- Strong understanding of cloud infrastructure, orchestration, and event-driven architectures.

- Solid debugging and problem-solving skills in production environments.

- Good understanding of data pipeline design, fault tolerance, and system reliability practices.

Good to Have :

- Experience with Infrastructure-as-Code tools (Terraform, CloudFormation).

- Exposure to monitoring/observability tools (CloudWatch, Datadog, Prometheus, etc.).

- Familiarity with CI/CD pipelines for data/platform deployments.

- Prior experience in a high-growth or fast-paced product environment.

Contact :

Deboshree, deboshree@rbmsoft.com