Description :

Job Overview

A leading telecommunications provider is seeking a Senior Data Engineer to join its Network Analytics team. This role is critical to designing, building, and maintaining enterprise-scale data platforms that support large-scale network operations and advanced analytics. The ideal candidate will bring strong expertise in big data engineering, cloud-based ETL pipelines, and distributed systems, along with the ability to provide technical leadership and influence data engineering best practices across the organization.

Key Responsibilities :

- Design, build, and maintain scalable ETL pipelines using Apache Spark to process large volumes of network and operational data

- Develop and optimize data storage solutions to ensure high availability, performance, and data quality

- Work extensively with AWS cloud services, including S3, Lambda, Redshift, and EMR

- Implement and maintain monitoring, logging, and alerting solutions for data pipelines and infrastructure

- Build and manage CI/CD deployment pipelines to support continuous integration and delivery

- Ensure data accuracy, consistency, and reliability across distributed systems

- Collaborate with cross-functional teams including analytics, network engineering, and product stakeholders

- Provide technical leadership and guidance on data engineering best practices, architecture standards, and coding conventions

- Document system designs, data flows, and operational procedures

- Communicate technical concepts and insights clearly to both technical and non-technical stakeholders

Required Skills & Experience

Education:

- Bachelors degree (or equivalent experience) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field

Programming & Technologies :

- Strong proficiency in Python

- Expertise in Scala (preferred) or Java

- Hands-on experience with Big Data technologies, especially Apache Spark

- Familiarity with the Hadoop ecosystem

Data & Cloud :

- Strong experience building ETL pipelines

- Proficiency with AWS services including S3, Lambda, Redshift, and EMR

- Strong knowledge of SQL and relational databases

- Familiarity with NoSQL databases

Systems & Operations :

- Experience working with distributed systems and complex data storage solutions

- Hands-on experience implementing monitoring, logging, and alerting solutions

- Experience building and maintaining deployment pipelines (CI/CD)

Years of Experience (YOE) by Education Level

- PhD: 3+ years

- Masters Degree: 6+ years

- Bachelors Degree: 8+ years