Position : Data Engineer.

Experience : 3+ years.

Location : Trivandrum, Hybrid.

Job Summary :

We are seeking a highly motivated and skilled Data Engineer with 3+ years of experience to join our growing data team. In this role, you will be instrumental in designing, building, and maintaining robust, scalable, and efficient data pipelines and infrastructure. You will work closely with data scientists, analysts, and other engineering teams to ensure data availability, quality, and accessibility for various analytical and machine learning initiatives.

Key Responsibilities :

Design and Development :

- Design, develop, and optimize scalable ETL/ELT pipelines to ingest, transform, and load data from diverse sources into data warehouses/lakes.

- Implement data models and schemas that support analytical and reporting requirements.

- Build and maintain robust data APIs for data consumption by various applications and services.

Data Infrastructure :

- Contribute to the architecture and evolution of our data platform, leveraging cloud services (AWS, Azure, GCP) or on-premise solutions.

- Ensure data security, privacy, and compliance with relevant regulations.

- Monitor data pipelines for performance, reliability, and data quality, implementing alerting and anomaly detection.

Collaboration & Optimization :

- Collaborate with data scientists, business analysts, and product managers to understand data requirements and translate them into technical solutions.

- Optimize existing data processes for efficiency, cost-effectiveness, and performance.

- Participate in code reviews, contribute to documentation, and uphold best practices in data engineering.

Troubleshooting & Support :

- Diagnose and resolve data-related issues, ensuring minimal disruption to data consumers.

- Provide support and expertise to teams consuming data from the data platform.

Required Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.

- 3+ years of hands-on experience as a Data Engineer or in a similar role.

- Strong proficiency in at least one programming language commonly used for data engineering (e.g., Python, Java, Scala).

- Extensive experience with SQL and relational databases (e.g., PostgreSQL, MySQL, SQL Server).

- Proven experience with ETL/ELT tools and concepts.

- Experience with data warehousing concepts and technologies (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, Data Bricks).

- Familiarity with cloud platforms (AWS, Azure, or GCP) and their data services (e.g., S3, EC2, Lambda, Glue, Data Factory, Blob Storage, BigQuery, Dataflow).

- Understanding of data modeling techniques (e.g., dimensional modeling, Kimball, Inmon).

- Experience with version control systems (e.g., Git).

- Excellent problem-solving, analytical, and communication skills.

Preferred Qualifications :

- Master's degree in a relevant field.

- Experience with Apache Spark (PySpark, Scala Spark) or other big data processing frameworks.

- Familiarity with NoSQL databases (e.g., MongoDB, Cassandra).

- Experience with data streaming technologies (e.g., Kafka, Kinesis).

- Knowledge of containerization technologies (e.g., Docker, Kubernetes).

- Experience with workflow orchestration tools (e.g., Apache Airflow, Azure Data Factory, AWS Step Functions).

- Understanding of DevOps principles as applied to data pipelines.

- Prior experience in Telecom is a plus.