HamburgerMenu
hirist

Senior Data Engineer - Python/Spark

CAPITALNUMBERS INFOTECH LIMITED
Any Location
10 - 12 Years
star-icon
4.2white-divider561+ Reviews

Posted on: 06/01/2026

Job Description

Description :

We are seeking a highly experienced Senior Data Engineer to support a Media ROI analytics project.

This role requires a strong hands-on data engineering professional who can also function as an analytical partner, with a deep understanding of CPG (Consumer Packaged Goods) market data and media performance metrics.

The ideal candidate will bring extensive experience designing and building cloud-based data platforms while collaborating closely with analytics and business stakeholders.

Key Responsibilities :

- Design, build, and maintain scalable, cloud-based enterprise data warehouses and data pipelines to support Media ROI and CPG analytics use cases.

- Partner with analytics and business stakeholders to understand media, marketing, and CPG business requirements and translate them into robust data solutions.

- Develop and optimize data pipelines using Snowflake, Databricks, Spark, and cloud-native services across AWS and Azure.

- Create and maintain complex SQL-based analytical models, business queries, and reporting datasets to enable deep insights into media performance and ROI.

- Integrate and process large-scale structured and semi-structured datasets using Big Data technologies.

- Ensure data quality, performance optimization, security, and governance across data platforms.

- Support downstream analytics, reporting, and advanced modeling teams by delivering well-structured, analytics-ready data.

- Provide technical leadership, best practices, and guidance on data engineering and cloud architecture.

Required Skills & Experience :

- 10+ years of overall experience in data engineering and analytics.

- Proven experience building cloud-based enterprise data warehouses and reporting platforms on AWS and Azure.

- Strong expertise in Snowflake, including data modeling, performance tuning, and optimization.

Extensive experience with Big Data architectures and tools, including :

- Hadoop File System (HDFS).

- Spark (Spark SQL, PySpark).

- Hive.

- Strong programming and query skills in SQL, Python, Postgres, and related technologies.

- Hands-on experience with Azure Databricks and the broader Azure data ecosystem.

- Deep experience working across both AWS and Azure stacks.

- Expertise in writing and optimizing complex business queries to support advanced analytical scenarios.

- Strong analytical mindset with the ability to understand and interpret CPG market data, media data, and performance metrics.

Preferred Qualifications :

- Experience supporting Media ROI, marketing analytics, or digital media measurement initiatives.

- Experience working in cross-functional or stakeholder-facing environments.

- Strong communication skills with the ability to explain complex technical concepts to non-technical audiences.


info-icon

Did you find something suspicious?

Similar jobs that you might be interested in