HamburgerMenu
hirist

Netscribes - Data Engineer - Hadoop/Python

NETSCRIBES DATA INSIGHTS
Bangalore
5 - 8 Years

Posted on: 20/08/2025

Job Description

About Us :

Were a global leader in providing strategic data and insights to help companies accelerate growth. Founded in 2000, we work with Fortune 500 companies and high-growth startups across sectors like eCommerce, healthcare, technology, and financial services. Our solutions include business research, content services, data analytics, data engineering, and AI/ML.

Key Responsibilities :

- Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.

- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility and fostering data-driven decision making across the organization.

- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

- Writes unit/integration tests, contributes to engineering wiki, and documents work.

- Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.

- Works closely with a team of front-end and backend engineers, product managers, and analysts.

- Defines company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.

- Designs data integrations and data quality framework.

Required Skills & Qualifications :

- BS or MS degree in Computer Science or a related technical field

- 5+ years of experience with Hive, Hadoop, Spark, and data warehouse design

- Hands-on experience in Python, SQL, and PySpark

- Exposure to AWS (S3, EMR) or Azure environments

- Familiarity with DevOps and automation (CI/CD, Docker, etc.)

- Experience working with enterprise reporting and data compliance use cases


info-icon

Did you find something suspicious?