Schedule : Full-Time

Work Location : Bengaluru

Overview :

C5i enables organizations to make the most effective strategic and tactical moves relating to their customers, markets, and competition at the rapid pace that the digital business world demands. Founded in 2000, our business areas include Applied AI, Big Data Analytics, Digital Transformation and Analytics. Rapid advances in Artificial Intelligence and Machine Learning technology have enabled us to create disruptive technologies and accelerators under our C5i suites that combine analytics, digital, and research solutions to provide significant and long-term value to our clients. More information can be found at www.c5i.ai

Global Offices : United States - United Kingdom - United Arab of Emirates - India - Singapore - Canada

Job Summary :

We are seeking an experienced Associate Manager Data Engineering with 5 - 7 years of experience in designing, developing, and managing scalable data engineering solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem, Big Data technologies, data pipelines, and cloud platforms (Azure/AWS).

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Hadoop and related Big Data technologies.

- Work extensively with Hadoop ecosystem technologies such as HDFS, Hive, Spark, and Sqoop.

- Develop and optimize data processing solutions using PySpark/Python and SQL.

- Design and implement data models, data warehouses, and data lakes across Azure and AWS platforms.

- Perform data integration, transformation, cleansing, and optimization for large and complex datasets.

- Monitor and troubleshoot data pipelines and ensure high availability, performance, and data quality.

- Collaborate with business, analytics, and cross-functional teams to understand data requirements and deliver effective solutions.

- Lead data engineering activities and ensure timely delivery in line with quality and project standards.

- Mentor junior data engineers and contribute to technical best practices and knowledge sharing.

Expected Outcomes :

- Successful delivery of scalable and reliable Big Data and data engineering solutions.

- Improved performance and efficiency of data pipelines and processing workflows.

- High-quality, accurate, and reliable data for analytics and business decision-making.

- Effective collaboration with stakeholders and timely resolution of technical issues.

- Contribution to engineering standards, reusable frameworks, and best practices.

Qualifications / Skills & Competencies :

- 5 - 7 years of experience in Data Engineering / Big Data technologies.

- Strong hands-on experience with Hadoop, HDFS, Hive, Spark, PySpark, SQL, and ETL/ELT.

- Proficiency in Python and strong SQL skills.

- Experience working with Azure and/or AWS cloud platforms.

- Good understanding of data warehousing, data lakes, data modeling, and distributed data processing.

- Experience with performance tuning and optimization of large-scale data pipelines.

- Understanding of data quality, governance, and security concepts.

- Strong analytical, problem-solving, communication, and stakeholder management skills.

- Experience mentoring junior team members and taking ownership of data engineering deliverables.

C5i is proud to be an equal opportunity employer. We are committed to equal employment opportunity regardless of race, color, religion, sex, sexual orientation, age, marital status, disability, gender identity, etc. If you have a disability or special need that requires accommodation, please keep us informed about the same at the hiring stages for us to factor necessary accommodations.