HamburgerMenu
hirist

Job Description

Job Title : Data Engineer

Location : Bangalore, India

Experience : 3 to 6 years

Employment Type : Full-Time


About the Role :


We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and systems that power analytics, business intelligence, and machine learning applications. You will work closely with cross-functional teams to ensure the accuracy, consistency, and accessibility of data across the organization while optimizing workflows for performance and scalability.


Key Responsibilities :


Data Pipeline Development & Management :


- Design, develop, and maintain robust ETL/ELT pipelines to ingest and transform large datasets from various structured and unstructured sources.

- Ensure efficient, scalable, and reliable data flow between systems.


Database Optimization & Data Storage :


- Manage and optimize SQL and NoSQL databases for efficient data storage, retrieval, and processing.

- Implement indexing, partitioning, and query optimization techniques to improve database performance.


Collaboration & Data Integration :


- Work closely with data scientists, analysts, and engineers to integrate data from multiple sources.

- Understand business requirements and deliver data solutions that enable insights and decision-making.


Data Quality & Monitoring :


- Implement data validation, quality checks, and monitoring processes to ensure accuracy and consistency.

- Establish automated alerts and reporting for data anomalies.


Automation & Performance Optimization :


- Automate repetitive data engineering tasks and workflows using scripts or scheduling tools.

- Optimize ETL processes for scalability, performance, and cost-efficiency.


Documentation & Knowledge Sharing :


- Maintain clear, detailed documentation for data workflows, infrastructure, and engineering processes.

- Share best practices and mentor junior team members as needed.


Requirements :


Must-Have :


- Bachelors or Masters degree in Computer Science, Information Technology, or a related field.

- 3 to 6 years of hands-on experience as a Data Engineer or in a similar data-centric role.

- Strong experience with ETL tools like Apache Airflow, Talend, or Informatica.

- Proficiency in SQL and familiarity with NoSQL databases.

- Strong programming skills in Python, Java, or Scala for data processing.

- Solid understanding of data warehousing concepts, schema design, and performance tuning.


Good-to-Have :


- Experience with big data frameworks like Apache Spark, Hadoop, or Flink.

- Familiarity with cloud platforms (AWS/GCP/Azure) and cloud-native data services.

- Knowledge of data modeling and MLOps practices.


info-icon

Did you find something suspicious?