Description :

Job Title : Data Engineer

Experience : 5+ Years

Location : Chennai / Hyderabad / Mumbai / Pune / Bangalore (Hybrid)

About the Role :

We are seeking an experienced Data Engineer with strong expertise in Python, SQL, data pipelines, and modern data platforms. In this role, you will design, build, and optimize data solutions that enable reliable, scalable, and high-quality data for analytics, reporting, and machine learning initiatives.

Key Responsibilities :

1. Data Pipeline & Architecture Development :

- Design, develop, and maintain scalable and efficient ETL/ELT pipelines across cloud/on-prem ecosystems.

- Set up and manage data lakes, data warehouses, and other storage systems using industry best practices.

- Ensure smooth data ingestion, processing, transformation, and availability across the organization.

2. Programming & Data Engineering Expertise :

- Utilize strong Python programming skills to build data engineering solutions and automation scripts.

- Work with SQL extensively for data extraction, transformation, optimization, and quality checks.

- Implement data scrubbing, validation, and quality processes to maintain integrity and accuracy.

3. Platform & Tool Proficiency :

- Work with the Databricks platform for large-scale data processing.

- Use big-data technologies such as Apache Spark and Hadoop for distributed computation.

- Evaluate, adopt, and integrate new tools and platforms to enhance the data engineering ecosystem.

4. Collaboration & Communication :

- Collaborate with data scientists, analysts, software engineers, and business teams to understand data needs.

- Translate complex technical concepts into clear, actionable insights for non-technical stakeholders.

- Play an active role in improving workflows, data reliability, and engineering standards.

5. Documentation & Best Practices :

- Maintain detailed documentation of pipelines, workflows, processes, and systems.

- Promote best practices for coding, testing, automation, and data management.

- Contribute to improving team knowledge, standards, and efficiency.

Must-Have Qualifications :

- Bachelors or Masters degree in Computer Science, Data Science, Information Technology, or related fields.

- Minimum 4+ years of hands-on experience as a Data Engineer.

- Strong proficiency in Python and SQL.

- Experience with Databricks, data pipelines, and data warehouse/lake setups.

- Working knowledge of Apache Spark, Hadoop, and other big-data technologies.

- Strong analytical thinking, problem-solving skills, and attention to detail.

Nice-to-Have Skills :

- Experience with cloud platforms: AWS / Azure / GCP.

- Familiarity with PySpark and large-scale data transformations.

- Exposure to Docker, Kubernetes, or other containerization tools.

- Knowledge of data visualization tools like Tableau, Power BI.

- Relevant certifications in data engineering or machine learning.