Data Engineer - Python/SQL/ETL

Overview :

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures that enable data-driven decision-making. The ideal candidate will have strong expertise in data modeling, ETL/ELT processes, cloud platforms, and big data technologies, ensuring high-quality, accessible, and reliable data for analytics and business intelligence.

Key Responsibilities :

- Design, develop, and maintain data pipelines and ETL/ELT workflows for structured and unstructured data.

- Build scalable, high-performance data architectures to support analytics, reporting, and AI/ML initiatives.

- Integrate data from multiple sources, including databases, APIs, and streaming platforms.

- Ensure data quality, consistency, and reliability across systems.

- Optimize SQL queries and database performance for large-scale datasets.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.

- Implement data governance, security, and compliance standards.

- Monitor and troubleshoot data systems, resolving any data-related issues promptly.

Required Skills & Qualifications :

- 3 to 7 years of experience in data engineering or related roles.

- Strong proficiency in SQL and experience with relational and NoSQL databases (PostgreSQL, MySQL, MongoDB, Cassandra, etc.).

- Experience with ETL/ELT tools (e.g., Apache NiFi, Talend, Informatica, Airflow, or similar).

- Knowledge of big data technologies (Hadoop, Spark, Kafka, etc.).

- Proficiency in Python, Java, or Scala for data processing.

- Experience with cloud platforms (AWS, Azure, GCP) and data services (Redshift, BigQuery, Snowflake).

- Strong problem-solving skills and ability to work in cross-functional teams.

- Excellent communication skills for technical and non-technical collaboration.

Preferred Skills :

- Experience with real-time streaming data pipelines.

- Knowledge of data warehousing, data lakes, and lakehouse architectures.

- Familiarity with CI/CD for data workflows.

- Understanding of data privacy regulations (GDPR, HIPAA, etc.).