Lead Data Engineer/Architect - ETL/Python

Description :

Job Summary :

We are seeking a highly skilled Lead Data Engineer & Data Architect to lead the design, development, and optimization of large-scale data solutions.

The ideal candidate will have extensive experience in SQL, Python, BigQuery, and Big Data technologies, along with the ability to architect scalable and high-performance data pipelines and platforms.

Key Responsibilities :

- Lead the design, development, and deployment of enterprise-level data architecture and pipelines.

- Mentor and guide data engineering teams in best practices for ETL, data modeling, and Big Data processing.

- Write, test, and optimize complex SQL queries for large-scale data analytics.

- Manage and optimize BigQuery implementations, including internal/external tables, partitioning, clustering, and performance tuning.

- Architect end-to-end data solutions for ingestion, transformation, and storage, ensuring scalability, reliability, and security.

- Develop Python-based applications and automation scripts to support data engineering workflows.

- Collaborate with business stakeholders, data scientists, and analytics teams to translate requirements into technical solutions.

- Stay updated with emerging data technologies and recommend adoption where appropriate.

Must-Have Skills :

SQL :

- Advanced expertise in reading, writing, testing, and maintaining complex queries.

BigQuery :

- Strong hands-on experience, including internal/external tables, partitioning, clustering, and performance optimization.

Python :

- Proficient in developing applications and scripts for data engineering tasks.

Big Data Engineering :

- Proven experience in large-scale Big Data projects and architectures.

Data Architecture :

- Experience in designing scalable, high-performance data models and solutions.