QBrainX - AI Data Engineering Lead

AI Data Engineering Lead

Experience : 6 to 10 Years

Job Location : Onsite Coimbatore (Mandatory)

Employment Type : Full-Time

About the Role :

We are seeking an experienced AI Data Engineering Lead to architect, build, and optimize scalable data solutions that enable advanced analytics and AI-driven insights. This role requires deep expertise in modern data engineering tools and cloud platforms, with the ability to lead end-to-end data pipeline development in a fast-paced environment.

Key Responsibilities :

- Design, develop, and deploy robust, scalable, and high-performance data pipelines.

- Manage and optimize data workflows using DBT and orchestration tools like Airflow or Prefect.

- Work extensively with Snowflake, BigQuery, and SQL for data transformation, warehousing, and modeling.

- Write clean, efficient, and maintainable Python code for data processing and integration tasks.

- Collaborate with cross-functional teams (Data Science, Product, Engineering) to gather requirements and deliver high-quality data solutions.

- Monitor, troubleshoot, and optimize data pipelines in production environments.

- Ensure data quality, consistency, security, and governance across systems.

- Contribute to architectural decisions and best practices for scalable data systems.

Required Skills & Experience :

- 6 to 10 years of experience in Data Engineering or related fields.

- Strong expertise in SQL, Snowflake, BigQuery, DBT, and Python.

- In-depth understanding of data warehousing, ETL/ELT processes, and data modeling.

- Hands-on experience working with GCP (Google Cloud Platform).

- Experience using workflow orchestration tools (Prefect or Airflow).

- Working knowledge of Terraform and Infrastructure as Code (IaC).

- Proficient with Git for version control and collaborative development.

- Excellent analytical, problem-solving, and debugging skills.

- Strong communication skills and ability to work effectively in a collaborative environment.