HamburgerMenu
hirist

Lead Data Engineer

knowledge Artisan
Anywhere in India/Multiple Locations
4 - 8 Years

Posted on: 17/09/2025

Job Description

Role Overview :


We are seeking an experienced Lead Data Engineer to design, develop, and scale data infrastructure while mentoring a team of engineers. The role involves collaborating with cross-functional teams, defining data requirements, and driving AI-powered data solutions that deliver high impact.

Key Responsibilities :


- Design and optimize SQL Server database architectures for performance, scalability, and high availability.

- Build and maintain data pipelines & ETL processes for large-scale integration.

- Implement DevOps practices (CI/CD automation) for data workflows.

- Develop and oversee Python-based applications for analytics and AI model deployment.

- Collaborate with data scientists to enable AI-driven insights and solutions.

- Ensure data governance, compliance, and security across data platforms.

- Research and adopt new technologies to enhance infrastructure efficiency.

Requirements :

- 10+ years of experience in data engineering / database development

- 2+ years of team leadership or management experience

- Strong expertise in SQL Server (performance tuning, indexing, HA)

- Advanced Python skills (Pandas, NumPy, PySpark, SQLAlchemy, APIs)

- Experience with DevOps (Azure DevOps/GitHub Actions), CI/CD, Docker, Kubernetes

- Proficiency in cloud platforms (Azure preferred)

- Knowledge of real-time data processing (Kafka, Spark Streaming)

- Strong knowledge of data modeling & data warehousing

- Excellent communication and collaboration skills

Bonus Skills :


- Certifications (Azure Data Engineer / DevOps Engineer)

- Familiarity with MLOps tools (MLflow, Kubeflow)

- Knowledge of AI/ML frameworks (TensorFlow, PyTorch, scikit-learn)

- Experience with web scraping (Beautiful Soup, Scrapy, Selenium)

Why join us ?

- Lead impactful projects with AI & cloud-first data solutions

- Work fully remote with a collaborative, innovative team

- Opportunities for continuous learning & growth in modern data tech


info-icon

Did you find something suspicious?