Lead Artificial Intelligence Engineer - RAG/LLM

Description :

Responsibilities :

- Develop and implement advanced Generative AI solutions (LLMs, embeddings, retrieval techniques, prompt engineering).

- Design and optimize Retrieval-Augmented Generation (RAG) solutions.

- Manage Databricks workflows, including job and cluster creation as well as Databricks API.

- Apply data structures and algorithms knowledge, including multiprocessing and optimization techniques.

- Utilize Python libraries (Pandas, Numpy, FastAPI) for data processing and API development.

- Perform SQL optimization and database architecture design (schema creation, normalization, functions, triggers).

- Deploy and orchestrate AI models using Docker and Kubernetes.

- Collaborate using GitHub for version control and team collaboration.

- Work with cloud platforms for AI solution deployment and management (Azure, GCP, AWS).

- Utilize PySpark for data processing (optional).

Requirements :

- Experience of 6- 10 years in the development and deployment of scalable AI/ML solutions.

- Has strong execution knowledge of Data Modeling, Databases in general (SQL and NoSQL), software development lifecycle and practices, unit testing, functional programming, etc.

- Basic understanding of CI/CD pipelines and deployment process.