Prompt Engineer - Python/LLM

Job Description :

We are seeking a talented and passionate Prompt Engineer to join our growing team. In this role, you will be at the forefront of leveraging Large Language Models (LLMs) to build cutting-edge applications.

You will design, develop, and optimize production-grade prompts, create complex prompt chains and workflows, and rigorously evaluate and refine LLM outputs.

Your expertise will be crucial in unlocking the full potential of LLMs for a variety of use cases.

What You'll Do :

- Design, develop, and optimize production-grade prompts for various LLMs (GPT, Claude, LLaMA, etc.

- Craft prompts for diverse applications, including retrieval, generation, classification, and more.

- Develop and maintain a library of effective prompts and prompt templates.

- Build and refine complex prompt chains and workflows using LangChain and LangGraph.

- Orchestrate LLM interactions to achieve specific application goals.

- Design and implement robust and scalable prompt-based systems.

- Conduct A/B testing to evaluate and compare prompt performance.

- Implement metrics and methodologies for evaluating LLM output quality.

- Perform performance tuning and optimization of LLM outputs.

- Continuously experiment and iterate on prompts to improve accuracy, relevance, and efficiency.

- Develop a deep understanding of LLM capabilities, constraints, biases, and hallucinations.

- Implement strategies to mitigate LLM limitations and improve reliability.

- Stay up to date with the newest advances in LLM technologies.

- Write clean, efficient, and maintainable Python code for prompt engineering tasks.

- Develop tools and scripts to automate prompt generation, evaluation, and deployment.

- Work in production environments and ensure code quality and reliability.

What We're Looking For :

- 2-5 years of hands-on experience in prompt engineering and LLM fine-tuning.

- Proven track record of designing and optimizing prompts for production applications.

- Strong knowledge of various LLMs (GPT, Claude, LLaMA, etc.) and their behavior.

- Understanding of LLM architectures, training processes, and capabilities.

- Strong Python coding skills and experience working in production environments.

- Experience with libraries such as LangChain and LangGraph.

- Understanding of LLM constraints, biases, and hallucinations, and strategies to mitigate them.

- Ability to identify and address potential issues related to LLM output quality.

- Strong analytical and problem-solving skills, with the ability to evaluate and optimize LLM performance.

- Ability to design and conduct experiments to test prompt effectiveness.

- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

- Ability to clearly communicate complex technical concepts.

- Experience with cloud platforms (e.g. , AWS, Azure, GCP).

- Knowledge of natural language processing (NLP) techniques.

- Experience with data analysis and visualization tools.

- Experience with other LLM frameworks.

- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Linguistics, or a related field