AI Discord - Community Roundtable #5 - Working With Open LLMs 

 

Thanks for everyone who joined our live session with Sharmila and Facundo on working with LLMs. This was part of our series in the AI Community Discord where we host community roundtables every 2 weeks on a Generative AI topic that is voted on by the community. 

 

This week we discussed working with Open LLMs including Mistral and Llama2. Our speakers walked us through what they are seeing in terms of how teams are blending OpenAI models + Open LLMs, how to work with these modes in Azure AI Studio and we saw a demo of using Prompt Flow to evaluate different models on one prompt. 

 

Recording

Here is the recording. (Apologies for audio problems at the start) 

 

Additional Resources

Explore the model catalog in Azure AI Studio

Develop a flow using Prompt Flow

Tune prompts using variants