thank you so much JohnAziz for your comments, so valuable. A step further:
A real-life RAG flows.
A very simple scenario User asks: Give me the top 5 takeaways "search phrase" (e.g. MS keynote)
The code behind it runs an Azure AI search and returns five relevant documents - that are passed via a prompt including the user's original question to the AI.
The AI answers with a text with the top 5 takeaways And this is where most examples on the internet end
How do to handle the following question from the user: Give me 5 more takeaways
If you ran an Azure search with this phrase, you will not for sure get anything relevant to the original question, or do you pass this question straight to AI where you include chat history, the original question, original RAG and AI answer? If we do this, what if the user asked something completely different as the follow up question, e.g. what was the hottest topic of the 2022 keynote? Without passing it to Azure AI search we will not have context
And the last question, when we pass the history of the conversation do we pass just User questions and Agent answers or all every RAG?
thanks