Forum Discussion
Weird problem when comparing the answers from chat playground and answer from api
I'm running into a weird issue with Azure AI Foundry (gpt-4o-mini) and need help. I'm building a chatbot that classifies each user message into: follow-up to previous message repeat of an earlier...
The Azure AI Foundry Chat Playground incorporates additional hidden system messages and underlying scaffolding that are not visible in the user interface or included in the “View Code” snippet. These implicit instructions influence and refine the model’s behavior, which accounts for the greater accuracy and consistency often observed in Playground outputs compared to direct API calls. While these hidden prompts cannot be accessed directly, similar results can be achieved by explicitly defining system messages and carefully structuring prompt formatting when working with the API or through LangChain.
Safety system messages - Azure OpenAI in Microsoft Foundry Models | Microsoft Learn