Forum Discussion
Weird problem when comparing the answers from chat playground and answer from api
I'm running into a weird issue with Azure AI Foundry (gpt-4o-mini) and need help. I'm building a chatbot that classifies each user message into: follow-up to previous message repeat of an earlier...
I would compare the exact API version, full message array, deployment, temperature, top_p, max_tokens, and any chat history included by the playground. LangChain can also wrap or reorder messages, so test once with the raw Azure OpenAI client only. For classification, use temperature 0, a fixed output schema, and possibly seed for best-effort reproducibility.