Forum Discussion

agreca's avatar
agreca
Iron Contributor
Nov 13, 2023

Concerning Consistent Hallucinations

Every once in a while when I try to have BCE provide a page summary for a PDF using the Edge Bar, it'll come up with information about a Korean Room-temperature superconductor (LK-99). I have never s...
General
Privacy & Security
Eric_VanAelstyn's avatar
Eric_VanAelstyn
Icon for Microsoft rankMicrosoft
Thank you for bringing this to our attention. We are currently investigating this.
Eric_VanAelstyn's avatar
Eric_VanAelstyn
Icon for Microsoft rankMicrosoft
Nov 30, 2023
Hi agreca and MikevZ because commercial data protection is applied and chat data isn't stored, we're unable to see exactly what might be triggering Copilot to hallucinate in this way. If you're using Creative mode in Copilot, hallucinations are more likely. We recommend that you switch to Balanced mode in Copilot when asking for a page summarization to get a more accurate response.
  • agreca's avatar
    agreca
    Iron Contributor
    Nov 30, 2023
    Hi Eric_VanAelstyn, I almost always use Precise and this was the case when I received these results.
  • agreca's avatar
    agreca
    Iron Contributor
    Dec 01, 2023

    Hi Eric_VanAelstyn , I am able to almost consistently reproduce this issue with a Statement of Work document that has no mention of this LK-99 superconductor. What's strange is it happens when Copilot is trying to build a reference to info it finds in the document. See below..

     

Resources