Forum Discussion

SimonHodgkinson0's avatar
SimonHodgkinson0
Copper Contributor
Jun 26, 2024

Using Copilot for Quality Assessment

Hi,
I have an end user that trying to use Copilot for M365 to perform a regular and detailed assessment of incoming policy documents against a set of company guidelines and framework for what makes for a quality written policy document.

I have tried to use a clever combination of prompts in both Word and Chat, linking to both the framework document and document for assessment and of course beginning by asking Copilot to digest the guidelines then provide a comprehensive report on it's findings. However every attempt just produces inconsistent and inadequate results and I don't know if it's the way I'm doing it or if Copilot is just not up to the challenge.

Has anyone got any experience trying the same and if so, what method worked for you? 

  • Luca_Bino's avatar
    Luca_Bino
    Brass Contributor
    can you specify the type of documents (word, pdf ??) you want to use ? Copilot for Word can only access oder word, pptx documents (not yet pdf).

    You can try with a prompt in copilot for word like this "write an assessment of this document /name-of-the-incoming-policy.docx based on our internal specific requirements listed in this /name-of-the-internal-requirements.docx (thsi emans you need to create a wrd document that includes all your internal specific policies
    • SimonHodgkinson0's avatar
      SimonHodgkinson0
      Copper Contributor

      Hi Luca_Bino 

       

      Thanks for that but that's pretty much what I've done.

      I created 2 files, one is the original policy document to be assessed and the other is the entire guidelines for what makes for a good document, tailored to remove anything not needed so that Copilot can fully and easily understand the framework. (Both in Word)

       

      I then created a prompt that says something like 'your job is to ....... This is the framework.......this is the document to be assessed......provide a comprehensive and detailed report on the evaluation.'

       

      I've continuously tweaked this process and what's contained in the framework document but I'm starting to believe that I've done all I can and Copilot is just not up-to-date the task.

      • Luca_Bino's avatar
        Luca_Bino
        Brass Contributor

        SimonHodgkinson0 

        I'd say,don't give up.
        We have had pretty good results with a customer of mine with this procedure.

        Sometimes it takes more energy and an "outside view" to get to the right prompt.


        You probably know this already, but keeping in mind that there are subtile differences when prompting

        E.g
        Translate this text to... VS rewrite this text in....
        Help me create a macro for.... VS write vba code for a macro

        Can you share the exact prompt you are using? Maybe an anonimized version of your documents?

Resources