Forum Discussion

JeffGanim's avatar
JeffGanim
Copper Contributor
Jan 30, 2025

Request to increase context length

Hello,

 

I think users would greatly appreciate the ability to include more context in prompts. In my experience, results can be dramatically improved if you can include more examples and background information directly in the prompt. While you can attach longer files, this is in my experience not nearly as effective as directly including information in the prompt, as attaching files I assume uses something like RAG to pull snippets of your context instead of the entire thing. This is especially important when including examples as in few-shot prompting. If I want to use Copilot to help me write a longer document, I want to provide multiple already completed examples of this longer document. However, with the context limit of Copilot for M365 I might not even be able to fit one example in the prompt. This is not an issue with ChatGPT which has a much longer context length (128k tokens vs. 16k characters in Copilot).

 

If users are able to write prompts with more context I think they will see much better results and therefore see the value of Copilot for M365 in a much clearer way.

 

Thank you for your consideration.

No RepliesBe the first to reply

Resources