Forum Discussion
Cwill83247
May 30, 2024Copper Contributor
Managing Data for RAG Chatbot
I have up and running a POC for a RAG Chatbot, data has been indexed/vectored. If I need to remove data because the information is now outdated, or say for example products/prices/description c...
PeterMc
Jun 06, 2024Copper Contributor
Cwill83247 I have the exact same question. I have a job scheduled to update my index by referencing a data store pointing to blob storage. I see that it adds data to the index when I have added additional documents to blob storage. However, when I remove documents (or a folder and all its documents) from blob storage, the data remains in the index. This is unexpected behavior. It seems the index is cumulative.
I do not want to create a new index whenever there is a change, so I am not sure what to do.