DeDuplication in Content Search

[Bill Diekmann]

I'm having to do more ediscovery and in my latest I wanted to ensure that email was deduplicated before exporting it to a pst. 

The first step (after getting the query built and run) is to generate the Report. Selecting the Deduplication box led me to believe that the process would do exactly that...dedupe. When the report process was complete, the report shows the number of items and size of the extract...and it is the same for the orginal query and after deduplication.

So then I went ahead and generated an export (again selecting deduplication). It created my pst files. After bringing them into Outlook, a very simple look in the first 100 emails....I found 18 duplicates.

Is there something missing in the process to run reports and exports to eliminate duplicate messages )or any object)?

when you are dealing with 250,000 emails, 20% is a large number that I dont have to look at.

[#2]

Duplicates should still be listed in the report file. Are you running the query against a single mailbox or multiple ones?

[#3]

Vasil. I have done this against a single mailbox and multiple mailboxes. In the report generation, you are given the option to deduplicate, I select this option. The report is generated and there are two lines in the report; mailbox object count and size, mailbox object count and size after deduplication. Every report I run, these two rows are always have the same results. 

When exporting, again using the same deduplication option, I open the PST and perform a simple check for duplicates and I always find duplicate emails and calendar objects.

using a third part tool, I typically get a 15-25% reduction of objects after running an export that has been deduped.

[#4 · Accepted solution]

Well I gave it a quick try and I seem to be able to confirm similar behavior. Need to take a more in-depth look to be sure though, but I'd certainly recommend opening a support ticket for this.

[#5]

Hey, did you ever get a response from Microsoft on this one?

---