Forum Discussion
AIP Log Analytics duplicated records
- May 28, 2020Sorry I don't know this particular table, or what logid_g contains. Its possible that its an artefact of a retry, some logs do get multiple rows when there is a retry.
You have answered your own question, if there is a difference then it will be sent (even if the time/date is the same)
- VoTranMay 28, 2020Copper Contributor
Thank you Clive for the answer. But do you have an explanation why the scanned files would have another different logid_g if the AIP scanner has only scanned 1 time in this repository?
- CliveWatsonMay 28, 2020Former EmployeeSorry I don't know this particular table, or what logid_g contains. Its possible that its an artefact of a retry, some logs do get multiple rows when there is a retry.
- CVarleyOct 08, 2020Copper Contributor
Hi CliveWatson,
Like @VoTran I am also seeing duplicate rows in my Log Analytics workspace for AIP. This is from an AIP Scanner job. Every file discovered by the scanner has a duplicate row.
Logid_g looks like some sort of GUID, but I cannot find a complete schema reference for InformationProtectionLogs_CL table (some of the columns are described here: https://docs.microsoft.com/en-us/azure/information-protection/reports-aip)
With the Distinct operator in KQL I've managed to de-dupe the rows for reporting, however it would be fantastic if we could get an explantation for the duplicates and complete schema reference if possible please?