SOLVED

How to delete table under CustomLogs ingested using HTTP Datacollector API?

Microsoft

Hi,

 

How to delete the customLog table ? 

I have created a custom log table using HTTP Datacollector API. How do I delete the table later?

I even could not see my custom log table under Advanced settings -> Data -> Custom Logs.

However I can query on the custom log table in Log search.

Also, What is the retention policy of the data ingested using HTTP Datacollector API?

 

Thanks.

 

5 Replies
best response confirmed by Stanislav Zhelyazkov (MVP)
Solution

Hi,

First the retention policy of custom data is the retention policy of any data in your Log Analytics workspace. By default workspace have retention of 31 days but that is configurable setting so it depends on what you have changed it to if you had at all. You can remove the custom log from Log Analytics blade - > Advanced Settings - > Data -> Custom Fields. There you can see all your custom fields for your custom log data. Once you remove the custom fields for the custom log, when you query the custom log you will get only records with Time Generated. Deleting data from Log Analytics is also possible but be careful. Read the instructions carefully:

https://docs.microsoft.com/en-us/azure/azure-monitor/platform/personal-data-mgmt

 

The menu that you are describing is for custom logs feature but not for logs from Ingestion API.

@Vino55 This has bothered me for years, and surprise - MS quietly added an API for this last March: https://docs.microsoft.com/en-us/rest/api/loganalytics/data%20collector%20logs%20(preview)/delete

 

 

Great find but when deleting the log using that API the old data still exists if I create the table again.

@Craig635 

How long did you wait before re-creating?  I think I noticed this too, but if I waited long enough, it was gone for good.

Waited a few hours, no luck. trying the Purge API now, it returns an HTTP 202 response that lets you then GET the status of the operation. That one has been pending for hours.
1 best response

Accepted Solutions
best response confirmed by Stanislav Zhelyazkov (MVP)
Solution

Hi,

First the retention policy of custom data is the retention policy of any data in your Log Analytics workspace. By default workspace have retention of 31 days but that is configurable setting so it depends on what you have changed it to if you had at all. You can remove the custom log from Log Analytics blade - > Advanced Settings - > Data -> Custom Fields. There you can see all your custom fields for your custom log data. Once you remove the custom fields for the custom log, when you query the custom log you will get only records with Time Generated. Deleting data from Log Analytics is also possible but be careful. Read the instructions carefully:

https://docs.microsoft.com/en-us/azure/azure-monitor/platform/personal-data-mgmt

 

The menu that you are describing is for custom logs feature but not for logs from Ingestion API.

View solution in original post