Seeking an understanding about migrating Application Insights to Log Analytics Workspace

%3CLINGO-SUB%20id%3D%22lingo-sub-2804484%22%20slang%3D%22en-US%22%3ESeeking%20an%20understanding%20about%20migrating%20Application%20Insights%20to%20Log%20Analytics%20Workspace%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2804484%22%20slang%3D%22en-US%22%3E%3CP%3EConcerning%20the%20following%3A%3CBR%20%2F%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-monitor%2Fapp%2Fconvert-classic-resource%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Ehttps%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-monitor%2Fapp%2Fconvert-classic-resource%3C%2FA%3E%3C%2FP%3E%3CP%3E%3CBR%20%2F%3EI'm%20looking%20to%20understand%20more%20about%20the%20impacts%20of%20migrating%20existing%20Application%20Insights%20based%20logs%20to%20an%20Azure%20Monitor%20%22Log%20Analytics%20Workspace%22%20resource.%26nbsp%3B%20At%20my%20company%20we%20already%20have%20quite%20a%20few%20dashboards%2C%20queries%2C%20and%20alerts%20built%20against%20the%20existing%20App%20Insights%20solution.%26nbsp%3B%20I%20fear%20that%20the%20migration%20of%20logs%20will%20break%20all%20of%20these.%26nbsp%3B%20For%20example%2C%20%22customEvents%22%20will%20become%20%22AppEvents%22%20and%20that%20will%20may%20break%20many%20things%20according%20to%20this%3A%3CBR%20%2F%3E%3CBR%20%2F%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-monitor%2Fapp%2Fapm-tables%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Ehttps%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-monitor%2Fapp%2Fapm-tables%3C%2FA%3E%3CBR%20%2F%3E%3CBR%20%2F%3EAm%20I%20understanding%20correctly%3F%26nbsp%3B%20Can%20anyone%20advise%20an%20upgrade%20path%20that%20won't%20break%20things%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWhen%20you%20try%20to%20migrate%20an%20App%20Insights%20resource%20you%20get%20a%20message%20that%20says%20%22%3CSPAN%3ETelemetry%20stored%20in%20both%20locations%20will%20be%20merged%20when%20making%20queries.%22.%26nbsp%3B%20Can%20anyone%20clarify%20this%3F%26nbsp%3B%20Does%20that%20mean%20we%20can%20continue%20using%20the%20old%20saved%20queries%20and%20dashboards%20within%20App%20Insights%20and%20they%20will%20continue%20to%20function%20after%20the%20migration%20(but%20reading%20the%20new%20Workspace)%3F%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EIs%20it%20possible%20to%20start%20feeding%20logs%20to%20the%20Workspace%20in%20parallel%20while%20still%20feeding%20them%20into%20the%20old%20App%20Insights%20solution%3F%26nbsp%3B%20This%20would%20allow%20us%20to%20gradually%20convert%20our%20queries%20and%20dashboards%20to%20the%20new%20Workspace%20without%20instantly%20breaking%20them%20all%20in%20an%20instant%2C%20and%20then%20perform%20the%20full%20migration%20only%20when%20done%20the%20updates.%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EIs%20there%20a%20way%20to%20identify%20all%20saved%20log%20queries%20and%20log%20usages%20in%20Azure%3F%26nbsp%3B%20We%20have%20many%20teams%20and%20resources%20in%20use%20and%20may%20have%20unknown%20log%20usages%20we%20don't%20want%20to%20miss.%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EThank%20you%2C%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EJonathan%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2804484%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EApplication%20Insights%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3ELog%20Analytics%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EMetrics%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2861913%22%20slang%3D%22en-US%22%3ERe%3A%20Seeking%20an%20understanding%20about%20migrating%20Application%20Insights%20to%20Log%20Analytics%20Workspace%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2861913%22%20slang%3D%22en-US%22%3EAn%20update.%20I%20ran%20a%20number%20of%20experiments%20to%20test%20the%20migration%20procedure%20from%20the%20classic%20App-Insights%20to%20the%20new%20Log%20Analytics%20Workspace%20way%20of%20doing%20things.%20Within%20a%20Sandbox%20environment%20I%20created%20the%20classic%20App-Insights%20resource%2C%20fed%20logs%20into%20it%2C%20performed%20the%20migration%2C%20and%20then%20fed%20more%20logs.%20Repeatedly%2C%20after%20the%20migration%20was%20performed%20there%20were%20a%20considerable%20number%20of%20logs%20missing%20from%20the%20new%20Workspace.%20Feeding%20brand%20new%20logs%20into%20the%20system%2C%20the%20new%20log%20entries%20would%20all%20appear%20in%20the%20classic%20environment%20but%20only%2025%25%20of%20the%20logs%20would%20show%20in%20the%20new%20Workspace.%20I%20ran%20this%20test%20multiple%20times%20to%20confirm%20the%20results%20(completely%20setting%20up%20a%20new%20environment%20every%20time).%3CBR%20%2F%3E%3CBR%20%2F%3EWe%20then%20created%20a%20brand%20new%20Azure%20subscription%20specifically%20to%20test%20this.%20Within%20this%20brand%20new%20subscription%20we%20encountered%20exactly%20the%20same%20problem%20again%20-%20after%20the%20migration%20was%20performed%2075%25%20of%20all%20new%20logs%20did%20NOT%20appear%20in%20the%20new%20Log%20Analytics%20Workspace%2C%20while%20still%20showing%20up%20in%20the%20classic%20environment.%20There%20was%20no%20clear%20pattern%20which%20log%20entries%20were%20missing%20(such%20as%20only%20info%20logs%20were%20missing%20while%20errors%20were%20present).%20It%20was%20a%20blanket%20loss%20of%2075%25%20of%20all%20log%20data.%20I%20created%20a%20support%20ticket%20with%20Microsoft%20to%20get%20help%20as%20I%20had%20run%20out%20of%20options.%20Despite%20the%20SLA%20saying%20they'd%20respond%20within%204%20hours%20it's%20been%20nearly%20a%20week%20now%20with%20no%20response%20from%20Microsoft.%3CBR%20%2F%3E%3CBR%20%2F%3EHowever%2C%20I%20discovered%20something%20else.%20After%20a%20few%20days%20the%20new%20Log%20Analytics%20Workspace%20environment%20appears%20to%20begin%20working%20correctly.%20I'm%20now%20able%20to%20feed%20new%20logs%20in%20and%20can%20see%20those%20new%20log%20entries%20appear%20in%20the%20new%20Workspace%20100%25%20matching%20the%20classic%20environment.%20Could%20it%20be%20that%20this%20problem%20only%20exists%20for%20new%20log%20entries%3F%20How%20long%20does%20it%20take%20before%20it%20%22warms%20up%22%20and%20functions%20properly%20after%20a%20migration%20is%20performed%3F%20I%20hate%20not%20being%20able%20to%20explain%20the%20missing%20log%20entries%20even%20if%20it%20eventually%20functions.%3CBR%20%2F%3E%3CBR%20%2F%3EJonathan%3C%2FLINGO-BODY%3E
New Contributor

Concerning the following:
https://docs.microsoft.com/en-us/azure/azure-monitor/app/convert-classic-resource


I'm looking to understand more about the impacts of migrating existing Application Insights based logs to an Azure Monitor "Log Analytics Workspace" resource.  At my company we already have quite a few dashboards, queries, and alerts built against the existing App Insights solution.  I fear that the migration of logs will break all of these.  For example, "customEvents" will become "AppEvents" and that will may break many things according to this:

https://docs.microsoft.com/en-us/azure/azure-monitor/app/apm-tables

Am I understanding correctly?  Can anyone advise an upgrade path that won't break things?

 

When you try to migrate an App Insights resource you get a message that says "Telemetry stored in both locations will be merged when making queries.".  Can anyone clarify this?  Does that mean we can continue using the old saved queries and dashboards within App Insights and they will continue to function after the migration (but reading the new Workspace)?

 

Is it possible to start feeding logs to the Workspace in parallel while still feeding them into the old App Insights solution?  This would allow us to gradually convert our queries and dashboards to the new Workspace without instantly breaking them all in an instant, and then perform the full migration only when done the updates.

 

Is there a way to identify all saved log queries and log usages in Azure?  We have many teams and resources in use and may have unknown log usages we don't want to miss.

 

Thank you,

 

Jonathan

1 Reply
An update. I ran a number of experiments to test the migration procedure from the classic App-Insights to the new Log Analytics Workspace way of doing things. Within a Sandbox environment I created the classic App-Insights resource, fed logs into it, performed the migration, and then fed more logs. Repeatedly, after the migration was performed there were a considerable number of logs missing from the new Workspace. Feeding brand new logs into the system, the new log entries would all appear in the classic environment but only 25% of the logs would show in the new Workspace. I ran this test multiple times to confirm the results (completely setting up a new environment every time).

We then created a brand new Azure subscription specifically to test this. Within this brand new subscription we encountered exactly the same problem again - after the migration was performed 75% of all new logs did NOT appear in the new Log Analytics Workspace, while still showing up in the classic environment. There was no clear pattern which log entries were missing (such as only info logs were missing while errors were present). It was a blanket loss of 75% of all log data. I created a support ticket with Microsoft to get help as I had run out of options. Despite the SLA saying they'd respond within 4 hours it's been nearly a week now with no response from Microsoft.

However, I discovered something else. After a few days the new Log Analytics Workspace environment appears to begin working correctly. I'm now able to feed new logs in and can see those new log entries appear in the new Workspace 100% matching the classic environment. Could it be that this problem only exists for new log entries? How long does it take before it "warms up" and functions properly after a migration is performed? I hate not being able to explain the missing log entries even if it eventually functions.

Jonathan