Forum Discussion
Azure not collecting custom log data
Hi, found the problem.
my VM network settings are blocking both inbound and outbound internet connection, which making the agent cannot collecting my custom log.
for people who having the same problem this work out for me:
1. set a proxy server for your VM to connect to the internet.
2. connect your VM to that proxy server
3. set up your agent to also connect using those proxy
and monitor will collect custom log normally.
CliveWatson thanks a lot for your help mate, appreciate it!
regards,
If you can rule out latency https://docs.microsoft.com/en-us/azure/azure-monitor/platform/data-ingestion-time and you have refreshed your browser?
I'd try a craft from scratch a simple log file in case some data in the example you are trying to send is causing an issue - control chars etc.... 1hr is the norm, maybe up to 8.
The criteria are really key, it sounds like you've checked already, but I've been caught out with the datetime format before...just this week I had a log with the right date format but the time was "." separated.
The log files to be collected must match the following criteria.
-
The log must either have a single entry per line or use a timestamp matching one of the following formats at the start of each entry.
YYYY-MM-DD HH:MM:SS
M/D/YYYY HH:MM:SS AM/PM
Mon DD, YYYY HH:MM:SS
yyMMdd HH:mm:ss
ddMMyy HH:mm:ss
MMM d hh:mm:ss
dd/MMM/yyyy:HH:mm:ss zzz
yyyy-MM-ddTHH:mm:ssK -
The log file must not allow circular logging or log rotation, where the file is overwritten with new entries.
-
The log file must use ASCII or UTF-8 encoding. Other formats such as UTF-16 are not supported.
I've tried and change my date format into YYYY-MM-DD just like you suggested.
but the result is same, log analytics workspace are showing my custom log name on the schema, but the data are not collected from my machine.
I don't think that the date format is the problem here, because when I tried to upload my sample files, the custom log wizard can read my files without problem.
- I just tried your file, both as a NEWLINE and a Date delimited custom log - with both date formats, and they both appeared in my workspace within 1hr (in West Europe)
Hi, found the problem.
my VM network settings are blocking both inbound and outbound internet connection, which making the agent cannot collecting my custom log.
for people who having the same problem this work out for me:
1. set a proxy server for your VM to connect to the internet.
2. connect your VM to that proxy server
3. set up your agent to also connect using those proxy
and monitor will collect custom log normally.
CliveWatson thanks a lot for your help mate, appreciate it!
regards,
- No problem, and thanks for taking the time to provide a resolution and feedback. Cheers Clive