Forum Discussion
How to Parse Fields on Data Ingest for CSV?
I have a 1.2GB CSV file (updates every month) that I want to ingest into a table. But I need to parse fields on data ingest rather than at query time. Custom fields doesn't seem to work for delimited...
Is there a way to use the split() command to parse the data on ingest into a custom field? I can't do it at query time due to the way I need to use the data.
It seems very strange to me that this parsing works perfectly as an externaldata table but I can't upload the same data to a permanent table easily.
It seems very strange to me that this parsing works perfectly as an externaldata table but I can't upload the same data to a permanent table easily.
Take a look at this and see if it will work for you: https://docs.microsoft.com/en-us/azure/sentinel/configure-data-transformation