Forum Discussion
How to Parse Fields on Data Ingest for CSV?
I have a 1.2GB CSV file (updates every month) that I want to ingest into a table. But I need to parse fields on data ingest rather than at query time. Custom fields doesn't seem to work for delimited...
Not sure why you would not be able to separate the data using a delimiter using the split() command. Is it possible to paste some of the cleaned up data?
- Is there a way to use the split() command to parse the data on ingest into a custom field? I can't do it at query time due to the way I need to use the data.
It seems very strange to me that this parsing works perfectly as an externaldata table but I can't upload the same data to a permanent table easily.- Take a look at this and see if it will work for you: https://docs.microsoft.com/en-us/azure/sentinel/configure-data-transformation
