Forum Discussion
Pedro Correa
Jun 03, 2021Brass Contributor
When to use and how to get querying proficiency
Alright, I will try to be short here but anyone let me know if more info is needed. We had this new project started 3 months ago, that was increasing the amount of data it was going inside our Elast...
liamca-msft
Microsoft
Hi Pedro, let me start with Q1. You are correct that pushing content and doing batching will be the most optimal way of getting content into the search service quickly. Just as a side note, the S2 and higher is backed by premium storage which also allows indexing to happen faster. However, the added cost does not always warrant the increase perf. You might also be interested in this code that we have for optimizing indexing performance that helps understand optimal batch sizes. https://github.com/Azure-Samples/azure-search-dotnet-samples/tree/master/optimize-data-indexing
In addition, please keep in mind that you can also parallelize uploads which can allow you to push data even fasters. However, if you do this it is important to keep track of throttling and back off exponentially if you start seeing this. The above sample helps walk through this as well.
Hope that helps!
Liam
In addition, please keep in mind that you can also parallelize uploads which can allow you to push data even fasters. However, if you do this it is important to keep track of throttling and back off exponentially if you start seeing this. The above sample helps walk through this as well.
Hope that helps!
Liam
Pedro Correa
Jun 03, 2021Brass Contributor
Thank you Liam, I will look into this example more.