Dec 14 2018 07:25 AM - edited Dec 14 2018 07:36 AM
I have two customers that want to use Azure Data Explorer and I am unsure how to size their system to get costs:
Thanks,
Adam
Dec 14 2018 07:50 AM
When choosing which data gets stored as hot and which gets stored as cold, it's important to understand the scenario and the query patterns. it's also important to note that Cache policy does not make Kusto a cold storage technology
for the first customer, 5GB is a low enough volume to estimate that a minimum sized cluster will do just fine to begin with.
regarding the scale of the larger customer's cluster -
1. ingestion capacity scales linearly with the number of nodes in the cluster.
2. having a larger volume of "hot" data (stored on SSD) will potentially require increasing the size of the cluster, if the data compressed size of the data which is required for interactive queries can't "fit" within the capacity of the cluster.
3. Choosing the L16 option will potentially be more cost efficient for a such a data-bound cluster.