Forum Discussion

ArifSyedUK's avatar
ArifSyedUK
Copper Contributor
Nov 16, 2021

IoT Central Export to Data Lake (Blob)

Hi,

does anyone know the logic behind the partition-id that is created on the Azure Blob storage as part of the folder structure

 {container}/{app-id}/{partition_id}/{YYYY}/{MM}/{dd}/{hh}/{mm}/{filename}

 

I seem to have 2 devices that share the same Model-ID (Template) and their Telemetry data is written to the same files under the same partition-id folder.

 

Thanks

 

IoT Central Ready

3 Replies

  • Mijinifresh's avatar
    Mijinifresh
    Copper Contributor
    Jul 07, 2022
    Also (and perhaps i am on the wrong path) you can split data into different containers / partitions based on what property you want to split the data message stream into
  • Mijinifresh's avatar
    Mijinifresh
    Copper Contributor
    Jul 07, 2022
    Did you get a response for this? Have you tried routing to split the data for the devices (though this may be inefficient for large scale deployments)
  • Andirly's avatar
    Andirly
    Copper Contributor
    Mar 22, 2022
    Hey,

    I can't provide a solution here but i'd be also very interested in the logic behind the partion id.

    To better use the exported data later on, it'd be make way more sense to name the virtual folder after the Device Id...

    Otherwise I have to look through the blobs to find the correct telemetry which causes overhead.

    Hope someone can help here.

Resources