Forum Discussion

miksingh's avatar
miksingh
Copper Contributor
Nov 11, 2021

Backup Data Lake Gen2

Hi

 

I have a storage with hierarchical namespace enabled, this is for ADLS gen2. The storage is then used to created a delta lake table via Azure Databricks. There is a data factory pipeline, which is inserting data into the ADLS gen (delta lake table), the delta lake table which grow significantly.

 

The challenge is, how can the delta lake table be backed up? Because hierarchical namespace is enabled on the storage account the following data protection features are disabled:

 

Azure Backup

Point-in-time restores for containers

Versioning for blobs

 

The container soft delete is the only data protection feature that is available to use. However this is not an adequate backup technique for this scenario.

No RepliesBe the first to reply