I’m looking for advise with pros / cons on the following:
data > azure event hub > databricks structured streaming > delta lake (bronze)
data > azure event hub > event hub capture to Azure Data Lake gen 2 > Databricks Autoloader > delta lake(bronze)
Azure event hub has only 7 day retention.
The need is not on realtime but more batch with trigger once and schedule