Yep i agree with prior comments. the external data source issue is a real problem.
Currently also got problems with creation of external tables and views.
- Deployments fail if the target lake location does not exist. okay that's to be expected, but if we've just built a new structure in dev, then that needs to be replicated in uat before this deployment will work.
- View creation fails if there is no actual data in the lake folder and a WITH clause is not specified on the CREATE VIEW.
- Deployment failing due to either NOT NULL is not allowed for external table columns. or NULL is not allowed for external table columns. NULL/NOT NULL are not declared on the CETAS. Unknown reason atm.
So I need to recreate the external data source and need to introduce some other process (manual or automated) to ensure the test lake structure is equivalent to dev, and has 'some' content. After this the deployment may well still fail on some tables.
Microsoft