ADF not able to delete rows in Delta Lake

Copper Contributor

I have created at DataFlow that deletes rows in a Delta Lake. The Pipeline executes fine, but nothing has been removed from the delta lake. What am I doing wrong?

 

knoerregaard_0-1648137691777.png

 

knoerregaard_1-1648137701788.png

knoerregaard_3-1648137726113.png

 

 

 

2 Replies
by the way, Inserts and updates works fine
Are you referring to the correct version of the delta table after the delete ?
The data is still present in the older version and also physically present in the storage, see documentation links below -->

Important
https://docs.delta.io/latest/delta-update.html -->
delete removes the data from the latest version of the Delta table but does not remove it from the physical storage until the old versions are explicitly vacuumed. See vacuum for details.

https://docs.delta.io/latest/delta-utility.html#-delta-vacuum