Forum Discussion
Data Quality history
Hi guys,
I would need some help with an easy data import.
I have a table with some history data in it, imported during certain dates (Snapshot_Date).
Some fields in the table are blank at certain import dates and then populated with data. I would like to check this data quality in some way.
For example, 1.png is a sample table with bogus data.
Upon inserting new data into the table tomorrow, for example, I'd like an IF statement (or some other way) that will check if Address field is null, see 2.png.
If Address is null, then add FAILED in the Check_Address field.
If Address is not null, then add PASSED in the Check_Address field.
To insert data into the history table, I'm using a View that gets data from a table with current data, I'm adding GETDATE() that will become Snapshot_Date and that's it.
I tried using IF/Else and Case in my View, but looks like I'm missing something...
Sorted it out, my NULL check was the issue.
3.png is just an example how it looks like with all bogus data, but this will get me started with what I actually need.
Sorted it out, my NULL check was the issue.
3.png is just an example how it looks like with all bogus data, but this will get me started with what I actually need.