When the source database
or system can't be changed and there isn't a way to know if data has changed (date modified or other options to check this), in that case checking all the rows is always needed when copying data.
The only rights I will get on the source is read tables. So there is no option to configure cdc or add a trigger or change the source system etc. Just reading tables, that's it.
Rows in the source table are updated, created and deleted. I need an exact copy of this table in the staging.
I hoped that DataVault would solve this, but I couldn't find an answer.
Also tried several options, but nothing beats just copy the complete table every time to the staging area.
Thanks for any advice on this matter.
ps. I am using Kimball methods right now and I am new to Data Vault