Hello,
I'm currently working with a customer that's utilizing File Channel (FC) to move data into The Cloud. They're using FC because of it's one-to-many functionality.
Because one Target endpoint will be feeding many tasks we can't have "Delete processed files" enabled. Because of this we need a method for removing processed files.
We have learnt that there's a naming convention for Full Load files so we can safely delete them:
And:
So, my question is: does anyone have any experience creating scripts/processes for removing processed CDC files?
Thanks in advance,
Nigel.
I'm currently working with a customer that's utilizing File Channel (FC) to move data into The Cloud. They're using FC because of it's one-to-many functionality.
Because one Target endpoint will be feeding many tasks we can't have "Delete processed files" enabled. Because of this we need a method for removing processed files.
We have learnt that there's a naming convention for Full Load files so we can safely delete them:
Code:
The first 8 numbers in the directory name are the id of the table and the last numbers are timestamp in hex. If you look at the replicate log you can see that every table gets a unique numeric id.
For example, in the following message from the log:
00004256: 2017-08-15T16:12:55 [TASK_MANAGER ]I: Start loading table 'TEST'.'NATION' (Id = 2) by subtask 2. Start load timestamp 000556CA8973BF40 (replicationtask_util.c:1040)
you can see that the table: TEST.NATION got id=2 so the first 8 characters of the load library that includes the table will be 2: load00000002xxxxxxx (xxx is timestamp in hex). Code:
Following the example I gave in my last comment the FL directory name that was created is:
load00000002000556CA8973BF40
(as you can see the id correlates to table is and the timestamp correlates to the start load timestamp. Thanks in advance,
Nigel.