Skip navigation

TRUNCATE + APPEND operations on buffer tables as atomic operations

score 30
You have not voted. Below Review Threshold

Hi,

 

I would like to propose a simple but, in my opinion, very useful improvement.

Me and my team noticed that when the "Truncate before load" property is set or the behavior of an ETL is set as "Truncate", the process performs two separate actions: a TRUNCATE on the target buffer table and subsequently an APPEND on the same table.

Sometimes the APPEND operation might fail for any reason and the table will be left truncated instead of reverting back to the previous correct state.

 

I would like to suggest to make the operation TRUNCATE + APPEND as atomic, in such a way that if the APPEND action fails the table wouldn't be left in an incorrect state.

 

 

Thank you for reading,

Tommaso

Comments

Vote history