I’m ingesting a file using DLT and I would like to create 2 new columns:
CreateDate and UpdateDate for all the records. UpdateDate is easy as I can just use the current date (although it would be nicer if this column didn’t update again if no other columns actually changed). But what I’m having difficulty doing is I don’t want CreateDate to ever be updated, as that should just contain the information when the data was first ingested and so should never change.

I originally thought to join the source data to the target table, but DLT doesn’t support Circular dependencies and so throws me this error:

The downstream table is referenced when creating the upstream table or view . Circular dependencies are not supported in a DLT pipeline. Please remove the dependency between.

I also tried using the parameter except_column_list however that’s actually just ended up completely removing the CreateDate column