I have several streaming tables which I need to mask some columns on because they contain PID in delta live pipelines within databricks.
When I run the following
CREATE FUNCTION postcode_mask(postcode STRING) RETURN CASE WHEN is_member('data') THEN postcode ELSE '*********' END;
ALTER TABLE address ALTER COLUMN postcode SET MASK postcode_mask`;
I get this error
STREAMING_TABLE_OPERATION_NOT_ALLOWED.UNSUPPORTED_OPERATION] The operation ALTER TABLE is not allowed: The operation is not supported on Streaming Tables. SQLSTATE: 42601
Is there a way to alter a streaming table and column within datricks?
ALTER STREAMING TABLE
Doesn’t seem to allow changes to columns