Error “Unable to parse” Custom Data Flow Template
I am trying to create custom data flow template for JDBC connection however when importing the template (python code to json converted) it is giving error/warning in console.
Dataflow: Warning in WriteToBigQuery
I have a pipeline which is receiving streaming data via pub/sub.
The data is manipulated and I want to write in BigQuery, using dynamic tables based on the row information:
table=lambda element: f'{GCP_PROJECT}:{element.get(“customerId”).replace(“-“,”_”)}.{element.get(“siteId”)}’,