Relative Content

Tag Archive for google-cloud-platformgoogle-cloud-dataflowapache-beam

Dataflow: Warning in WriteToBigQuery

I have a pipeline which is receiving streaming data via pub/sub.
The data is manipulated and I want to write in BigQuery, using dynamic tables based on the row information:
table=lambda element: f'{GCP_PROJECT}:{element.get(“customerId”).replace(“-“,”_”)}.{element.get(“siteId”)}’,