I have stream A and stream B in Flink.
- A has watermarks and timestamps
- B is some source i get from calling periodically an API, it does not have watermarks/timestamps
I want to connect stream A and stream B (enrich A with B), with the resulting connection having the watermarks of A
since Flink takes the min between the two, I thought about two approaches:
- emit Max watermarks, and collect max timestamps from B
- mark B as temporary idle after each emission
I don’t know which approach is correct, or is there a better way to handle this scenario
New contributor
Asaad27 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.