I want to create a pipeline with two elements. One is a dataflow. This dataflow creates 5 tables in my lakehouse. The second element of the pipeline is a notebook. I want the notebook to load each of these 5 tables, make some transformations on the data. Then the 5 tables need to appended to each other, and added to the lakehouse (if a table exists, it is replaced).
How can I pass the names of the tables created by the dataflow to the notebook, for it to know which tables to load and transform?
I am really new to Microsoft Fabric environment, I tried googling but I can’t seem to fid a concrete answer, hence I am looking for help here.
Erina is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.