I have a delta table named “test_table” in databricks like:
data_value,batch_number,rnumber,file_name,responseStatus,url
21gdsddnh,1,1,subject_1.csv,'','',''
21gdsdernh,1,2,subject_1.csv,'','',''
21gdweddnh,1,3,subject_1.csv,'','',''
21gdweddnh,2,1,subject_2.csv,'','',''
21gdweddnh,2,2,subject_2.csv,'','',''
21gdweddnh,2,3,subject_2.csv,'','',''
Now a csv file named “response.csv” like:
file_name,responseStatus,url
subject_1.csv,SUCCESS,/org/source/restapi.com
subject_1.csv,SUCCESS,/org/source/restapi.com
subject_1.csv,SUCCESS,/org/source/restapi.com
subject_2.csv,SUCCESS,/org/source/restapi.com
subject_2.csv,SUCCESS,/org/source/restapi.com
subject_2.csv,SUCCESS,/org/source/restapi.com
Requirement: I need to attach/Update test_table such that these 6 rows of “response.csv” get attached to “test_table” so that my test_table finally looks like:
data_value,batch_number,rnumber,file_name,responseStatus,url
21gdsddnh,1,1,subject_1.csv,SUCCESS,/org/source/restapi.com
21gdsdernh,1,2,subject_1.csv,SUCCESS,/org/source/restapi.com
21gdweddnh,1,3,subject_1.csv,SUCCESS,/org/source/restapi.com
21gdweddnh,2,1,subject_2.csv,SUCCESS,/org/source/restapi.com
21gdweddnh,2,2,subject_2.csv,SUCCESS,/org/source/restapi.com
21gdweddnh,2,3,subject_2.csv,SUCCESS,/org/source/restapi.com