I read the file from “adls” raw container and performed certain actions to check the null values renamed the columns and added an additional column to the file.
After all these actions I wrote the file to adls container. I used the read command back to check if the file was written successfully. The command has shown the values in the table, however, when I checked the adls container it says no file found.
Wondering how the same thing was correct in Databricks and can not find it in ADLS.
I have checked all the permissions and mounting parts.
I used Service Principal, azure key vault, created secret scope and connected adls to Databricks.
Permitted app registration and the adls account with the “Storage blob contributor” role under role assignments.
I was able to read the file and write the file successfully using data bricks. However, can not see the file in the adls container.
Susmitha Kanuri is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.