I am saving a pandas dataframe as csv file from my databricks notebook using the command –
df.to_csv(cwd + '/data.csv', index=False)
This completes without any error. However, where can find this path in the GUI of databricks (how can I navigate to cwd basically)? In fact, when I try reading the same file again –
pd.read_csv(os.getcwd() + '/data.csv')
,
it gives a file not found error [Errno 2] No such file or directory. Is there something wrong I am doing?
Another question on the similar lines I had was, how can I navigate to the CWD from the Databricks GUI?