How to extract the name of the parent directory based on the name of the child directory using pyspark / dbutils / databricks? I have the below folder structure on ADLS gen2:
