emp_data_df.withColumn(“Row_Number”,row_number(),over(window)) .withColumn(“Rank”,rank(),over(window)) .withColumn(“Dense_Rank”,dense_rank(),over(window)) .filter(col(“Desnse_Rank”)<=2) .show(truncate=False) i am getting error message as NameError: name ‘over’ is not defined . How to resolve this? pyspark databricks spark-notebook New contributor Swapnil is a new contributor to this site. Take care in asking for clarification, commenting, and answering. Check out our Code of Conduct.