Getting below error pyspark pandas.
PandasNotImplementedError: The method pd.Series.iter() is not implemented. If you want to collect your data as an NumPy array, use ‘to_numpy()’ instead
Import pyspark.pandas as ps
df_mas=(spark.read.format("csv").option ("header", "true"). load (driver.config["MSAOutputFiles"])
df=df_mas.pandas_api()
df["MAUS"] = nр.where(df.MAUS=="NHTTYMEDN"),"MHINC", df.MAUS_MNEM_CD)
display (df)