Every time I try to compute the dataframe it fails giving me the following or similar error messages:
Exception: 'ValueError("could not convert string to float: '<NA>'")'
Right now I want to filter out all rows wich contain float values. This works, but once I want to write it back to disk as a parquet file and call compute() during it, it fails (the writing to disk works when not calling compute). I have tried replacing with numpy.nan, I have tried converting the columns to numeric, I have tried replacing all ‘NA’ and ” stringsm and to fill all empty values, but all to no avail.
Has anybody encountered a similar error or know how to fix it?
marvin.s is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.