I am trying to read a csv file into a dataframe. My problem is that I am the read is successful but I am only getting 2864 rows in the dataframe where the file contains 38154 rows. my guess is that its happening because 754 has no value for the item. I need to read this csv full file into a dataframe.
So far I have tired below:
df = pd.read_csv(myfile.csv,encoding=’utf-16′, on_bad_lines=’skip’, chunksize=chunk_size)
I have attached the image of the data from csv file
I am trying to read a csv file into a dataframe. My problem is that I am the read is successful but I am only getting 2864 rows in the dataframe where the file contains 38154 rows. my guess is that its happening because 754 has no value for the item. I need to read this csv full file into a dataframe.
So far I have tired below:
df = pd.read_csv(myfile.csv,encoding=’utf-16′, on_bad_lines=’skip’, chunksize=chunk_size)
I have attached the image of the data from csv file
