I have 54 data files, each of which is several GB in size.
Each file contains 15 columns of (x,y,z)
values.
My task is to read those files, compute autocorrelation, and plot graphs.
How should I read the files?
- Open each file
- Read 15 columns
- Prepare plot
- Write the plot to a Bitmap file
Or,
- Open each file
- Read one column
- Prepare one plot
- Accumulate plot
- go to step #1
- do this 15 times
- Finally, write the plot to a bitmap file
Which one will be faster?
Which one will be memory-efficient?