I’m creating an HDF5 file that contains two databases (images, text). The size of the HDF5 is over an order of magnitude larger than the image files + text files. Is this due to an issue with the way I’m storing the data or text? I’m unable to figure out why. The images are stored as bytes and the text is stored as the recommended text format by HDF5.
I have about 80GB of images and about 40MB of text. The HDF5 file is about 1.5TB.