In the following code I have the three functions get_dataset1, get_dataset2 and get_dataset3 that are all very similar, only differ when they call len(dataset) and os.path.join = tmp. The functions get_dataset1 and get_dataset3 behave as attended, they load a dataset and it has a length greater 0. However, in the case of get_dataset2, dataset has length 0. Why is that? Clearly, pinecone’s load_dataset and Dataset class have some strange behavior, potentially a bug.

Description: