We have a vendor that’s putting JSON files into folders that have our target PARQUET files we want to load. The folders have timestamps, so we have to load the whole folder. But, COPY is failing when trying to also load those JSON files. Is there a way to exclude the JSON files but load all the PARQUET files in the folder?

For example, the folder is s3://bucket/path/2024-06-07T12:44:44.79492.parquet/
So, my COPY command only copies up to s3://bucket/path/2024-06-07, because I don’t know the timestamp a priori.