Avoid writing partition column in Parquet file
I’m trying to export a DuckDB table to a Parquet file using hive partitioning. Unfortunately, DuckDb writes the partition both as hive partition and as a column in the file. This doesn’t seem correct, and most of the tools fail to read the file when they find the same column twice (once in the file and once in the hive partition).
DuckDB – Avoid writing partition column in Parquet file
I’m trying to export a DuckDB table to a Parquet file using hive partitioning.
Unfortunately, DuckDb writes the partition both as hive partition and as a column in the file. This doesn’t seem correct, and most of the tools fail to read the file when they find the same column twice (once in the file and once in the hive partition).
Is there a way to tell DuckDb to avoid writing the partition column in Parquet file?
Querying multiple parquet files in a range using duckdb
I have parquet files arranged in this format