In python, we can do:
import pyarrow.parquet as pq
filter = ('some_column', '=', 'some_value')
pq.read_table(file_path, filters=[filter]).to_pandas()
How can I apply a filter similarly when reading a parquet file in Julia?
I’ve tried:
using Parquet
filter = row -> row.some_column == "some_value"
Parquet.read_parquet(filepath, filter=filter)
But I get an error saying that there is no such method and says:
Closest candidates are:
Parquet.Table(::Any, ::Parquet.File, ::Tables.Schema; rows, batchsize, column_generator, use_threads) got unsupported keyword argument “filter”