Parallel reading/writing of single parquet files?

[bradlarsen]

Hi there,

The C++ implementation of Arrow seems to support multithreaded reading of Parquet files (e.g., here).

It doesn't look like the native Rust implementation has any multithreaded capability like this. Are there any plans or ongoing efforts to add that?

Thanks!

[tustvold]

See https://docs.rs/parquet/latest/parquet/arrow/arrow_writer/struct.ArrowColumnWriter.html

And

https://docs.rs/parquet/latest/parquet/arrow/async_reader/type.ParquetRecordBatchStreamBuilder.html#method.new_with_metadata