This repository has been archived by the owner on Feb 18, 2024. It is now read-only.
Add page_size opt to control array_to_pages #1291
Labels
no-changelog
Issues whose changes are covered by a PR and thus should not be shown in the changelog
seems the
2^31 - 2^25
is a fixed value now, which may be to large.parquet.page.size:
The page size is for compression. When reading, each page can be decompressed independently. A block is composed of pages. The page is the smallest unit that must be read fully to access a single record. If this value is too small, the compression will deteriorate. Default size is 1048576 bytes (= 1 * 1024 * 1024).The text was updated successfully, but these errors were encountered: