Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Unnecessarily slow writes while writing arrow IPC #1317

Closed
cyr opened this issue Dec 5, 2022 · 0 comments
Closed

Unnecessarily slow writes while writing arrow IPC #1317

cyr opened this issue Dec 5, 2022 · 0 comments
Labels
no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog

Comments

@cyr
Copy link
Contributor

cyr commented Dec 5, 2022

As per the parquet2 issue, writing arrow IPC files do some flushing while writing, which won't let a BufWriter to fullly utilize its buffers. PR incoming!
@cyr cyr mentioned this issue Dec 5, 2022
Merged
@cyr cyr closed this as completed Dec 6, 2022
@jorgecarleitao jorgecarleitao added the no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog label Dec 13, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@cyr @jorgecarleitao