Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Arrow2 cannnot open arrow IPC files written by Julia's Arrow.jl, Unable to get dictionaries from footer. #677

Closed
pcjentsch opened this issue Dec 13, 2021 · 1 comment · Fixed by #678
Labels
bug Something isn't working no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog

Comments

@pcjentsch
Copy link

Arrow2 has trouble opening IPC files written by Arrow.jl in Julia. I think it's an issue on this side because pyarrow is able to open the files.

I have created a git repository with a sample IPC file written by Arrow.jl and some sample code from Arrow2 that reproduces the error by trying to read the IPC file.

Thank you for the great package! Let me know if there is any other way I can help, and of course if this error might be on Julia's side.

@jorgecarleitao
Copy link
Owner

jorgecarleitao commented Dec 13, 2021

Thanks a lot for the investigation. This is indeed a bug on our side where we are being too restrictive in what we accept. PR to fix it in #678. After PR:

cargo run --features io_ipc,io_print --example ipc_file_read "test.ipc"
+----------------------+------+
| a                    | b    |
+----------------------+------+
| 0.23161250793669264  | test |
| 0.7067493353734342   | test |
| 0.9173674364326969   | test |
...

Thank you for the great package!

Thank you 🙇

@jorgecarleitao jorgecarleitao added bug Something isn't working no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog labels Dec 13, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants