Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Unable to decode parquet file with List[PrimitiveArray<f64>] #890

Closed
Igosuki opened this issue Mar 6, 2022 · 2 comments · Fixed by #904
Closed

Unable to decode parquet file with List[PrimitiveArray<f64>] #890

Igosuki opened this issue Mar 6, 2022 · 2 comments · Fixed by #904
Assignees
Labels
bug Something isn't working no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog

Comments

@Igosuki
Copy link
Contributor

Igosuki commented Mar 6, 2022

Reading the following file : https://github.com/Igosuki/arrow2/blob/parquet_file_fail/part-00000-ff6ed8b4-84b9-4d58-b491-6c6401ba8925-c000.snappy.parquet
Fails with :

NotYetImplemented(Decoding 'PlainDictionary'-encoded optional any pages is not yet implemented for Primitive)

It can be read by arrow-rs

Any idea why the decoding fails here ?

@jorgecarleitao
Copy link
Owner

Thanks for reporting it.

#892 fixes this one, but does not fixes reading this file. I am marking this as a blocker for 0.10 - we need to correctly read multi-page nested columns.

@Igosuki
Copy link
Contributor Author

Igosuki commented Mar 12, 2022 via email

@jorgecarleitao jorgecarleitao added bug Something isn't working no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog labels Mar 12, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants