Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Feature: RleDictionary decoding for parquet #921

Closed
ritchie46 opened this issue Mar 20, 2022 · 0 comments · Fixed by #924
Closed

Feature: RleDictionary decoding for parquet #921

ritchie46 opened this issue Mar 20, 2022 · 0 comments · Fixed by #924
Labels
bug Something isn't working no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog

Comments

@ritchie46
Copy link
Collaborator

This was a a parquet file that was shared on polars. Copied from pola-rs/polars#2448.

I believe the original file was created with pyarrow.

import polars as pl
import requests
from io import BytesIO

url = "https://github.com/netenglabs/suzieq/blob/master/tests/data/nxos/parquet-out/routes/sqvers=2.0/namespace=nxos/hostname=dcedge01/ae4052489ad24989b6bee9944721d4e8.parquet?raw=true"
response = requests.get(url)
image_data = BytesIO(response.content)

df = pl.read_parquet(image_data)

which results in the same error as above:

exceptions.ArrowErrorException: NotYetImplemented("Decoding \"RleDictionary\"-encoded optional any pages is not yet implemented for Binary")
@ritchie46 ritchie46 added the enhancement An improvement to an existing feature label Mar 20, 2022
@jorgecarleitao jorgecarleitao added bug Something isn't working no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog and removed enhancement An improvement to an existing feature labels Mar 21, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants