Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

write categorical to csv without casting #1506

Closed
ritchie46 opened this issue Oct 8, 2021 · 3 comments · Fixed by #1518
Closed

write categorical to csv without casting #1506

ritchie46 opened this issue Oct 8, 2021 · 3 comments · Fixed by #1518
Labels
skip changelog Do not include in changelog

Comments

@ritchie46
Copy link
Member

First will fix upstream: jorgecarleitao/arrow2#508

@ghuls
Copy link
Collaborator

ghuls commented Oct 8, 2021

Would it be hard to read certain columns of a CSV file directly to a Categorical?

@ritchie46
Copy link
Member Author

Would it be hard to read certain columns of a CSV file directly to a Categorical?

We'd need to write a builder. Currently we only create them from iterators.

@ritchie46
Copy link
Member Author

@ghuls it is quite complicated. Every thread must synchronize the string cache and later in rechunking we also need to do work to keep the catergories in sync.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
skip changelog Do not include in changelog
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants