Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cast is very slow in arrow/arrow2 #1302

Closed
sundy-li opened this issue Aug 5, 2021 · 0 comments
Closed

Cast is very slow in arrow/arrow2 #1302

sundy-li opened this issue Aug 5, 2021 · 0 comments
Labels
C-feature Category: feature C-performance Category: Performance

Comments

@sundy-li
Copy link
Member

sundy-li commented Aug 5, 2021

Summary

SELECT sum(number)
FROM numbers_mt(10000000000)

1 rows in set. Elapsed: 0.522 sec. Processed 10.00 billion rows, 80.14 GB (19.16 billion rows/s., 153.54 GB/s.)
SELECT sum(CAST(number, 'UInt32'))
FROM numbers_mt(10000000000)

1 rows in set. Elapsed: 36.359 sec. Processed 10.00 billion rows, 80.14 GB (275.03 million rows/s., 2.20 GB/s.)

jorgecarleitao/arrow2#252

The second query is 70 times slower

@sundy-li sundy-li added C-feature Category: feature C-performance Category: Performance labels Aug 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-feature Category: feature C-performance Category: Performance
Projects
None yet
Development

No branches or pull requests

1 participant