You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
If the arrow flight encodes a record batch slice where the first row of that slice has offset zero then it reuses the non-sliced data for offsets. This can not only cause offset arrays that are larger than the slice to be encoded but the offset encoding will be incorrect as there may be zero or more rows that were not removed from the slice.
Describe the bug
If the arrow flight encodes a record batch slice where the first row of that slice has offset zero then it reuses the non-sliced data for offsets. This can not only cause offset arrays that are larger than the slice to be encoded but the offset encoding will be incorrect as there may be zero or more rows that were not removed from the slice.
To Reproduce
will result in an error where all lists are empty.
Expected behavior
No error is thrown at list offsets are properly encoded.
Additional context
This line seems to be the problem:
arrow-rs/arrow-ipc/src/writer.rs
Line 1433 in 5a86db3
Setting that line to instead
0 => offset_slice.iter().map(|x| *x).collect(),
fixes the problem.The text was updated successfully, but these errors were encountered: