Skip to content

Latest commit

 

History

History
162 lines (140 loc) · 25 KB

CHANGELOG.md

File metadata and controls

162 lines (140 loc) · 25 KB
Raw

Changelog

51.0.0 (2024-03-15)

Full Changelog

Breaking changes:

Implemented enhancements:

  • Prototype Arrow over HTTP in Rust #5496 [arrow]
  • Add DataType::ListView and DataType::LargeListView #5492 [parquet] [arrow]
  • Improve documentation around handling of dictionary arrays in arrow flight #5487 [arrow] [arrow-flight]
  • Better memory limiting in parquet ArrowWriter #5484 [parquet]
  • Support Creating Non-Nullable Lists and Maps within a Struct #5482 [arrow]
  • [DISCUSSION] Better borrow propagation (e.g. RecordBatch::schema() to return &SchemaRef vs SchemaRef) #5463 [parquet] [arrow] [arrow-flight]
  • Build Scalar with ArrayRef #5459
  • AsyncArrowWriter doesn't limit underlying ArrowWriter to respect buffer-size #5450 [parquet]
  • Refine Display implementation for FlightError #5438 [arrow] [arrow-flight]
  • Better ergonomics for FixedSizeList and LargeList #5372 [arrow]
  • Update Flight proto #5367 [arrow] [arrow-flight]
  • Support check similar datatype but with different magnitudes #5358 [arrow]
  • Buffer memory usage for custom allocations is reported as 0 #5346 [arrow]
  • Can the ArrayBuilder trait be made Sync? #5344 [arrow]
  • support cast 'UTF8' to FixedSizeList #5339 [arrow]
  • Support Creating Non-Nullable Lists with ListBuilder #5330 [arrow]
  • ParquetRecordBatchStreamBuilder::new() panics instead of erroring out when opening a corrupted file #5315 [parquet]
  • Raw JSON Writer #5314 [arrow]
  • Add support for more fused boolean operations #5297 [arrow]
  • parquet: Allow disabling embed ARROW_SCHEMA_META_KEY added by the ArrowWriter #5296 [parquet]
  • Support casting strings like '2001-01-01 01:01:01' to Date32 #5280 [arrow]
  • Temporal Extract/Date Part Kernel #5266 [arrow]
  • Support for extracting hours/minutes/seconds/etc. from Time32/Time64 type in temporal kernels #5261 [arrow]
  • parquet: add method to get both the inner writer and the file metadata when closing SerializedFileWriter #5253 [parquet]
  • Release arrow-rs version 50.0.0 #5234

Fixed bugs:

  • Empty String Parses as Zero in Unreleased Arrow #5504 [arrow]
  • Unused import in nightly rust #5476 [parquet] [arrow] [arrow-flight]
  • Error The data type type List .. has no natural order when using arrow::compute::lexsort_to_indices with list and more than one column #5454 [arrow]
  • Wrong size assertion in arrow_buffer::builder::NullBufferBuilder::new_from_buffer #5445 [arrow]
  • Inconsistency between comments and code implementation #5430 [arrow]
  • OOB access in Buffer::from_iter #5412 [arrow]
  • Cast kernel doesn't return null for string to integral cases when overflowing under safe option enabled #5397 [arrow]
  • Make ffi consume variable layout arrays with empty offsets #5391 [arrow]
  • RecordBatch conversion from pyarrow loses Schema's metadata #5354 [arrow]
  • Debug output of Time32/Time64 arrays with invalid values has confusing nulls #5336 [arrow]
  • Removing a column from a RecordBatch drops schema metadata #5327 [arrow]
  • Panic when read an empty parquet file #5304 [parquet]
  • How to enable statistics for string columns? #5270 [parquet]
  • concat::tests::test_string_dictionary_merge failure fails on Mac / has different results in different platforms #5255 [arrow]

Documentation updates:

  • Minor: Add doc comments to GenericByteViewArray #5512 [arrow] (alamb)
  • Improve docs for logical and physical nulls even more #5434 [arrow] (alamb)
  • Add example of converting RecordBatches to JSON objects #5364 [arrow] (alamb)

Performance improvements:

Closed issues:

  • Add StringViewArray implementation and layout and basic construction + tests #5469 [parquet] [arrow]
  • Add DataType::Utf8View and DataType::BinaryView #5468 [parquet] [arrow]

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator