Skip to content

fix(deps): update rust crate arrow-array to v56 #157

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

fix(deps): update rust crate arrow-array to v56 #157

wants to merge 1 commit into from
+1 −1

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Aug 5, 2025 •
edited
Loading

This PR contains the following updates:

Package Type Update Change
arrow-array dependencies major 55.2 -> 56.0

Release Notes

apache/arrow-rs (arrow-array)

v56.1.0

Compare Source

Full Changelog

Implemented enhancements:

Fixed bugs:

  • The Rustdocs are clean CI job is failing #​8175
  • [avro] Bug in resolving avro schema with named type #​8045 [arrow]
  • Doc test failure (test arrow-avro/src/lib.rs - reader) when verifying avro 56.0.0 RC1 release #​8018 [arrow]

Documentation updates:

Performance improvements:

Closed issues:

  • [Variant] Improve fuzz test for Variant #​8199
  • [Variant] Improve fuzz test for Variant #​8198
  • VariantArrayBuilder tracks starting offsets instead of (offset, len) pairs #​8192
  • Rework ValueBuilder API to work with ParentState for reliable nested rollbacks #​8188
  • [Variant] Rename ValueBuffer as ValueBuilder #​8186
  • [Variant] Refactor ParentState to track and rollback state on behalf of its owning builder #​8182
  • [Variant] ObjectBuilder should detect duplicates at insertion time, not at finish #​8180
  • [Variant] ObjectBuilder does not reliably check for duplicates #​8170
  • [Variant] Support StringView and LargeString in ´batch_json_string_to_variant` #​8145 [parquet]
  • [Variant] Rename batch_json_string_to_variant and batch_variant_to_json_string json_to_variant #​8144 [parquet]
  • [avro] Use tempfile crate rather than custom temporary file generator in tests #​8143 [arrow]
  • [Avro] Use Write rather dyn Write in Decoder #​8142 [arrow]
  • [Variant] Nested builder rollback is broken #​8136
  • [Variant] Add support the remaing primitive type(timestamp_nanos/timestampntz_nanos/uuid) for parquet variant #​8126
  • Meta: Implement missing Arrow 56.0 lint rules - Sequential workflow #​8121
  • ARROW-012-015: Add linter rules for remaining Arrow 56.0 breaking changes #​8120
  • ARROW-010 & ARROW-011: Add linter rules for Parquet Statistics and Metadata API removals #​8119
  • ARROW-009: Add linter rules for IPC Dictionary API removals in Arrow 56.0 #​8118
  • ARROW-008: Add linter rule for SerializedPageReaderState usize→u64 breaking change #​8117
  • ARROW-007: Add linter rule for Schema.all_fields() removal in Arrow 56.0 #​8116
  • [Variant] Implement ShreddingState::AllNull variant #​8088 [parquet]
  • [Variant] Support Shredded Objects in variant_get #​8083 [parquet]
  • [Variant]: Implement DataType::RunEndEncoded support for cast_to_variant kernel #​8064 [parquet]
  • [Variant]: Implement DataType::Dictionary support for cast_to_variant kernel #​8062 [parquet]
  • [Variant]: Implement DataType::Struct support for cast_to_variant kernel #​8061 [parquet]
  • [Variant]: Implement DataType::Decimal32/Decimal64/Decimal128/Decimal256 support for cast_to_variant kernel #​8059 [parquet]
  • [Variant]: Implement DataType::Timestamp(..) support for cast_to_variant kernel #​8058 [parquet]
  • [Variant]: Implement DataType::Float16 support for cast_to_variant kernel #​8057 [parquet]
  • [Variant]: Implement DataType::Interval support for cast_to_variant kernel #​8056 [parquet]
  • [Variant]: Implement DataType::Time32/Time64 support for cast_to_variant kernel #​8055 [parquet]
  • [Variant]: Implement DataType::Date32 / DataType::Date64 support for cast_to_variant kernel #​8054 [parquet]
  • [Variant]: Implement DataType::Null support for cast_to_variant kernel #​8053 [parquet]
  • [Variant]: Implement DataType::Boolean support for cast_to_variant kernel #​8052 [parquet]
  • [Variant]: Implement DataType::FixedSizeBinary support for cast_to_variant kernel #​8051 [parquet]
  • [Variant]: Implement DataType::Binary/LargeBinary/BinaryView support for cast_to_variant kernel #​8050 [parquet]
  • [Variant]: Implement DataType::Utf8/LargeUtf8/Utf8View support for cast_to_variant kernel #​8049 [parquet]
  • [Variant] Implement cast_to_variant kernel #​8043 [parquet]
  • [Variant] Support variant_get kernel for shredded variants #​7941 [parquet]
  • Add test for casting Decimal128 (i128::MIN and i128::MAX) to f64 with overflow handling #​7939 [arrow]

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator

v56.0.0: arrow 56.0.0

Compare Source

Changelog

56.0.0 (2025-07-29)

Full Changelog

Breaking changes:

Implemented enhancements:

  • [parquet] Relax type restriction to allow writing dictionary/native batches for same column #​8004
  • Support casting int64 to interval #​7988 [arrow]
  • [Variant] Add ListBuilder::with_value for convenience #​7951 [parquet]
  • [Variant] Add ObjectBuilder::with_field for convenience #​7949 [parquet]
  • [Variant] Impl PartialEq for VariantObject #​7943 #​7948
  • [Variant] Offer simdutf8 as an optional dependency when validating metadata #​7902 [parquet] [arrow]
  • [Variant] Avoid collecting offset iterator #​7901 [parquet]
  • [Variant] Remove superfluous check when validating monotonic offsets #​7900 [parquet]
  • [Variant] Avoid extra allocation in ObjectBuilder #​7899 [parquet]
  • [Variant][Compute] variant_get kernel #​7893 [parquet]
  • [Variant][Compute] Add batch processing for Variant-JSON String conversion #​7883 [parquet]
  • Support MapArray in lexsort #​7881 [arrow]
  • [Variant] Add testing for invalid variants (fuzz testing??) #​7842 [parquet]
  • [Variant] VariantMetadata, VariantList and VariantObject are too big for Copy #​7831 [parquet]
  • Allow choosing flate2 backend #​7826 [parquet]
  • [Variant] Tests for creating "large" VariantObjectss #​7821 [parquet]
  • [Variant] Tests for creating "large" VariantLists #​7820 [parquet]
  • [Variant] Support VariantBuilder to write to buffers owned by the caller #​7805 [parquet]
  • [Variant] Move JSON related functionality to different crate. #​7800 [parquet]
  • [Variant] Add flag in ObjectBuilder to control validation behavior on duplicate field write #​7777 [parquet]
  • [Variant] make serde_json an optional dependency of parquet-variant #​7775 [parquet]
  • [coalesce] Implement specialized BatchCoalescer::push_batch for PrimitiveArray #​7763 [arrow]
  • Add sort_kernel benchmark for StringViewArray case #​7758 [arrow]
  • [Variant] Improved API for accessing Variant Objects and lists #​7756 [parquet]
  • Buildable reproducible release builds #​7751
  • Allow per-column parquet dictionary page size limit #​7723 [parquet]
  • [Variant] Test and implement efficient building for "large" Arrays #​7699 [parquet]
  • [Variant] Improve VariantBuilder when creating field name dictionaries / sorted dictionaries #​7698 [parquet]
  • [Variant] Add input validation in VariantBuilder #​7697 [parquet]
  • [Variant] Support Nested Data in VariantBuilder #​7696 [parquet]
  • Parquet: Incorrect min/max stats for int96 columns #​7686 [parquet]
  • Add DictionaryArray::gc method #​7683 [arrow]
  • [Variant] Add negative tests for reading invalid primitive variant values #​7645 [parquet]

Fixed bugs:

  • [Variant] Panic when appending nested objects to VariantBuilder #​7907 [parquet]
  • Panic when casting large Decimal256 to f64 due to unchecked unwrap() #​7886 [arrow]
  • Incorrect inlined string view comparison after " Add prefix compare for inlined" #​7874 [parquet] [arrow]
  • [Variant] test_json_to_variant_object_very_large takes over 20s #​7872 [parquet]
  • [Variant] If ObjectBuilder::finalize is not called, the resulting Variant object is malformed. #​7863 [parquet]
  • CSV error message has values transposed #​7848 [arrow]
  • Concating struct arrays with no fields unnecessarily errors #​7828 [arrow]
  • Clippy CI is failing on main after Rust 1.88 upgrade #​7796 [parquet] [arrow] [arrow-flight]
  • [Variant] Field lookup with out of bounds index causes unwanted behavior #​7784 [parquet]
  • Error verifying parquet-variant crate on 55.2.0 with verify-release-candidate.sh #​7746
  • test_to_pyarrow tests fail during release verification #​7736 [arrow]
  • [parquet_derive] Example for ParquetRecordWriter is broken. #​7732
  • [Variant] Variant::Object can contain two fields with the same field name #​7730 [parquet]
  • [Variant] Panic when appending Object or List to VariantBuilder #​7701 [parquet]
  • Slicing a single-field dense union array creates an array with incorrect logical_nulls length #​7647 [arrow]
  • Ensure page encoding statistics are written to Parquet file #​7643 [parquet] (etseidl)

Documentation updates:

Performance improvements:

  • RowConverter on list should only encode the sliced list values and not the entire data #​7993 [arrow]
  • [Variant] Avoid extra allocation in list builder #​7977 [parquet]
  • [Variant] Convert JSON to Variant with fewer copies #​7964 [parquet]
  • Optimize sort kernels partition_validity method #​7936 [arrow]
  • Speedup sorting for inline views #​7857 [arrow]
  • Perf: Investigate and improve parquet writing performance #​7822 [parquet] [arrow]
  • Perf: optimize sort string_view performance #​7790 [arrow]
  • Clickbench microbenchmark spends significant time in memcmp for not_empty predicate #​7766 [arrow]
  • Use prefix first for comparisons, resort to data buffer for remaining data on equal values #​7744 [arrow]
  • Change use of inline_value to inline it to a u128 #​7743 [arrow]
  • Add efficient way to upgrade keys for additional dictionary builders #​7654 [arrow]
  • Perf: Make sort string view fast(1.5X ~ 3X faster) #​7792 [arrow] (zhuqi-lucas)
  • Add specialized coalesce path for PrimitiveArrays #​7772 [arrow] (alamb)

Closed issues:

  • Implement full-range i256::to_f64 to replace current ±∞ saturation for Decimal256 → Float64 #​7985
  • [Variant] impl FromIterator fpr VariantPath #​7955
  • validated and is_fully_validated flags doesn't need to be part of PartialEq #​7952 [parquet]
  • [Variant] remove VariantMetadata::dictionary_size #​7947 [parquet]
  • [Variant] Improve VariantArray performance by storing the index of the metadata and value arrays #​7920
  • [Variant] Converting variant to JSON string seems slow #​7869 [parquet]
  • [Variant] Present Variant at Iceberg Summit NYC July 10, 2025 #​7858
  • [Variant] Avoid second copy of field name in MetadataBuilder #​7814 [parquet]
  • Remove APIs deprecated in or before 54.0.0 #​7810 [parquet] [arrow] [arrow-flight]
  • [Variant] Make it harder to forget to finish a pending parent i n ObjectBuilder #​7798 [parquet]
  • [Variant] Remove explicit ObjectBuilder::finish() and ListBuilder::finish and move to Drop impl #​7780 [parquet]
  • Reduce repetition in tests for arrow-row/src/run.rs #​7692 [arrow]
  • [Variant] Add tests for invalid variant values (aka verify invalid inputs) #​7681 [parquet]
  • [Variant] Introduce structs for Variant::Decimal types #​7660 [parquet]

Merged pull requests:

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate Renovate
Copy link
Contributor Author

renovate bot commented Aug 5, 2025 •
edited
Loading

⚠️ Artifact update problem

Renovate failed to update an artifact related to this branch. You probably do not want to merge this PR as-is.

♻ Renovate will retry this branch, including artifacts, only when one of the following happens:

  • any of the package files in this branch needs updating, or
  • the branch becomes conflicted, or
  • you click the rebase/retry checkbox if found above, or
  • you rename this PR's title to start with "rebase!" to trigger it manually

The artifact failure details are included below:

File name: Cargo.lock
Command failed: cargo update --config net.git-fetch-with-cli=true --manifest-path spnl/Cargo.toml --package [email protected] --precise 56.1.0
    Updating crates.io index
error: failed to select a version for the requirement `arrow-array = "^55.1"`
candidate versions found which didn't match: 56.1.0
location searched: crates.io index
required by package `lancedb v0.21.3`
    ... which satisfies dependency `lancedb = "^0.21.0"` (locked to 0.21.3) of package `spnl v0.4.0 (/tmp/renovate/repos/github/IBM/spnl/spnl)`
    ... which satisfies path dependency `spnl` (locked to 0.4.0) of package `spnl-cli v0.4.0 (/tmp/renovate/repos/github/IBM/spnl/cli)`

@renovate renovate bot force-pushed the renovate/arrow-array-56.x branch from 29f06f1 to 4ecbea0 Compare August 10, 2025 12:47
@renovate renovate bot force-pushed the renovate/arrow-array-56.x branch from 4ecbea0 to 362a476 Compare August 17, 2025 20:29
@renovate renovate bot force-pushed the renovate/arrow-array-56.x branch from 362a476 to c954b3f Compare August 25, 2025 13:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
0 participants