Releases: zarr-developers/VirtualiZarr
v2.2.1
Small patch release with a couple bug fixes.
What's Changed
- Allow storing scalar arrays under 'c' key by @maxrjones in #836
- Improve ManifestStore.list_dir for arrays and nested groups by @maxrjones in #837
Full Changelog: v2.2.0...v2.2.1
v2.2.0
Release includes a new Zarr V2 parser, integration with Virtual TIFF for TIFF parsing, and support for parsing HDF data with nested groups, along with bug fixes and documentation improvements.
What's Changed
- Add back supports_partial_writes property, returning False by @maxrjones in #828
- Add link to ESIP talk by @maxrjones in #819
- Add virtual tiff as an optional dependency by @maxrjones in #810
- Fix examples' links by @malmans2 in #795
- Fix typing in ManifestStore by @maxrjones in #820
- Parse zarr v2 by @neilSchroeder in #822
- Remove
ZARR_DEFAULT_FILL_VALUElookup by @norlandrhagen in #812 - Raise informative error on Zarr V2 parsing with Zarr-Python<3.1.3 by @maxrjones in #829
- Return None for Zarr V2/consolidated metadata requests by @maxrjones in #827
- Revert "Remove unnecessary dtype conversion in icechunk writer" by @TomNicholas in #805
- Support nested group in
ManifestStore+HDFParserby @ilan-gold in #790
New Contributors
- @malmans2 made their first contribution in #795
- @neilSchroeder made their first contribution in #822
- @ilan-gold made their first contribution in #790
Full Changelog: v2.1.2...v2.2.0
v2.1.2
Patch release with minor bug fixes for the DMRPParser and Icechunk writing behavior.
What's Changed
- New empty release notes by @TomNicholas in #781
- Minor improvements to dmrpp parser by @Mikejmnez in #757
- account for
endianbeing possiblyNoneby @keewis in #787 - Do not validate references for "empty" chunks. by @sharkinsspatial in #791
- Remove unnecessary dtype conversion in icechunk writer by @popododo0720 in #760
- Polish release notes for v2.1.2 by @maxrjones in #793
New Contributors
- @Mikejmnez made their first contribution in #757
- @popododo0720 made their first contribution in #760
Full Changelog: v2.1.1...v2.1.2
v2.1.1
Extremely minor release to ensure compatibility with the soon-to-be released version of xarray (v2025.08.0).
What's Changed
- Empty release notes by @TomNicholas in #778
- Adjust for small change in signature of private xarray function
_nested_combineby @TomNicholas in #779 - Eelease notes for v2.1.1 by @TomNicholas in #780
Full Changelog: v2.1.0...v2.1.1
v2.1.0
This release fixes a number of important bugs that could silently lead to referenced data being read back incorrectly.
In particular, note that writing virtual chunks to Icechunk now requires that all virtual chunk containers are set correctly by default.
It also unpins our dependency on xarray, so that VirtualiZarr is compatible with the latest released version of Xarray.
Please upgrade!
What's Changed
- Add template for empty release notes in release guide by @TomNicholas in #755
- Add empty release notes section by @TomNicholas in #754
- Adds Mkdocs alternate tabs to show multiple store configurations on Usage.md by @norlandrhagen in #741
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #756
- Include serializer from ManifestStore in Icechunk virtual references by @maxrjones in #766
- Raise instead of silently dropping non-zarr custom codec by @TomNicholas in #775
- Raise if missing virtual chunk containers by @TomNicholas in #774
- Unpin xarray by @maxrjones in #765
- Extract endianness from Bytes codec in V2 metadata conversion by @maxrjones in #769
- Note breaking change of enforcing virtual chunk containers are correct by @TomNicholas in #776
- v2.1.0 release notes by @TomNicholas in #777
Full Changelog: v2.0.1...v2.1.0
v2.0.1
Minor release to ensure compatibility with incoming changes to Icechunk.
What's Changed
- Fix indexing with nones by @TomNicholas in #730
- Add empty release notes section by @TomNicholas in #732
- Refactor indexing by @TomNicholas in #734
- Don't write empty chunks to icechunk by @TomNicholas in #745
- Fix test paths to make upstream Icechunk happy by @paraseba in #752
- Document recommendation to use
repo.save_configby @TomNicholas in #746 - Enable workflow_dispatch for upstream workflow by @paraseba in #751
- Add comment on skip_signature=True in the s3 store example by @jbusecke in #731
- v2.0.1 release notes by @TomNicholas in #753
New Contributors
Full Changelog: v2.0.0...v2.0.1
v2.0.0
🎉 v2.0.0 - Second major release of VirtualiZarr 🎉
Highlights
- Implement
open_virtual_mfdatasetfor easy merging/concatenation with parallelization via Dask, Lithops, or a custom subclass of concurrent.futures.Executor - Add support for custom external parsers
- Add an internal Zarr V3 Parser
- Enable loading data directly via Zarr and/or Xarray without temporary serialization via Icechunk or Kerchunk
- 📖 Revamped documentation
Detailed Release Notes
Read more about the numerous new features, enhancements, bug fixes, and internal improvements in the release notes.
Migration Guide
The migration guide contains detailed information about switching from VirtualiZarr 1.0 to VirtualiZarr 2.0.
v2.0.0rc1
VirtualiZarr v2.0.0 Release Candidate 1
Highlights
- 🎉 Second major release of VirtualiZarr 🎉
- Implement
open_virtual_mfdatasetfor easy merging/concatenation with parallelization via Dask, Lithops, or a custom subclass of concurrent.futures.Executor - Add support for custom external parsers
- Add an internal Zarr V3 Parser
- Enable loading data directly via Zarr and/or Xarray without temporary serialization via Icechunk or Kerchunk
- Revamped documentation 📖
Detailed Release Notes
Read more about the numerous new features, enhancements, bug fixes, and internal improvements in the release notes.
Migration Guide
The migration guide contains detailed information about switching from VirtualiZarr 1.0 to VirtualiZarr 2.0.
v1.3.2
Small release which fixes a problem causing the docs to be out of date, fixes some issues in the tests with unclosed file handles, but also increases the performance of writing large numbers of virtual references to Icechunk!
What's Changed
- Upgrade icechunk 0.2.0 by @abarciauskas-bgse in #445
- Update
store.set_virtual_ref->store.set_virtual_refsby @norlandrhagen in #443 - Align HDF reader CF _FillValue with Zarr v3 semantics by @sharkinsspatial in #420
- Revert "Align HDF reader CF _FillValue with Zarr v3 semantics (#420)" by @TomNicholas in #457
- Store -> Datacube language in readme by @TomNicholas in #456
- Close open file handle if there aren't loadable_vars by @maxrjones in #455
- Reapply HDF reader fillvalue by @chuckwondo in #460
- Update minimum icechunk version to v0.2.4 by @TomNicholas in #462
- Add missing pytest-asyncio plugin by @chuckwondo in #461
- Release notes for v1.3.2 by @TomNicholas in #463
Full Changelog: v1.3.1...v1.3.2
v1.3.1
This is a minor version that among other things, fixes examples by using the new Icechunk syntax.
What's Changed
- Install Icechunk from Conda in CI by @TomNicholas in #425
- Remove Zarr chunk manifest writing functionality by @norlandrhagen in #426
- Update zarr 3 codec pipeline workflow by @mpiannucci in #423
- Add in-memory icechunk tests to existing roundtrip tests by @jsignell in #422
- Updates examples to newer Icechunk syntax by @norlandrhagen in #431
Full Changelog: v1.3.0...v1.3.1