Skip to content

Releases: opendatacube/datacube-core

Open Data Cube release 1.9.7

05 Aug 03:34
Compare
Choose a tag to compare

This release includes a fix for a critical bug affecting dask loading and the postgis index driver.

What's Changed

Full Changelog: 1.9.6...1.9.7

Includes contributions from @pjonsson, @SpacemanPaul, @emmaai and @Ariana-B

The Open Data Cube Steering Council thanks and acknowledges the ongoing support of Geoscience Australia and RISE.

Open Data Cube 1.9.6

11 Jul 01:43
Compare
Choose a tag to compare

This release brings odc-stac in as a direct dependency of datacube-core and moves some STAC to EO3
conversion code out of odc-stac into core as the first step in an organisation-wide cross-repo consolidation and
refactor of STAC handling code and in preparation for more native suppport of STAC metadata within core.

It also contains some enhancements to CLI commands, bugfixes and cleanup.

What's Changed

Full Changelog: 1.9.5...1.9.6

Includes contributions from @pjonsson, @Ariana-B, @omad, and @SpacemanPaul.

The Open Data Cube Steering Council thanks and acknowledges the ongoing support of
Geoscience Australia, CSIRO and RISE.

Open Data Cube 1.9.5

17 Jun 02:12
8389498
Compare
Choose a tag to compare

This release introduces support for boolean type search fields, as well as a handful of bug-fixes.

What's Changed

New feature:

  • Add boolean field definition (addressing issue #1937) #1949

Bug fixes:

  • Export grid workflow classes from datacube.api fixing issue #1953 #1958
  • archive-less-mature runs when re-indexing datasets (fixing issue #1917) #1948
  • Serialise Measurement with canonical name (fixing issue #1936) #1962

Docker image improvements:

  • Dockerfile: switch to ubuntu user #1964
  • Dockerfile: let rasterio detect data path #1966

Miscellaneous code cleanup and CI improvements:

  • model: handle integer resolution #1967
  • Remove types-redis dependency #1965
  • index: add return types #1939
  • Update dependencies #1925
  • Run Ruff format on all code #1926, #1927
  • Group all dependabot updates in the 'uv' ecosystem. #1928, #1934
  • Move deprecated imports #1938
  • Remove empty doc strings #1946
  • index: fix search_by_product type #1944
  • Put coverage config in pyproject #1942
  • Fix alembic deprecation warning #1941
  • Convert doc strings to type annotations #1940, #1950, #1951
  • Convert doc strings to type annotations #1940
  • Document alembic upgrades #1955
  • postgis: stop parsing table names #1961
  • postgis: fix alembic metadata object #1960
  • increment fallback version and finalise release notes #1970

Automated updates

Includes contributions from @pjonsson, @omad, @emmaai, @Ariana-B and @SpacemanPaul, with thanks to
supporting organisations CSIRO, RISE and Geoscience Australia.

Full Changelog: 1.9.4...1.9.5

v1.9.4 (20 May 2025)

20 May 05:49
Compare
Choose a tag to compare

Improvements

Bring back GridWorkflow

GridWorkflow is back! It was accidentally removed with the deprecated ingestion tools as part of the ODC 1.9 release, since it’s no longer needed internally. It is however an extremely useful public API for anyone running large scale data summaries and is used by ODC Statistician.

GridWorkflow has been updated to use the odc-geo geometry classes.

See: issue 1749 and PR 1760

Fixed Dask load crash in some cases

There was a regression in data loading with dask in Datacube 1.9. It only occurred in rare cases so only affected some people.

The load failed whenever there were completely empty data chunks, which are rectangular in shape. That is, X != Y.

See PR 1780 and issue 1779 for details.

Cleaning and Tidying

Massive cleaning effort across the codebase, spearheaded by @pjonsson, with a focus on:

Improvements in type annotations

Linting fixes

Code formatting and import ordering

Continuous integration improvements

See the ODC Docs Whats New page for more details.

Other Changes

Read more

1.9.3

14 Apr 07:04
88dfa6d
Compare
Choose a tag to compare

Contains a fix to a serious bug affecting dask usage, preparation for psycopg3, and a lot of other minor cleanup,
tweaks and fixes.

Includes contributions from @pjonsson, @omad, @caitlinadams, @SpacemanPaul and first PRs from new contributors
@emmanuel-ferdman and @allrob23.

Special thanks to @pjonsson who is single-handedly responsible for most of the PRs in this release, and to
to all supporting organisations including Geoscience Australia, CSIRO and RISE.

Known Issue

There are still some issues with Dask loading in 1.9. We are looking into them and anticipate a 1.9.4 release
to fix them in the next few weeks.

Full list of changes:

Bug Fixes

  • Fix error when run with Python 3.10 causing pickling errors #1776
  • Stop filtering warnings #1734

Warnings Cleanup:

  • Fix some readthedocs warnings #1762
  • config.py: emit ODC2DeprecationWarning #1733
  • tests: ignore deliberate warnings #1741, #1754, #1768
  • Add a common table expression to fix a SQLAlchemy 2.0 sub-query warning #1747
  • Fix ODC2DeprecationWarnings #1737, #1738, #1745
  • Undeprecate Product.grid_spec #1770

Minor Fixes and Cleanup:

Typechecking Cleanups:

CI Fixes and Improvements:

  • CI: fix docker image name #1730
  • CI: fix codecov warning #1740
  • CI: retry more in setup-miniconda #1753
  • CI: cancel old PR jobs #1761
  • CI: update doctor rst version #1775
  • Stop building Python 2 wheels #1752
  • pytest: only test documentation for relevant files #1751
  • Autoupdates #1723, #1726, #1729, #1771
  • Update mypy version #1743

1.9.2

26 Feb 04:30
d93344b
Compare
Choose a tag to compare

What's Changed

  • Fix postgis filtered count bug (#1717)
  • Suppress cartesian join warnings (#1719)
  • Remove stray debug message and minor mypy cleanup (#1720)
  • Update whats_new ready for 1.9.2 release (#1720)

Full Changelog: 1.9.1...1.9.2

The work in this release was funded by Auspatious for the Digital Earth Pacific project.

Includes contributions from @SpacemanPaul

1.9.1

25 Feb 04:03
Compare
Choose a tag to compare

Changes

  • Make compatible with Dask/Distributed versions 2024.11 and above. A change in how Dask transmitted ODC data structures broke data loading in these versions. We had a dependency restriction to prevent incompatible versions being installed, which is now removed. PR 1706
  • New Documentation Theme which scales properly for mobiles, includes a dark mode, looks cleaner and is much more maintainable. PR 1676, PR 1702
  • Extend the allowed range of PostgreSQL TCP Ports to 65,535. Known as dynamic or ephemeral port numbers, they aren’t used for permanent servers, but are useful when dynamically running servers for tests. PR 1697

Test fixes

  • Fix compatibility with antimeridian 0.4+, which includes a superior implementation of splitting, using great circle coordinates instead of a simple 2D plane. PR 1708
  • Make tests pass when run as root, which often happens within a docker container. PR 1705
  • Hard code the use of nanosecond precision within xarray data. PR 1707

Maintenance

  • Update pre-commit hooks. PR 1701, PR 1699, PR 1710
  • Update copyright dates for 2025.
  • Remove our GitHub Actions dependency on DockerHub (and credentials). PR 1711
  • Update the release process to be a bit simpler, and use OIDC for authentication with PyPI. PR 1713

1.9.1rc2

25 Feb 02:37
Compare
Choose a tag to compare
1.9.1rc2 Pre-release
Pre-release

What's Changed

  • [chore] Update pre commit hooks, copyright dates for 2025, Doc-QA checks, mypy version pin by @omad in #1699
  • Dra/extend valid db port range by @omad in #1697
  • Major documentation theme update and fixes by @omad in #1676
  • Fix: Use canonical RTD url everywhere by @omad in #1702
  • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1701
  • Fix dask 2024.11+ incompatibility by @omad in #1706
  • Hardcode to ns precision times in xarray by @omad in #1707
  • Fix failing configuration test when running as root (and fix potential crash on misconfigured config paths) by @omad in #1705
  • Fix tests for antimeridian 0.4+ by @omad in #1708
  • [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1710
  • In GHA Always Build Test Docker (And don't rely on DockerHub/credentials) by @omad in #1711
  • Improve automated release process with OIDC and uv by @omad in #1713
  • Prepare release notes for 1.9.1 release by @omad in #1714
  • Allow GHA to Authenticate with OIDC to PyPI by @omad in #1715

Full Changelog: 1.9.0...1.9.1rc2

Open Data Cube 1.9.0

23 Dec 00:03
39c96e8
Compare
Choose a tag to compare

Open Data Cube 1.9.0 release

1.9.0 is first major release of the Open Data Cube in several years. The focus has been on retiring technical
debt and unused features and preparing for major architectural changes in subsequent releases.

As there are some backwards incompatibilities in this release, we recommend that you read the migration notes
at docs/installation/MIGRATION-1.8-to-1.9 before upgrading.

Major changes from recent 1.8.x releases include:

  • A new index driver that uses PostGIS spatial indexes to provide faster and more accurate geospatial search
    and provide better support for storing data that covers regions where traditional lat/long seach is
    inadequate (i.e. covering polar regions or crossing the anti-meridian).

    The new postgis index driver implements a new API for working with dataset lineage, and only supports
    a single location per dataset. It is otherwise largely backwards compatible with the legacy postgres index driver.

    The legacy "postgres" index driver is still available, but will be removed in a future release.

  • A new configuration layer that provides more predictable and consistent behaviour and will be easier to
    extend in future.

    Given the nature and scope of the changes, the new configuration layer is not fully backwards compatible
    with the old implementation, but the vast majority of use cases should only require minor adjustments
    to existing configuration and code at most.

  • The old datacube.utils.geometry library is now deprecated. odc-geo is used internally throughout,
    and we recommend updating all your code to use odc-geo rather than the deprecated internal library.

  • The long-deprecated executor and ingestion workflows have been removed.

Changes since 1.9.0-rc13

  • API autodocs cleanup (#1688)
  • Further metadata fix for new lineage API (#1690)
  • Update release process ready for post-1.9.0 release (#1691)
  • Removed all references to the postgis driver as "experimental" in tests and documentation (#1693)
  • Update whats_new.rst etc. for 1.9.0 release (#1694)

With thanks to all who contributed to 1.9.0 development: @omad, @whatnick, @pjonsson, @alexgleith, @Kirill888, @robbibt, @snowman2, @caitlinadams, @Ariana-B, and @SpacemanPaul

Open Data Cube 1.9.0-rc13 pre-release

16 Dec 03:40
1315a6e
Compare
Choose a tag to compare
Pre-release

Open Data Cube 1.9.0-rc13

Pre-release of the lineage API bug-fix needed for Explorer pre-release.

This will most likely be the last release candidate before the 1.9.0 release.

Changes since 1.9.0-rc13

  • Update and cross-reference 1.8 to 1.9 migration notes (#1686)
  • Fix SimpleDocNav lineage handling with PostGIS index (#1687)
  • Update whats_new.rst for 1.9.0-r13 pre-release (#1689)

Includes contributions from @SpacemanPaul and @Ariana-B