Skip to content

Avoid stacking when grouping by chunked array #10254

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Apr 28, 2025

Conversation

dcherian
Copy link
Contributor

Now we completely avoid constructing a very large MultiIndex in memory. I'm relying on the existing test suite, but I also manually checked that we never use self._group_dim or self.group1d when grouping by a chunked array

@dcherian dcherian added the plan to merge Final call for comments label Apr 26, 2025
@dcherian dcherian merged commit e4f8768 into pydata:main Apr 28, 2025
35 of 37 checks passed
dcherian added a commit to dcherian/xarray that referenced this pull request Apr 29, 2025
* main:
  Fix convert calendar on non-temporal data in datasets (pydata#10268)
  BinGrouper: reduce indirection (pydata#10270)
  Fix reduction by subset of grouper dimensions (pydata#10258)
  Shorten text repr for ``DataTree`` (pydata#10139)
  Fix benchmarks runners (pydata#10265)
  Fix infinite recursion when calling `np.fix` (pydata#10248)
  BinGrouper: Support setting labels when provided with IntervalIndex (pydata#10259)
  Avoid stacking when grouping by chunked array (pydata#10254)
  Improve alignment checks (pydata#10251)
  Update how-to-add-new-backend.rst (pydata#10240)
  Support extension array indexes (pydata#9671)
  Switch documentation to pydata-sphinx-theme (pydata#8708)
  Bump codecov/codecov-action from 5.4.0 to 5.4.2 in the actions group (pydata#10239)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant