Open
Description
Is your feature request related to a problem or challenge?
Tracking ticket for next release, also a place to track desired inclusions
Previous release will be https://crates.io/crates/datafusion/47.0.0 (June, 2025) so next major release would be late June or Early July 2025
Steps:
- Update version and changelog:
- Test with DataFusion Python:
- Test with DataFusion Comet
- Test with delta.rs:
- Test with LakeSail:
- Write upgrade guide:
- Test with parquet viewer
- Test with datafusion-materialized-views
- Voting Thread:
- Create ticket for next release:
Prior release tickets:
Changes to add to upgrade guide
These PRs made changes that deserve a mention in the upgrade guide
- [MAJOR] Equivalence System Overhaul #16217
- Update upgrade md for new unified config for sql string mapping to utf8view when we release datafusion 49.0.0 #16428
- Add compression option to SpillManager #16268
Features to mention in the blog (if they make it)
- Introduce Async User Defined Functions #14837
- [EPIC] A collection of tickets for improving sorting larger than memory datasets / spilling sorts #15271
- TopK dynamic filter pushdown attempt 2 #15770
- Support integration with Parquet modular encryption #15216
- [MAJOR] Equivalence System Overhaul #16217
- Use Tokio's task budget consistently, better APIs to support task cancellation #16398
Bugs that need to be fixed
- Panic in
datafusion_expr::window_state::WindowAggState::update
#16308 - SortQueryFuzzer found a failing case on main #16452
- Wrong results when
pushdown_filters
is enabled (starting in 48.0.0) #16588 - Extended tests are failing #16595