Skip to content
This repository was archived by the owner on Jul 3, 2023. It is now read-only.

Avoid redundant distinct applications #287

Open
ryzhyk opened this issue Feb 3, 2023 · 0 comments
Open

Avoid redundant distinct applications #287

ryzhyk opened this issue Feb 3, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@ryzhyk
Copy link
Collaborator

ryzhyk commented Feb 3, 2023

distinct is a no-op when it is connected to the output of aggregate, rolling_aggregate or any other operator that outputs collections with unit weights only. Implement a simple optimization that skips inserting distinct in such cases, similar to how we don't shard already sharded data.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant