This repository was archived by the owner on Jul 3, 2023. It is now read-only.
Repository navigation
This repository was archived by the owner on Jul 3, 2023. It is now read-only.
Avoid redundant distinct applications #287
Description
distinct is a no-op when it is connected to the output of aggregate, rolling_aggregate or any other operator that outputs collections with unit weights only. Implement a simple optimization that skips inserting distinct in such cases, similar to how we don't shard already sharded data.
Activity