Skip to content

Update Ray Data histograms to show percentiles in data dashboard#58650

Merged
alanwguo merged 7 commits intoray-project:masterfrom
alanwguo:update-histograms
Nov 18, 2025
Merged

Update Ray Data histograms to show percentiles in data dashboard#58650
alanwguo merged 7 commits intoray-project:masterfrom
alanwguo:update-histograms

Conversation

@alanwguo
Copy link
Contributor

@alanwguo alanwguo commented Nov 14, 2025

Description

The data grafana dashboard by default should work well when viewing across all operators. Use a percentile graph that is grouped by operator instead.

For the histogram bar charts, hide that in the operator panels row. This is useful for areas where we by default filter by a single operator (like in the data dashboard)

Screenshot 2025-11-14 at 2 33 16 PM Screenshot 2025-11-14 at 2 33 08 PM

Signed-off-by: Alan Guo <aguo@anyscale.com>
@alanwguo alanwguo requested a review from a team as a code owner November 14, 2025 22:22
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request is a great initiative to improve the data dashboard by replacing histograms with P90 percentile graphs for key metrics, which should provide more actionable insights. The old histogram views are thoughtfully preserved within a collapsed "Operator Panels" row for detailed, per-operator analysis.

My review has identified a critical issue in the new PromQL queries for percentile calculations that would render the graphs incorrect. I've provided specific code suggestions to fix this. Additionally, I've included a couple of medium-severity comments to enhance code maintainability by addressing code duplication and removing unused code.

Signed-off-by: Alan Guo <aguo@anyscale.com>
Signed-off-by: Alan Guo <aguo@anyscale.com>
@ray-gardener ray-gardener bot added docs An issue or change related to documentation data Ray Data-related issues observability Issues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling labels Nov 15, 2025
@bveeramani bveeramani self-assigned this Nov 16, 2025
Signed-off-by: Alan Guo <aguo@anyscale.com>
@alanwguo alanwguo added the go add ONLY when ready to merge, run all tests label Nov 17, 2025
@alanwguo alanwguo requested a review from a team as a code owner November 18, 2025 01:22
Signed-off-by: Alan Guo <aguo@anyscale.com>
@alanwguo alanwguo merged commit 9ffdd76 into ray-project:master Nov 18, 2025
6 checks passed
Aydin-ab pushed a commit to Aydin-ab/ray-aydin that referenced this pull request Nov 19, 2025
…-project#58650)

## Description
The data grafana dashboard by default should work well when viewing
across all operators. Use a percentile graph that is grouped by operator
instead.

For the histogram bar charts, hide that in the operator panels row. This
is useful for areas where we by default filter by a single operator
(like in the data dashboard)

<img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM"
src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59"
/>
<img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM"
src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2"
/>

---------

Signed-off-by: Alan Guo <aguo@anyscale.com>
Signed-off-by: Aydin Abiar <aydin@anyscale.com>
ykdojo pushed a commit to ykdojo/ray that referenced this pull request Nov 27, 2025
…-project#58650)

## Description
The data grafana dashboard by default should work well when viewing
across all operators. Use a percentile graph that is grouped by operator
instead.

For the histogram bar charts, hide that in the operator panels row. This
is useful for areas where we by default filter by a single operator
(like in the data dashboard)

<img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM"
src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59"
/>
<img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM"
src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2"
/>

---------

Signed-off-by: Alan Guo <aguo@anyscale.com>
Signed-off-by: YK <1811651+ykdojo@users.noreply.github.com>
SheldonTsen pushed a commit to SheldonTsen/ray that referenced this pull request Dec 1, 2025
…-project#58650)

## Description
The data grafana dashboard by default should work well when viewing
across all operators. Use a percentile graph that is grouped by operator
instead.

For the histogram bar charts, hide that in the operator panels row. This
is useful for areas where we by default filter by a single operator
(like in the data dashboard)

<img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM"
src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59"
/>
<img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM"
src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2"
/>

---------

Signed-off-by: Alan Guo <aguo@anyscale.com>
Future-Outlier pushed a commit to Future-Outlier/ray that referenced this pull request Dec 7, 2025
…-project#58650)

## Description
The data grafana dashboard by default should work well when viewing
across all operators. Use a percentile graph that is grouped by operator
instead.

For the histogram bar charts, hide that in the operator panels row. This
is useful for areas where we by default filter by a single operator
(like in the data dashboard)

<img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM"
src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59"
/>
<img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM"
src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2"
/>

---------

Signed-off-by: Alan Guo <aguo@anyscale.com>
Signed-off-by: Future-Outlier <eric901201@gmail.com>
peterxcli pushed a commit to peterxcli/ray that referenced this pull request Feb 25, 2026
…-project#58650)

## Description
The data grafana dashboard by default should work well when viewing
across all operators. Use a percentile graph that is grouped by operator
instead.

For the histogram bar charts, hide that in the operator panels row. This
is useful for areas where we by default filter by a single operator
(like in the data dashboard)

<img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM"
src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59"
/>
<img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM"
src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2"
/>

---------

Signed-off-by: Alan Guo <aguo@anyscale.com>
Signed-off-by: peterxcli <peterxcli@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Ray Data-related issues docs An issue or change related to documentation go add ONLY when ready to merge, run all tests observability Issues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants