Skip to content

[Data] Compute Expressions-fixed size array#58741

Merged
bveeramani merged 28 commits intoray-project:masterfrom
400Ping:data/compute-expressions-arr
Jan 14, 2026
Merged

[Data] Compute Expressions-fixed size array#58741
bveeramani merged 28 commits intoray-project:masterfrom
400Ping:data/compute-expressions-arr

Conversation

@400Ping
Copy link
Contributor

@400Ping 400Ping commented Nov 18, 2025

Description

Completing the fixed-size array namespace operations

Related issues

Related to #58674

Additional information

@400Ping 400Ping requested a review from a team as a code owner November 18, 2025 15:44
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a new _ArrayNamespace to handle fixed-size array operations in Ray Data expressions, adding flatten() and to_list() methods. The implementation is a good start, but I've identified a couple of issues in the new arr_namespace.py file. Specifically, the flatten() method has incorrect fallback logic that makes its behavior inconsistent, and the to_list() method can be optimized for better performance. My review includes suggestions to fix these issues for improved correctness and efficiency.

@400Ping 400Ping marked this pull request as draft November 18, 2025 16:37
@400Ping 400Ping marked this pull request as ready for review November 18, 2025 16:38
@400Ping 400Ping force-pushed the data/compute-expressions-arr branch from a86b794 to 000cf1e Compare November 18, 2025 16:42
@400Ping 400Ping changed the title [Data]Compute Expressions-fixed size array [WIP[Data]Compute Expressions-fixed size array Nov 18, 2025
@400Ping 400Ping changed the title [WIP[Data]Compute Expressions-fixed size array [WIP][Data]Compute Expressions-fixed size array Nov 18, 2025
@ray-gardener ray-gardener bot added data Ray Data-related issues community-contribution Contributed by the community labels Nov 18, 2025
@gvspraveen
Copy link
Contributor

Hi @400Ping Thanks for contribution. Can you fix the CI (lint issue)?

Copy link
Contributor

@iamjustinhsu iamjustinhsu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @400Ping! Can you also add some tests?

@400Ping 400Ping marked this pull request as draft November 20, 2025 10:27
Signed-off-by: 400Ping <fourhundredping@gmail.com>
Signed-off-by: 400Ping <fourhundredping@gmail.com>
Signed-off-by: 400Ping <fourhundredping@gmail.com>
Signed-off-by: 400Ping <fourhundredping@gmail.com>
@400Ping 400Ping force-pushed the data/compute-expressions-arr branch from 987ca07 to 7819f4b Compare November 21, 2025 18:38
Signed-off-by: 400Ping <fourhundredping@gmail.com>
@400Ping 400Ping changed the title [WIP][Data]Compute Expressions-fixed size array [Data] Compute Expressions-fixed size array Nov 22, 2025
@400Ping 400Ping marked this pull request as ready for review November 22, 2025 05:56
@400Ping
Copy link
Contributor Author

400Ping commented Nov 23, 2025

cc @goutamvenkat-anyscale PTAL

Signed-off-by: 400Ping <fourhundredping@gmail.com>
@400Ping 400Ping requested a review from iamjustinhsu November 25, 2025 06:03
Signed-off-by: Ping <fourhundredping@gmail.com>
Signed-off-by: 400Ping <fourhundredping@gmail.com>
@400Ping
Copy link
Contributor Author

400Ping commented Dec 7, 2025

@goutamvenkat-anyscale fixed, PTAL.

@400Ping
Copy link
Contributor Author

400Ping commented Dec 11, 2025

cc @iamjustinhsu

@400Ping
Copy link
Contributor Author

400Ping commented Dec 11, 2025

cc @owenowenisme @bveeramani PTAL

Signed-off-by: 400Ping <fourhundredping@gmail.com>
Signed-off-by: 400Ping <fourhundredping@gmail.com>
@400Ping
Copy link
Contributor Author

400Ping commented Dec 17, 2025

cc @goutamvenkat-anyscale

@400Ping
Copy link
Contributor Author

400Ping commented Dec 31, 2025

@goutamvenkat-anyscale PTAL

@400Ping
Copy link
Contributor Author

400Ping commented Jan 8, 2026

@goutamvenkat-anyscale

@owenowenisme
Copy link
Member

@400Ping Could you fix the conflict first? Thanks.

Signed-off-by: 400Ping <fourhundredping@gmail.com>
@400Ping
Copy link
Contributor Author

400Ping commented Jan 10, 2026

@400Ping Could you fix the conflict first? Thanks.

Done

Copy link
Contributor

@goutamvenkat-anyscale goutamvenkat-anyscale left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks good. Thanks.

Just a couple of comments

Signed-off-by: 400Ping <fourhundredping@gmail.com>
Copy link
Contributor

@goutamvenkat-anyscale goutamvenkat-anyscale left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Signed-off-by: 400Ping <fourhundredping@gmail.com>
@bveeramani bveeramani merged commit 28bca7a into ray-project:master Jan 14, 2026
6 checks passed
jeffery4011 pushed a commit to jeffery4011/ray that referenced this pull request Jan 20, 2026
## Description
Completing the fixed-size array namespace operations

## Related issues
Related to ray-project#58674

## Additional information

---------

Signed-off-by: 400Ping <fourhundredping@gmail.com>
Signed-off-by: Ping <fourhundredping@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: jeffery4011 <jefferyshen1015@gmail.com>
ryanaoleary pushed a commit to ryanaoleary/ray that referenced this pull request Feb 3, 2026
## Description
Completing the fixed-size array namespace operations

## Related issues
Related to ray-project#58674 

## Additional information

---------

Signed-off-by: 400Ping <fourhundredping@gmail.com>
Signed-off-by: Ping <fourhundredping@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
peterxcli pushed a commit to peterxcli/ray that referenced this pull request Feb 25, 2026
## Description
Completing the fixed-size array namespace operations

## Related issues
Related to ray-project#58674

## Additional information

---------

Signed-off-by: 400Ping <fourhundredping@gmail.com>
Signed-off-by: Ping <fourhundredping@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: peterxcli <peterxcli@gmail.com>
peterxcli pushed a commit to peterxcli/ray that referenced this pull request Feb 25, 2026
## Description
Completing the fixed-size array namespace operations

## Related issues
Related to ray-project#58674

## Additional information

---------

Signed-off-by: 400Ping <fourhundredping@gmail.com>
Signed-off-by: Ping <fourhundredping@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: peterxcli <peterxcli@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-contribution Contributed by the community data Ray Data-related issues @external-author-action-required Alternate tag for PRs where the author doesn't have labeling permission. go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants