[Release / Train] Update Train Release tests set to Manual by pseudo-rnd-thoughts · Pull Request #63342 · ray-project/ray

pseudo-rnd-thoughts · 2026-05-14T13:43:22Z

Description

A number of Train's release tests are set to Manual meaning that they are never tested.
This PR updates them to run them weekly

Signed-off-by: Mark Towers <mark@anyscale.com>

gemini-code-assist

Code Review

This pull request streamlines several example notebooks and release test configurations by removing unused imports, updating dependency versions (notably Llama-Factory), and transitioning various release tests from manual to scheduled frequencies. Feedback from the reviewer highlights two significant issues: the accidental removal of essential imports (ray and partial) in the object detection evaluation notebook, and the specification of a non-existent version for the transformers library in the BYOD audio script.

Signed-off-by: Mark Towers <mark@anyscale.com>

dstrodtman

Stamping to unblock once tests are passing.

github-actions · 2026-05-30T01:15:12Z

This pull request has been automatically marked as stale because it has not had
any activity for 14 days. It will be closed in another 14 days if no further activity occurs.
Thank you for your contributions.

You can always ask for help on our discussion forum or Ray's public slack channel.

If you'd like to keep this open, just leave any comment, and the stale label will be removed.

# Conflicts: # release/release_tests.yaml

Signed-off-by: Mark Towers <mark@anyscale.com>

…sorflow_benchmark.py Signed-off-by: Mark Towers <mark@anyscale.com>

Signed-off-by: Mark Towers <mark@anyscale.com>

# Conflicts: # doc/source/ray-overview/examples/e2e-multimodal-ai-workloads/notebooks/01-Batch-Inference.ipynb # doc/source/ray-overview/examples/e2e-multimodal-ai-workloads/notebooks/02-Distributed-Training.ipynb # doc/source/ray-overview/examples/e2e-multimodal-ai-workloads/notebooks/03-Online-Serving.ipynb # doc/source/ray-overview/examples/entity-recognition-with-llms/README.ipynb # doc/source/ray-overview/examples/entity-recognition-with-llms/containerfile # doc/source/ray-overview/examples/mcp-ray-serve/ci/tests.sh # doc/source/ray-overview/examples/object-detection/1.object_detection_train.ipynb # doc/source/ray-overview/examples/object-detection/2.object_detection_batch_inference_eval.ipynb # doc/source/ray-overview/examples/object-detection/3.video_processing_batch_inference.ipynb # doc/source/ray-overview/examples/object-detection/4.object_detection_serve.ipynb

Signed-off-by: Mark Towers <mark@anyscale.com>

This reverts commit 01a2212.

Signed-off-by: Mark Towers <mark@anyscale.com>

…p_finetuning.ipynb Signed-off-by: Mark Towers <mark@anyscale.com>

Signed-off-by: Mark Towers <mark@anyscale.com>

liulehui · 2026-06-15T20:39:00Z

  python: "3.10"
  group: AIR examples
-  working_dir: air_examples/dolly_v2_lightning_fsdp_finetuning
+  working_dir: air_examples/pythia_lightning_fsdp_finetuning


can we link a release test thats runs against this new one in the description?

liulehui · 2026-06-15T20:43:07Z

 pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118

-pip3 install lightning==2.0.3
+pip3 install "lightning>=2,<3" "pydantic>=2,<3" "fastapi>=0.100.0"


looks like there are some incompatibility in the https://console.anyscale-staging.com/cld_kvedZWag2qA8i5BjxUevf5i7/prj_92c7b71w55flm6gv6imv4m6vqg/jobs/prodjob_eaaqtp9y3ba8g9tc9367ucrnj4?job-logs-section-tabs=application_logs&job-tab=overview

…etune.ipynb Signed-off-by: Mark Towers <mark@anyscale.com>

cursor

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

^{Reviewed by Cursor Bugbot for commit 5df3522. Configure here.}

Signed-off-by: Mark Towers <mark@anyscale.com>

Mark Towers added 2 commits May 14, 2026 12:34

[Release / Train] Enable passing Train Release Tests

e07d9a7

Signed-off-by: Mark Towers <mark@anyscale.com>

[Release / Train] Re-enable passing Train Release Tests

3bb905a

Signed-off-by: Mark Towers <mark@anyscale.com>

pseudo-rnd-thoughts requested a review from a team as a code owner May 14, 2026 13:43

gemini-code-assist Bot reviewed May 14, 2026

View reviewed changes

Comment thread doc/source/ray-overview/examples/object-detection/2.object_detection_batch_inference_eval.ipynb Outdated

Comment thread release/ray_release/byod/byod_e2e_audio.sh

cursor Bot reviewed May 14, 2026

View reviewed changes

Comment thread doc/source/ray-overview/examples/e2e-multimodal-ai-workloads/notebooks/01-Batch-Inference.ipynb Outdated

ray-gardener Bot added train Ray Train Related Issue devprod release-test release test labels May 14, 2026

fix tune-pytorch-asha

3fe2e76

Signed-off-by: Mark Towers <mark@anyscale.com>

dstrodtman approved these changes May 15, 2026

View reviewed changes

github-actions Bot added the stale The issue is stale. It will be closed within 7 days unless there are further conversation label May 30, 2026

pseudo-rnd-thoughts added unstale A PR that has been marked unstale. It will not get marked stale again if this label is on it. and removed stale The issue is stale. It will be closed within 7 days unless there are further conversation labels Jun 1, 2026

Merge branch 'master' into train-release-manual

fbca439

# Conflicts: # release/release_tests.yaml

cursor Bot reviewed Jun 9, 2026

View reviewed changes

Comment thread doc/source/ray-overview/examples/object-detection/1.object_detection_train.ipynb Outdated

Fix changes

9c878bb

Signed-off-by: Mark Towers <mark@anyscale.com>

cursor Bot reviewed Jun 9, 2026

View reviewed changes

Comment thread doc/source/ray-overview/examples/object-detection/1.object_detection_train.ipynb Outdated

Mark Towers added 4 commits June 10, 2026 12:21

Relax the dreambooth requirements.txt and remove checkpointing on ten…

da8a57d

…sorflow_benchmark.py Signed-off-by: Mark Towers <mark@anyscale.com>

Add default to dict get

70e4308

Signed-off-by: Mark Towers <mark@anyscale.com>

Update PyO3 and Fix Anyscale SDK 2026

01a2212

Signed-off-by: Mark Towers <mark@anyscale.com>

pseudo-rnd-thoughts requested a review from a team as a code owner June 11, 2026 11:27

cursor Bot reviewed Jun 11, 2026

View reviewed changes

Comment thread release/air_tests/air_benchmarks/workloads/tensorflow_benchmark.py Outdated

Comment thread release/ray_release/cluster_manager/minimal.py Outdated

Mark Towers added 6 commits June 12, 2026 11:55

Revert "Update PyO3 and Fix Anyscale SDK 2026"

1b22556

This reverts commit 01a2212.

Fix pydantic >=2 and AZ

6c6ea7c

Signed-off-by: Mark Towers <mark@anyscale.com>

Fix tensorflow_benchmark.py

73d6816

Signed-off-by: Mark Towers <mark@anyscale.com>

Add fastapi >= 0.100.0

8a60c7b

Signed-off-by: Mark Towers <mark@anyscale.com>

Merge pip installs

7e66064

Signed-off-by: Mark Towers <mark@anyscale.com>

Convert dolly_lightning_fsdp_finetuning.ipynb to pythia_lightning_fsd…

f9b7c76

…p_finetuning.ipynb Signed-off-by: Mark Towers <mark@anyscale.com>

pseudo-rnd-thoughts requested a review from a team as a code owner June 12, 2026 15:33

Mark Towers added 2 commits June 12, 2026 16:46

pre-commit

71884e8

Signed-off-by: Mark Towers <mark@anyscale.com>

Revert to 3.10

e30733d

Signed-off-by: Mark Towers <mark@anyscale.com>

cursor Bot reviewed Jun 12, 2026

View reviewed changes

Comment thread release/air_tests/air_benchmarks/workloads/tensorflow_benchmark.py

revert torch-cu128 to gpu

ef1459b

Signed-off-by: Mark Towers <mark@anyscale.com>

liulehui reviewed Jun 15, 2026

View reviewed changes

Reduce the necessary resources for vicuna_13b_lightning_deepspeed_fin…

5df3522

…etune.ipynb Signed-off-by: Mark Towers <mark@anyscale.com>

cursor Bot reviewed Jun 16, 2026

View reviewed changes

Comment thread doc/source/train/examples/lightning/vicuna_13b_lightning_deepspeed_finetune.ipynb

Enable test, fix dreambooth requirements and change to 8x g5.4xlarge

2fa2899

Signed-off-by: Mark Towers <mark@anyscale.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Release / Train] Update Train Release tests set to Manual#63342

[Release / Train] Update Train Release tests set to Manual#63342
pseudo-rnd-thoughts wants to merge 20 commits into
ray-project:masterfrom
pseudo-rnd-thoughts:train-release-manual

pseudo-rnd-thoughts commented May 14, 2026

Uh oh!

gemini-code-assist Bot left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

dstrodtman left a comment

Uh oh!

github-actions Bot commented May 30, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

liulehui Jun 15, 2026

Uh oh!

liulehui Jun 15, 2026

Uh oh!

cursor Bot left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

pseudo-rnd-thoughts commented May 14, 2026

Description

Uh oh!

gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

Code Review

Uh oh!

Uh oh!

Uh oh!

Uh oh!

dstrodtman left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions Bot commented May 30, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

liulehui Jun 15, 2026

Choose a reason for hiding this comment

Uh oh!

liulehui Jun 15, 2026

Choose a reason for hiding this comment

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants