Skip to content

[Flaky Tests] 5736 flaky test(s) detected #4480

Open

Description

@github-actions

Flaky Test Report - 2026-10-24

Summary:

  • Flaky tests: 5736
  • Newly flaky (last 7 days): 2
  • Resolved: 0

Flaky Test Report - 2026-10-24

Summary

  • Flaky tests: 5736
  • Newly flaky (last 7 days): 2
  • Resolved: 0
  • Total tests analyzed: 32760
  • CI runs analyzed: 60

Flaky Tests

Test Failure Rate Failures Flaky Score Last Failed
...replay_collection_smoke[cuda-async-True-True-True-frames] 20.0% (15/75) 15 0.40 2026-10-22
..._replay_collection_smoke[cuda-sync-True-True-True-frames] 20.0% (15/75) 15 0.40 2026-10-22
...replay_collection_smoke[cuda-async-True-False-False-time] 20.0% (15/75) 15 0.40 2026-10-22
...play_collection_smoke[cuda-async-True-False-False-warmup] 20.0% (15/75) 15 0.40 2026-10-22
...ollection_smoke[cuda-sync-True-False-False-reset_records] 20.0% (15/75) 15 0.40 2026-10-22
...eamer_v3_process_inference_collection_smoke[cuda:0-False] 20.0% (15/75) 15 0.40 2026-10-22
...reamer_v3_process_inference_collection_smoke[cuda:0-True] 20.0% (15/75) 15 0.40 2026-10-22
...d.py::test_cuda_prioritized_replay_buffer_samples_on_cuda 20.0% (15/75) 15 0.40 2026-10-22
...ict_prioritized_replay_buffer_memmap_storage_cuda_sampler 20.0% (15/75) 15 0.40 2026-10-22
...cuda_prioritized_replay_buffer_weight_matches_cpu_formula 20.0% (15/75) 15 0.40 2026-10-22
...b/test_rb_core.py::TestSequenceUnit::test_non_cpu_storage 20.0% (15/75) 15 0.40 2026-10-22
...ce[tensor-LazyMemmapStorage-device_data0-device_storage0] 20.0% (15/75) 15 0.40 2026-10-22
...torage_device[tensor-LazyMemmapStorage-device_data3-auto] 20.0% (15/75) 15 0.40 2026-10-22
...ce[tensor-LazyTensorStorage-device_data0-device_storage0] 20.0% (15/75) 15 0.40 2026-10-22
...torage_device[tensor-LazyTensorStorage-device_data3-auto] 20.0% (15/75) 15 0.40 2026-10-22
...device[tc-LazyMemmapStorage-device_data0-device_storage0] 20.0% (15/75) 15 0.40 2026-10-22
...st_storage_device[tc-LazyMemmapStorage-device_data3-auto] 20.0% (15/75) 15 0.40 2026-10-22
...device[tc-LazyTensorStorage-device_data0-device_storage0] 20.0% (15/75) 15 0.40 2026-10-22
...st_storage_device[tc-LazyTensorStorage-device_data3-auto] 20.0% (15/75) 15 0.40 2026-10-22
...device[td-LazyMemmapStorage-device_data0-device_storage0] 20.0% (15/75) 15 0.40 2026-10-22

Newly Flaky Tests

  • test/rb/test_storages.py::TestStorageExport::test_device_storage[cuda-ListStorage-True]
  • test/objectives/test_transitive_q.py::TestTransitiveQLoss::test_compile_matches_eager

Configuration

  • Minimum failure rate: 5%
  • Maximum failure rate: 95%
  • Minimum failures required: 2
  • Minimum executions required: 3

Generated at 2026-10-24T06:28:29.732433+00:00


This issue is automatically updated daily. See the full dashboard for more details.

Activity

  1. changed the title [-][Flaky Tests] 72 flaky test(s) detected[/-] [+][Flaky Tests] 5712 flaky test(s) detected[/+] on Sep 23, 2026
  2. changed the title [-][Flaky Tests] 5712 flaky test(s) detected[/-] [+][Flaky Tests] 72 flaky test(s) detected[/+] on Sep 25, 2026
  3. changed the title [-][Flaky Tests] 72 flaky test(s) detected[/-] [+][Flaky Tests] 5735 flaky test(s) detected[/+] on Sep 28, 2026
  4. changed the title [-][Flaky Tests] 5735 flaky test(s) detected[/-] [+][Flaky Tests] 72 flaky test(s) detected[/+] on Sep 29, 2026
  5. changed the title [-][Flaky Tests] 72 flaky test(s) detected[/-] [+][Flaky Tests] 5732 flaky test(s) detected[/+] on Sep 30, 2026
  6. changed the title [-][Flaky Tests] 5732 flaky test(s) detected[/-] [+][Flaky Tests] 72 flaky test(s) detected[/+] on Oct 1, 2026
  7. changed the title [-][Flaky Tests] 72 flaky test(s) detected[/-] [+][Flaky Tests] 5732 flaky test(s) detected[/+] on Oct 3, 2026
  8. changed the title [-][Flaky Tests] 5732 flaky test(s) detected[/-] [+][Flaky Tests] 5765 flaky test(s) detected[/+] on Oct 4, 2026
  9. changed the title [-][Flaky Tests] 5765 flaky test(s) detected[/-] [+][Flaky Tests] 3 flaky test(s) detected[/+] on Oct 5, 2026
  10. changed the title [-][Flaky Tests] 3 flaky test(s) detected[/-] [+][Flaky Tests] 5768 flaky test(s) detected[/+] on Oct 6, 2026
  11. changed the title [-][Flaky Tests] 5768 flaky test(s) detected[/-] [+][Flaky Tests] 5772 flaky test(s) detected[/+] on Oct 9, 2026
  12. changed the title [-][Flaky Tests] 5772 flaky test(s) detected[/-] [+][Flaky Tests] 5773 flaky test(s) detected[/+] on Oct 10, 2026
  13. changed the title [-][Flaky Tests] 5773 flaky test(s) detected[/-] [+][Flaky Tests] 5772 flaky test(s) detected[/+] on Oct 14, 2026
  14. changed the title [-][Flaky Tests] 5772 flaky test(s) detected[/-] [+][Flaky Tests] 5771 flaky test(s) detected[/+] on Oct 15, 2026
  15. changed the title [-][Flaky Tests] 5771 flaky test(s) detected[/-] [+][Flaky Tests] 5735 flaky test(s) detected[/+] on Oct 16, 2026
  16. changed the title [-][Flaky Tests] 5735 flaky test(s) detected[/-] [+][Flaky Tests] 5736 flaky test(s) detected[/+] on Oct 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    CIHas to do with CI setup (e.g. wheels & builds, tests...)flaky-test-tracker

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions