Repository navigation
[Flaky Tests] 5736 flaky test(s) detected #4480
Copy link
Copy link
Open
Labels
CIHas to do with CI setup (e.g. wheels & builds, tests...)Has to do with CI setup (e.g. wheels & builds, tests...)flaky-test-tracker
Description
Flaky Test Report - 2026-10-24
Summary:
- Flaky tests: 5736
- Newly flaky (last 7 days): 2
- Resolved: 0
Flaky Test Report - 2026-10-24
Summary
- Flaky tests: 5736
- Newly flaky (last 7 days): 2
- Resolved: 0
- Total tests analyzed: 32760
- CI runs analyzed: 60
Flaky Tests
| Test | Failure Rate | Failures | Flaky Score | Last Failed |
|---|---|---|---|---|
...replay_collection_smoke[cuda-async-True-True-True-frames] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
..._replay_collection_smoke[cuda-sync-True-True-True-frames] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...replay_collection_smoke[cuda-async-True-False-False-time] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...play_collection_smoke[cuda-async-True-False-False-warmup] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...ollection_smoke[cuda-sync-True-False-False-reset_records] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...eamer_v3_process_inference_collection_smoke[cuda:0-False] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...reamer_v3_process_inference_collection_smoke[cuda:0-True] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...d.py::test_cuda_prioritized_replay_buffer_samples_on_cuda |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...ict_prioritized_replay_buffer_memmap_storage_cuda_sampler |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...cuda_prioritized_replay_buffer_weight_matches_cpu_formula |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...b/test_rb_core.py::TestSequenceUnit::test_non_cpu_storage |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...ce[tensor-LazyMemmapStorage-device_data0-device_storage0] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...torage_device[tensor-LazyMemmapStorage-device_data3-auto] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...ce[tensor-LazyTensorStorage-device_data0-device_storage0] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...torage_device[tensor-LazyTensorStorage-device_data3-auto] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...device[tc-LazyMemmapStorage-device_data0-device_storage0] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...st_storage_device[tc-LazyMemmapStorage-device_data3-auto] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...device[tc-LazyTensorStorage-device_data0-device_storage0] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...st_storage_device[tc-LazyTensorStorage-device_data3-auto] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
...device[td-LazyMemmapStorage-device_data0-device_storage0] |
20.0% (15/75) | 15 | 0.40 | 2026-10-22 |
Newly Flaky Tests
test/rb/test_storages.py::TestStorageExport::test_device_storage[cuda-ListStorage-True]test/objectives/test_transitive_q.py::TestTransitiveQLoss::test_compile_matches_eager
Configuration
- Minimum failure rate: 5%
- Maximum failure rate: 95%
- Minimum failures required: 2
- Minimum executions required: 3
Generated at 2026-10-24T06:28:29.732433+00:00
This issue is automatically updated daily. See the full dashboard for more details.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
CIHas to do with CI setup (e.g. wheels & builds, tests...)Has to do with CI setup (e.g. wheels & builds, tests...)flaky-test-tracker
Activity
[-][Flaky Tests] 72 flaky test(s) detected[/-][+][Flaky Tests] 5712 flaky test(s) detected[/+][-][Flaky Tests] 5712 flaky test(s) detected[/-][+][Flaky Tests] 72 flaky test(s) detected[/+][-][Flaky Tests] 72 flaky test(s) detected[/-][+][Flaky Tests] 5735 flaky test(s) detected[/+][-][Flaky Tests] 5735 flaky test(s) detected[/-][+][Flaky Tests] 72 flaky test(s) detected[/+][-][Flaky Tests] 72 flaky test(s) detected[/-][+][Flaky Tests] 5732 flaky test(s) detected[/+][-][Flaky Tests] 5732 flaky test(s) detected[/-][+][Flaky Tests] 72 flaky test(s) detected[/+][-][Flaky Tests] 72 flaky test(s) detected[/-][+][Flaky Tests] 5732 flaky test(s) detected[/+][-][Flaky Tests] 5732 flaky test(s) detected[/-][+][Flaky Tests] 5765 flaky test(s) detected[/+][-][Flaky Tests] 5765 flaky test(s) detected[/-][+][Flaky Tests] 3 flaky test(s) detected[/+][-][Flaky Tests] 3 flaky test(s) detected[/-][+][Flaky Tests] 5768 flaky test(s) detected[/+][-][Flaky Tests] 5768 flaky test(s) detected[/-][+][Flaky Tests] 5772 flaky test(s) detected[/+][-][Flaky Tests] 5772 flaky test(s) detected[/-][+][Flaky Tests] 5773 flaky test(s) detected[/+][-][Flaky Tests] 5773 flaky test(s) detected[/-][+][Flaky Tests] 5772 flaky test(s) detected[/+][-][Flaky Tests] 5772 flaky test(s) detected[/-][+][Flaky Tests] 5771 flaky test(s) detected[/+][-][Flaky Tests] 5771 flaky test(s) detected[/-][+][Flaky Tests] 5735 flaky test(s) detected[/+][-][Flaky Tests] 5735 flaky test(s) detected[/-][+][Flaky Tests] 5736 flaky test(s) detected[/+]