Skip to content

[FEAT][distributed]: implement overlapping rollout and training pipeline #18

Closed
Closed
[FEAT][distributed]: implement overlapping rollout and training pipeline#18
Assignees
inaniloquentee
Labels
component: distributedTasks involving Ray actor management, cross-node scheduling, and communication synchronization.enhancementNew feature or requestpriority: highSevere congestion issues require the highest priority for resolution.type: performancePerformance optimization tasks aimed at increasing throughput and reducing latency etc.

Description

@Flink-ddd
Flink-ddd
opened on May 18, 2026

Construct an advanced asynchronous execution pipeline to overlap computing cycles. Allow vLLM rollout workers to sample data for iteration N+1 concurrently while DeepSpeed training workers process gradients for iteration N.

Activity

  1. Flink-ddd
    added
    enhancementNew feature or request
    component: distributedTasks involving Ray actor management, cross-node scheduling, and communication synchronization.
    type: performancePerformance optimization tasks aimed at increasing throughput and reducing latency etc.
    priority: highSevere congestion issues require the highest priority for resolution.
    on May 31, 2026
  2. inaniloquentee
    self-assigned this
    on May 31, 2026

  3. inaniloquentee commented on Jun 2, 2026

    @inaniloquentee
    inaniloquentee
    on Jun 2, 2026
    Collaborator

    This is the PR: https://github.com/Flink-ddd/RL-Kernel/pull/61

  4. inaniloquentee
    closed this as completedon Jun 9, 2026
  5. zhangj1an
    added 2 commits that reference this issue on Sep 3, 2026

    [DSv4][P1-S0] Use the real sub-issues of #2 (#14-#21)

    5bb39bf

    [DSv4][P1-S0] Use the real sub-issues of #2 (#14-#21)

    39c4aea
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

component: distributedTasks involving Ray actor management, cross-node scheduling, and communication synchronization.enhancementNew feature or requestpriority: highSevere congestion issues require the highest priority for resolution.type: performancePerformance optimization tasks aimed at increasing throughput and reducing latency etc.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions