Skip to content

Specify rank ID for component to run only on some ranks #4056

Description

@Nic-Ma

Is your feature request related to a problem? Please describe.
For multi-gpu training / inference, many some components only need to execute on specified ranks, so it would be nice to support the config for target rank ID.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    Status
    No status

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions