Skip to content

Custom memory pool #61

Open
Open

Description

@sanjibansg

Often experiments need to pass their own GPU stream and memory pools that the inference code can utilize instead of allocating memory on their own. The generated code by SOFIE should be capable of also using it instead of instantiating a queue and a memory pool of its own.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions