Skip to content

Exclude models from idle unloading #9305

@loryanstrant

Description

@loryanstrant

Is your feature request related to a problem? Please describe.

No

Describe the solution you'd like

I'd love the ability for some models to stay loaded to improve their responsiveness, while being able to unload others.
The ideal state would be to have a toggle or somewhere in the settings where we can list particular models that are excluded from unloading.

Describe alternatives you've considered

I've tried turning the idle unloading toggle off, and extending the time - but this has a negative effect when there are other models that I do want to be unloaded due to idle.

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions