Skip to content
This repository was archived by the owner on Jun 5, 2025. It is now read-only.
This repository was archived by the owner on Jun 5, 2025. It is now read-only.

[Story]: Extend Muxing to Differentiate Between Chat and FIM Requests #1059

Closed
2 of 2 issues completed
Closed

Description

@aponcedeleonch

Description

We currently support routing logic based on filenames, and now we need to extend that functionality to differentiate between chat requests and Fill-In-Middle (FIM) requests.

Example

  • A chat that references app.py → Model 1
  • A FIM request within app.py → Model 2

Implementation Outline

  • Extend the existing muxing rules to include a check for request type (chat or FIM).
  • Allow users to configure which model should handle chat requests vs. FIM for specific filenames.

Additional Context

No response

Activity

  1. changed the title [-][Story]: Extend muxing for support FIM and Chat requests[/-] [+][Story]: Extend Muxing to Differentiate Between Chat and FIM Requests[/+] on Feb 14, 2025
  2. aponcedeleonch commented on Mar 3, 2025

    @aponcedeleonch
    MemberAuthor

    Closed by the tickets mentioned above

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions