This repository was archived by the owner on Jun 5, 2025. It is now read-only.
Repository navigation
This repository was archived by the owner on Jun 5, 2025. It is now read-only.
Implement pipelines for FIM #87
Description
We can call directly the endpoint in our gcloud instance from vscode with the following config
"tabAutocompleteModel": {
"title": "Stacklok Hosted - Non Instruct",
"provider": "openai",
"model": "Qwen/Qwen2.5-Coder-14B",
"apiKey": "$(token)",
"apiBase": "https://inference.codegate.ai/v1"
},
"tabAutocompleteOptions": {
"debounceDelay": 500
}Make the necessary code changes so that the request first passes through CodeGate and then goes to gcloud
Metadata
Metadata
Assignees
Labels
No labels
Activity
Add a FIM pipeline to providers
Add a FIM pipeline to providers
[-]Call the non-instruct model through CodeGate[/-][+]Implement pipelines for FIM[/+]aponcedeleonch commentedon Nov 27, 2024
The description of the task can be generalized to be able to call any model with FIM. The current logic of CodeGate should be already prepared to handle such requests. There are 2 changes that need to be made:
messages. However, there are incoming messages with keyprompt. We should standardize the messages before calling our pipeline. Jakub is working on this.Add a FIM pipeline to providers
aponcedeleonch commentedon Nov 28, 2024
Closed via #102