Skip to content
This repository was archived by the owner on Feb 11, 2026. It is now read-only.
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 4 additions & 15 deletions docs/development.md
Original file line number Diff line number Diff line change
Expand Up @@ -110,26 +110,15 @@ Example [.env](../.env.example) file.

## Local Dev Chat Environment

### 1) Using the ilab command line tool
### Using the ilab command line tool

For the chat functionality to work you need a ilab model chat instance. To run this locally:

`cd server`

[https://github.com/instructlab/instructlab?tab=readme-ov-file#-getting-started](https://github.com/instructlab/instructlab?tab=readme-ov-file#-getting-started)
For the chat functionality to work you need a ilab model chat instance. To run this locally see [Ilab Getting Started](https://github.com/instructlab/instructlab?tab=readme-ov-file#-getting-started).

After you use the `ilab serve` command you should have, by default, a chat server instance running on port 8000.

### 2) Using Podman

#### Current issues

- The docker image that runs the server does not utilise Mac Metal GPU and therefore is very slow when answering prompts
- The docker image is very large as it contains the model itself. Potential to have the model incorporated via a docker volume to reduce the size of the actual image.

`docker run -p 8000:8000 aevo987654/instructlab_chat_8000:v2`
### 2) Running in a Container

This should run a server on port 8000
See the upstream CLI documentation for running ilab in a [container](https://github.com/instructlab/instructlab/tree/main/containers).

### Configuring the chat environment to use a local ilab model chat instance

Expand Down
6 changes: 0 additions & 6 deletions package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

21 changes: 0 additions & 21 deletions server/Containerfile

This file was deleted.

26 changes: 0 additions & 26 deletions server/config.yaml

This file was deleted.