From 630eadbb8fb4d5a1d943300d583679dcdd30f919 Mon Sep 17 00:00:00 2001 From: rpan Date: Sat, 13 Apr 2024 23:08:07 +0800 Subject: [PATCH] Recover data server - modify `data/download.sh` accordingly - remove notifications in `README.md` - improve `README.md` regarding platform issues --- README.md | 10 +++++----- data/download.sh | 2 +- 2 files changed, 6 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 01efe57e1..223341d79 100644 --- a/README.md +++ b/README.md @@ -83,8 +83,8 @@ An extensible, convenient, and efficient toolbox for finetuning large machine le ### Setup -Our package has been fully tested on Linux OS (Ubuntu 20.04). Other OS platforms (MacOS, Windows) are not fully tested. -You may encounter some unexpected errors. You may try it first on a Linux machine or use Google Colab to experience it. +Our package has been tested on Linux OS (Ubuntu 20.04). Other OS platforms (MacOS, Windows) are not fully tested, where you may encounter unexpected errors. If you are using LMFlow for the first time, we recommend you to try on a Linux machine or Google Colab. + CUDA versions 10.3-11.7 are supported in versions `v0.0.5` or older. For CUDA versions greater than 11.7, one can use our stable branch `>= v0.0.6`. ```bash @@ -102,7 +102,8 @@ Please refer to our [doc](https://optimalscale.github.io/LMFlow/examples/DATASET ### Finetuning (Full) Full training updates all the parameters to finetune a language model. -Here is an example to finetune a GPT-2 base model. (We encounter a data server problem recently. To avoid errors, please use the latest [`download.sh`](https://github.com/OptimalScale/LMFlow/blob/main/data/download.sh) script in main branch to download the dataset) +Here is an example to finetune a GPT-2 base model. + ```sh cd data && ./download.sh alpaca && cd - @@ -113,8 +114,7 @@ cd data && ./download.sh alpaca && cd - ``` ### Finetuning (LISA) -[LISA](https://arxiv.org/abs/2403.17919) is a memory-efficient finetuning algorithm that allows tradeoff between memory and the number of randomly unfreezed layers. This script currently is only tested in single gpus. Please stay tuned for our latest updates :smile: (We encounter a data server problem recently. To avoid errors, please use the latest [`download.sh`](https://github.com/OptimalScale/LMFlow/blob/main/data/download.sh) script in main branch to download the dataset) - +[LISA](https://arxiv.org/abs/2403.17919) is a memory-efficient finetuning algorithm that allows tradeoff between memory and the number of randomly unfreezed layers. This script currently is only tested in single gpus. Please stay tuned for our latest updates :smile: ```sh cd data && ./download.sh alpaca && cd - diff --git a/data/download.sh b/data/download.sh index bb95c2e77..f0e04e552 100755 --- a/data/download.sh +++ b/data/download.sh @@ -1,7 +1,7 @@ #!/bin/bash function main() { - public_server="http://107.23.182.175:5000" + public_server="http://lmflow.org:5000" if [ $# -lt 1 -o "$1" = "-h" -o "$1" = "--help" ]; then echo "Usage: bash $(basename $0) dataset_name" echo "Example: bash $(basename $0) MedMCQA"