the training of Altogether

[TianyuCuiOvO]

Since the model weights are not published, if i want to train Altogether from scratch, how to obtain and load the PT and FT data required for training?

[tackhwa]

Hi, may I ask if you were able to successfully run the pretraining for this?. I was interested to use Altogether in one of my project

[howardhsu]

Thanks for your interests. We move altogether-specific code to apps/altogether now (feel free to report bugs) and the readme should point to FT code. We cannot release PT data but code only. You may consider to replace PT data by YFCC, DataComp etc. (any image-text pairs).