Skip to content

Ds-inference Int8 support through ZeroQuant technology#2217

Merged
jeffra merged 25 commits into
masterfrom
ds-inference/ZeroQuant-Int8
Aug 30, 2022
Merged

Ds-inference Int8 support through ZeroQuant technology#2217
jeffra merged 25 commits into
masterfrom
ds-inference/ZeroQuant-Int8

change the mp_size to tp_size at inference config & add some doc-stri…

f3f4b1d
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs