Skip to content

Commit 441f1eb

Browse files
committed
chore: refactor to use generic model loading
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent ebf1522 commit 441f1eb

7 files changed

Lines changed: 179 additions & 218 deletions

File tree

backend/python/transformers/backend.py

Lines changed: 167 additions & 218 deletions
Large diffs are not rendered by default.

backend/python/transformers/requirements-cpu.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,6 @@ accelerate
55
transformers>=5.0.0
66
bitsandbytes
77
sentence-transformers==5.2.3
8+
diffusers
9+
soundfile
810
protobuf==6.33.5

backend/python/transformers/requirements-cublas12.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,6 @@ numba==0.60.0
55
transformers>=5.0.0
66
bitsandbytes
77
sentence-transformers==5.2.3
8+
diffusers
9+
soundfile
810
protobuf==6.33.5

backend/python/transformers/requirements-cublas13.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,6 @@ numba==0.60.0
55
transformers>=5.0.0
66
bitsandbytes
77
sentence-transformers==5.2.3
8+
diffusers
9+
soundfile
810
protobuf==6.33.5

backend/python/transformers/requirements-hipblas.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,6 @@ llvmlite==0.43.0
66
numba==0.60.0
77
bitsandbytes
88
sentence-transformers==5.2.3
9+
diffusers
10+
soundfile
911
protobuf==6.33.5

backend/python/transformers/requirements-intel.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,6 @@ numba==0.60.0
66
transformers>=5.0.0
77
bitsandbytes
88
sentence-transformers==5.2.3
9+
diffusers
10+
soundfile
911
protobuf==6.33.5

backend/python/transformers/requirements-mps.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,6 @@ accelerate
55
transformers>=5.0.0
66
bitsandbytes
77
sentence-transformers==5.2.3
8+
diffusers
9+
soundfile
810
protobuf==6.33.5

0 commit comments

Comments
 (0)