Skip to content

server: init server http requests threads pool with --parallel if set - #5836

Merged
ggerganov merged 1 commit into
masterfrom
feature/server/init-http-threads-with-n-slots
Mar 3, 2024
Merged

server: init server http requests threads pool with --parallel if set#5836
ggerganov merged 1 commit into
masterfrom
feature/server/init-http-threads-with-n-slots

server: init server http requests threads pool with max of hardware_c…

65e013b
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs