Skip to content

[BYOC][TensorRT] Reuse TRT engines based on max_batch_size for dynamic batching, improve device buffer allocation#8172

Merged
comaniac merged 5 commits into
apache:mainfrom
trevor-m:trt-dynamic-batching-reuse
Jun 3, 2021
Merged

[BYOC][TensorRT] Reuse TRT engines based on max_batch_size for dynamic batching, improve device buffer allocation#8172
comaniac merged 5 commits into
apache:mainfrom
trevor-m:trt-dynamic-batching-reuse

Typo

9ecf9f7
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs