Support dynamic batch for TensorRT and onnxruntime (#329)

Browse Source

* Support dynamic batch for TensorRT and onnxruntime

* Fix output name

* Add some images

* Add dynamic-batch usage notebook

* Add example notebook for onnxruntime and tensorrt

...

This commit is contained in:

tripleMu

2022-07-29 06:01:43 +08:00

committed by GitHub

parent 0d882e553e

commit a7c00297d5

8 changed files with 5231 additions and 2 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

inference/images/bus.jpg

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 476 KiB

inference/images/image1.jpg

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 79 KiB

inference/images/image2.jpg

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 140 KiB

inference/images/image3.jpg

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 115 KiB

inference/images/zidane.jpg

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 165 KiB