Skip to content

Adds automatic loading of the external tensorrt_plugins library in the TensorRT-RTX Execution Provider to support custom transformer plugins - #26558

Merged
Chi Lo (chilo-ms) merged 1 commit into
microsoft:mainfrom
anujj:nv_ep_external_plugins
Nov 13, 2025
Merged

Conversation

@anujj

@anujj anujj commented Nov 12, 2025

Copy link
Copy Markdown
Contributor

External TensorRT plugins for transformer models were previously only available as internal TensorRT components. To enable flexible deployment these plugins have been externalized into a separate library.

@anujj

anujj commented Nov 12, 2025

Copy link
Copy Markdown
Contributor Author

@chilo-ms

Copy link
Copy Markdown
Contributor

/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline,Windows x64 QNN CI Pipeline

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 4 pipeline(s).

@anujj

anujj commented Nov 13, 2025

Copy link
Copy Markdown
Contributor Author

Chi Lo (@chilo-ms) : can we merge this change, please ?

@chilo-ms
Chi Lo (chilo-ms) merged commit 907ede2 into microsoft:main Nov 13, 2025
90 checks passed
Rohanjames1997 pushed a commit to Rohanjames1997/onnxruntime that referenced this pull request Dec 4, 2025
…the TensorRT-RTX Execution Provider to support custom transformer plugins (microsoft#26558)

External TensorRT plugins for transformer models were previously only
available as internal TensorRT components. To enable flexible deployment
these plugins have been externalized into a separate library.
Sumit Kumar (Sumit2318) pushed a commit that referenced this pull request Jan 6, 2026
…the TensorRT-RTX Execution Provider to support custom transformer plugins (#26558)

External TensorRT plugins for transformer models were previously only
available as internal TensorRT components. To enable flexible deployment
these plugins have been externalized into a separate library.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants