Skip to content

[NV TRT RTX EP] Package CUDA Runtime and TRT RTX with NV TensorRT RTX EP python wheel - #26115

Merged
Changming Sun (snnn) merged 10 commits into
microsoft:mainfrom
keshavv27:nv_ep_packaging
Oct 27, 2025
Merged

[NV TRT RTX EP] Package CUDA Runtime and TRT RTX with NV TensorRT RTX EP python wheel#26115
Changming Sun (snnn) merged 10 commits into
microsoft:mainfrom
keshavv27:nv_ep_packaging

Conversation

@keshavv27

@keshavv27 keshavv27 commented Sep 22, 2025

Copy link
Copy Markdown
Contributor

Description

  • CUDA Runtime added as a dependency for NV EP python wheel
  • TRT RTX dlls and license copied to wheel as public wheels for TRT RTX are currently unavailable
  • Use onnxruntime.preload_dlls() to load CUDA Runtime DLL
  • python package name for NV EP is onnxruntime-trt-rtx

Motivation and Context

Enables out-of-the-box usage for the NV TensorRT RTX EP python wheel

Gaurav Garg (@gaugarg-nv) Vishal Agarwal (@thevishalagarwal) Maximilian Müller (@gedoensmax) Ishwar Raut (@ishwar-raut1)

@keshavv27

keshavv27 commented Sep 23, 2025

Copy link
Copy Markdown
Contributor Author

Chi Lo (@chilo-ms) @jywu-msft Changming Sun (@snnn) Tianlei Wu (@tianleiwu) pinging for review, Thanks!

@keshavv27 keshavv27 changed the title [NV TensorRT RTX EP] Package CUDA Runtime and TRT RTX with NV TensorRT RTX EP python wheel [NV TRT RTX EP] Package CUDA Runtime and TRT RTX with NV TensorRT RTX EP python wheel Sep 25, 2025
@tianleiwu

Copy link
Copy Markdown
Contributor

Comment thread setup.py Outdated
Comment thread cmake/onnxruntime_python.cmake
Comment thread setup.py Outdated
Comment thread ThirdPartyNotices.txt Outdated
Comment thread ThirdPartyNotices.txt Outdated
@snnn

Copy link
Copy Markdown
Contributor

The ThirdPartyNotices.txt is for third-party components that we distribute. i.e. what ORT packages contain.

@snnn

Copy link
Copy Markdown
Contributor

I am asking my colleagues regarding to the license updates.

@snnn

Copy link
Copy Markdown
Contributor

Who will build and publish this package, Microsoft or Nvidia?

@keshavv27

Copy link
Copy Markdown
Contributor Author

Who will build and publish this package, Microsoft or Nvidia?
Nvidia will release the package, but this change will enable developers to build the package from source also

@snnn
Changming Sun (snnn) merged commit 5568c3a into microsoft:main Oct 27, 2025
92 checks passed
Naomi Ovadia (naomiOvad) pushed a commit to naomiOvad/onnxruntime that referenced this pull request Nov 2, 2025
… EP python wheel (microsoft#26115)

### Description
- CUDA Runtime added as a dependency for NV EP python wheel
- TRT RTX dlls and license copied to wheel as public wheels for TRT RTX
are currently unavailable
-  Use onnxruntime.preload_dlls() to load CUDA Runtime DLL
- python package name for NV EP is onnxruntime-trt-rtx


### Motivation and Context
Enables out-of-the-box usage for the NV TensorRT RTX EP python wheel


@gaugarg-nv @thevishalagarwal @gedoensmax @ishwar-raut1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants