[EP ABI] Add support for creating EP Context models. by adrianlizarraga · Pull Request #25124 · microsoft/onnxruntime

Adrian Lizarraga (adrianlizarraga) · 2025-06-20T19:04:32Z

Description

Updates OrtEp::Compile() to allow a plugin EP to create and return EPContext nodes.
Updates the example EP plugin to generate an example EPContext model:

Motivation and Context

Adds more of the functionality missing from the EP ABI used for plugin EPs.

…ible with OrtEpApi.

…uct sizes for ep api)

…tGraph to the model editor api

…ph/capability name

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

…pi versions of Graph structures

Adrian Lizarraga (adrianlizarraga) and others added 30 commits May 28, 2025 11:38

Create IExecutionProvider wrapper for OrtEp

732f29a

Add OrtEp::GetCapability and stub implementation in dummy ep

9c39966

Simplify GetCapability for OrtEp (no allocator). Make OrtGraph compat…

db2cda3

…ible with OrtEpApi.

Add API OrtGraph_GetNodes()

93900ba

Derive from OrtNode and OrtGraph instead of using variant (reduce str…

5676355

…uct sizes for ep api)

Separate model-editor and ep-api graph types into different files

353fdb8

Revert variable name change to reduce diff

62eb132

Add some comments

38b5398

Add unit test that adds the example plugin ep to a session.

09cea7a

Merge branch 'main' into adrianl/ep-abi

a659a80

Add C APIs to get a node's name and op_type

9f45c18

Update error message when user passes in the wrong kind of OrtNode/Or…

7cac7d1

…tGraph to the model editor api

Add ToInternal() methods to convert from OrtNode to its derived classes

5b38f4b

clean up

8abe39e

Rename AddSupportedNodes api func. Dont force eps to provide a subgra…

9abc3ff

…ph/capability name

Add OrtEp::Compile()

df0636d

Fill out Compile() wrapper function more

177828a

Fix annotation

0206de9

Update NodeComputeInfo handling

a3ab415

Merge branch 'main' into adrianl/ep-abi

59b5367

Finish making Mul work in example plugin EP

77b3037

rename file

1b616d8

Apply suggestions from code review

217aca1

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Update onnxruntime/test/autoep/library/example_plugin_ep.cc

2adb618

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

hide reinterpret_cast with a ToInternal call

e144c80

Use only one enum to differentiate between the ModelEditorApi and EpA…

9031bd5

…pi versions of Graph structures

Add many more graph apis for traversing edges

37dd688

Move graph apis to OrtApi struct

ee354a4

ifdef out stuff for minimal build

3a99ff2

More ifdef for minimal builds

d969d11

dependabot Bot mentioned this pull request Mar 9, 2026

Bump Microsoft.ML.OnnxRuntime.Gpu from 1.23.2 to 1.24.3 yuniko-software/bge-m3-onnx#66

Closed

This was referenced Mar 17, 2026

Bump Microsoft.ML.OnnxRuntime from 1.17.3 to 1.24.3 Magedeline/MaggyHelper-Code#9

Open

Bump Microsoft.ML.OnnxRuntime.Gpu from 1.23.2 to 1.24.4 yuniko-software/bge-m3-onnx#68

Closed

dependabot Bot mentioned this pull request Apr 1, 2026

deps(nuget): Bump the nuget-all group with 11 updates msbrettorg/maenifold#83

Closed

This was referenced Apr 25, 2026

Bump Microsoft.ML.OnnxRuntime from 1.22.1 to 1.25.0 IoTSharp/SonnetDB#50

Closed

Bump Microsoft.ML.OnnxRuntime.Gpu from 1.23.2 to 1.25.0 yuniko-software/bge-m3-onnx#71

Closed

deps(nuget): Bump the nuget-all group with 12 updates msbrettorg/maenifold#85

Closed

This was referenced May 11, 2026

Bump Microsoft.ML.OnnxRuntime.Gpu from 1.23.2 to 1.26.0 yuniko-software/bge-m3-onnx#74

Open

Bump Microsoft.ML.OnnxRuntime from 1.18.1 to 1.26.0 uav-simulator/uavsimulator#3

Open

dependabot Bot mentioned this pull request Jun 21, 2026

Bump Microsoft.ML.OnnxRuntime from 1.22.1 to 1.27.0 DevelApp-ai/MarkdownStructureChunker#32

Merged

This was referenced Jul 1, 2026

deps(nuget): Bump the nuget-all group with 12 updates msbrettorg/maenifold#88

Closed

Bump Microsoft.ML.OnnxRuntime from 1.22.0 to 1.27.0 elbruno/ElBruno.Speech#10

Closed

This was referenced Jul 8, 2026

Bump Microsoft.AspNetCore.SignalR.Client and 8 others one-ware/OneWare#272

Closed

Bump the microsoft group with 9 updates one-ware/OneWare#317

Closed

This was referenced Jul 22, 2026

Bump the microsoft group with 9 updates one-ware/OneWare#323

Closed

Bump Microsoft.AspNetCore.SignalR.Client and 8 others one-ware/OneWare#332

Closed

This was referenced Aug 1, 2026

deps(nuget): Bump the nuget-all group with 12 updates msbrettorg/maenifold#90

Open

Bump Microsoft.ML.OnnxRuntime from 1.20.1 to 1.28.0 varro986/codename-aurora#16

Closed

This was referenced Aug 8, 2026

Bump Microsoft.ML.OnnxRuntime from 1.23.2 to 1.28.0 marcmy/videoduplicatefinder#68

Closed

chore(deps-nuget): Bump Microsoft.ML.OnnxRuntime from 1.17.3 to 1.29.0 spelech/model-context-gateway#90

Closed

This was referenced Aug 17, 2026

Bump Microsoft.ML.OnnxRuntime from 1.20.1 to 1.29.0 varro986/codename-aurora#17

Open

deps(nuget): Bump Microsoft.ML.OnnxRuntime from 1.19.0 to 1.29.0 techbuzzz/ai-watermark-remover#11

Closed

dependabot Bot mentioned this pull request Aug 27, 2026

Bump Microsoft.ML.OnnxRuntime from 1.22.0 to 1.29.0 briandenicola/watch-tracker-app#105

Merged

Navigation Menu

Uh oh!

[EP ABI] Add support for creating EP Context models. - #25124

[EP ABI] Add support for creating EP Context models.#25124
Adrian Lizarraga (adrianlizarraga) merged 103 commits into
mainfrom
adrianl/ep-abi-ep-context-nodes

Adrian Lizarraga (adrianlizarraga) commented Jun 20, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

Adrian Lizarraga (adrianlizarraga) commented Jun 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Motivation and Context

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Adrian Lizarraga (adrianlizarraga) commented Jun 20, 2025 •

edited

Loading