Skip to content

[Docs] Add BYOC external library dispatch architecture documentation#19395

Merged
MasterJH5574 merged 2 commits into
apache:mainfrom
tlopex:doc221
Apr 12, 2026
Merged

[Docs] Add BYOC external library dispatch architecture documentation#19395
MasterJH5574 merged 2 commits into
apache:mainfrom
tlopex:doc221

Conversation

@tlopex

@tlopex tlopex commented Apr 12, 2026

Copy link
Copy Markdown
Member

Add an architecture document (docs/arch/external_library_dispatch.rst) for TVM's BYOC (Bring Your Own Codegen) mechanism, covering the end-to-end pipeline for offloading operator subgraphs to external libraries (cuBLAS, CUTLASS, cuDNN, DNNL)

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a new architectural document, external_library_dispatch.rst, which provides a detailed overview of the External Library Dispatch (BYOC) pipeline in TVM Relax. The documentation covers pattern registration, partitioning, code generation, and runtime execution, and is integrated into the main architecture index. Feedback focused on technical accuracy: correcting the pipeline diagram to show that partitioning happens on high-level Relax IR before the LegalizeOps pass, and updating the C++ FFI example to use GetGlobal with an existence check instead of GetGlobalRequired.

Comment thread docs/arch/external_library_dispatch.rst Outdated
Comment thread docs/arch/external_library_dispatch.rst
@MasterJH5574 MasterJH5574 merged commit e22be4e into apache:main Apr 12, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants