Skip to content

NVIDIA-918: Add NVIDIA DPF Operator documentation - #117142

Open
gaurav-nelson wants to merge 1 commit into
openshift:mainfrom
gaurav-nelson:NVIDIA-918-dpf-operator-docs
Open

NVIDIA-918: Add NVIDIA DPF Operator documentation#117142
gaurav-nelson wants to merge 1 commit into
openshift:mainfrom
gaurav-nelson:NVIDIA-918-dpf-operator-docs

Conversation

@gaurav-nelson

@gaurav-nelson gaurav-nelson commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Based on #117002 by @Shivank-rh

Cherrypick:

  • enterprise-4.22+

Summary

  • Converts the NVIDIA DPF (DOCA Platform Framework) v26.4 installation manual into modular AsciiDoc
  • DPF enables hardware-accelerated OVN-Kubernetes networking by offloading data plane operations to NVIDIA BlueField-3 DPUs on OpenShift 4.22
  • 7 assemblies in networking/networking_operators/dpf_operator/, 59 modules in modules/, 2 images, topic map entry

Structure

Assembly Content
about-dpf-operator Architecture overview, component placement, requirements
dpf-environment-setup Management cluster setup, prerequisite operators
dpf-operator-installation DPF Operator install, DPU resources, DPU services
dpf-hosted-cluster-provisioning DPU hosted cluster via dpf-hcp-provisioner
dpf-worker-nodes-provisioning OVN-K CNI adjustments, adding workers, DPU provisioning
dpf-validation-telemetry Traffic validation, DTS observability
dpf-troubleshooting DPU provisioning issues, unsupported OVN-K features

Items for reviewer

  • TOC bits need to be added by the reviewer
  • TODO comments flag areas needing engineering verification: BFB registry auth, TP vs GA in Ch 12
  • Cross-references to existing OCP docs use xref: placeholders — need anchor ID verification
  • Source uses "management cluster" and "host cluster" interchangeably — standardized on "management cluster"

Test plan

  • Verify all include:: paths resolve
  • Verify topic map renders correctly
  • Review Vale compliance
  • Cross-check code examples against DPF v26.4 source

🤖 Generated with Claude Code

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Aug 3, 2026
@openshift-ci-robot

openshift-ci-robot commented Aug 3, 2026

Copy link
Copy Markdown

@gaurav-nelson: This pull request references NVIDIA-918 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the epic to target the "5.0.0" version, but no target version was set.

Details

In response to this:

Based on #117002 by @Shivank-rh

Summary

  • Converts the NVIDIA DPF (DOCA Platform Framework) v26.4 installation manual into modular AsciiDoc
  • DPF enables hardware-accelerated OVN-Kubernetes networking by offloading data plane operations to NVIDIA BlueField-3 DPUs on OpenShift 4.22
  • 7 assemblies in networking/networking_operators/dpf_operator/, 59 modules in modules/, 2 images, topic map entry

Structure

Assembly Content
about-dpf-operator Architecture overview, component placement, requirements
dpf-environment-setup Management cluster setup, prerequisite operators
dpf-operator-installation DPF Operator install, DPU resources, DPU services
dpf-hosted-cluster-provisioning DPU hosted cluster via dpf-hcp-provisioner
dpf-worker-nodes-provisioning OVN-K CNI adjustments, adding workers, DPU provisioning
dpf-validation-telemetry Traffic validation, DTS observability
dpf-troubleshooting DPU provisioning issues, unsupported OVN-K features

Items for reviewer

  • TOC bits need to be added by the reviewer
  • TODO comments flag areas needing engineering verification: BFB registry auth, TP vs GA in Ch 12
  • Cross-references to existing OCP docs use xref: placeholders — need anchor ID verification
  • Source uses "management cluster" and "host cluster" interchangeably — standardized on "management cluster"

Test plan

  • Verify all include:: paths resolve
  • Verify topic map renders correctly
  • Review Vale compliance
  • Cross-check code examples against DPF v26.4 source

🤖 Generated with Claude Code

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci Bot added the size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. label Aug 3, 2026
@szigmon

szigmon commented Aug 4, 2026

Copy link
Copy Markdown

👋 @gaurav-nelson Great work on the comprehensive DPF documentation!

I noticed some production-critical gaps that would prevent successful DTS observability deployment, so I created PR #117216 with targeted additions:

🚨 Critical Missing Piece: Complete Grafana installation instructions

  • Your PR shows how to VIEW metrics but not how to INSTALL Grafana
  • Added control-plane scheduling fix (prevents "Application is not available" error)

📋 Other Additions:

  • Release notes with known issues/troubleshooting
  • Updated version examples (v1.33.5 → v1.35.0)

All content from production-tested deployment, YAML validated with oc apply --dry-run=client

Happy to collaborate on merging these fixes into your PR instead of having competing PRs. The additions complement your excellent work perfectly!

View specific additions: main...szigmon:openshift-docs:dpf-dts-critical-fixes-20260804

What do you think? 🤝

@szigmon

szigmon commented Aug 4, 2026

Copy link
Copy Markdown

🚀 DPF Documentation Enhancement - How Would You Like to Proceed?

Hi @gaurav-nelson! Excellent comprehensive DPF documentation work!

I've identified critical production gaps that would prevent successful DTS observability deployment and prepared comprehensive fixes. How would you prefer to receive these enhancements?


🎯 Critical Issues Found

  1. Production-blocking: Missing complete Grafana installation instructions
  2. Deployment failure: Grafana needs control-plane scheduling fix
  3. Missing troubleshooting: No diagnostic guidance for production issues
  4. Consistency issues: Mixed command formats across 10+ files
  5. Version updates: Several files show v1.33.5 instead of v1.35.0

🤝 Integration Options - Your Choice

Option A: Direct File Sharing(Easiest)

I provide ready-to-use files via:

  • GitHub Gist with downloadable files
  • Google Drive with organized folders
  • Email attachment if you prefer

Option B: Collaborative PR 🔄 (Most Professional)

  • I update my existing fork with all comprehensive fixes
  • You can cherry-pick specific commits from my branch
  • Or merge specific files you want to include
  • View live diff: Compare exactly what changes

Option C: Detailed Instructions 📋 (Complete Control)

  • Step-by-step file modifications with exact line numbers
  • Copy/paste blocks for each section
  • You implement exactly what you want

Option D: Live Collaboration 💬 (Interactive)

  • We coordinate via comments for specific sections
  • I provide fixes as you request them
  • Most flexible but requires coordination

📊 What's Ready

Complete content prepared (production-tested):

  • Comprehensive Grafana installation (455 lines) - All 10 dashboard panels
  • Complete troubleshooting guide (326 lines) - Diagnostic workflows
  • Consistency fixes - Command formatting across 10+ files
  • Version updates - All examples updated to v1.35.0
  • YAML validation - All resources tested with oc apply --dry-run=client

Total: 781 lines of comprehensive, production-ready content


🎯 My Recommendation

Option B (Collaborative PR) because:

  • Easy to review - See exact diffs of what's added
  • Cherry-pick what you want - Take only the parts you need
  • Professional workflow - Standard GitHub collaboration
  • No copy/paste errors - Direct file integration
  • Maintains attribution - Clear commit history

🤔 What's Your Preference?

Just let me know which option works best for you! I'm happy to accommodate whatever approach is most convenient for your workflow.

Goal: Ensure users can successfully deploy DTS observability in production environments 🚀

All content is based on working production deployment and addresses real deployment blockers I've encountered.

@JoeAldinger JoeAldinger left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few comments and suggestions. Overall there are some global changes I'd recommend to improve the user experience, increase readability, and condense the docs. Thanks, and let me know if you have any questions.

.Additional resources

* xref:../dpu-operator/dpu-operator.adoc#dpu-operator[DPU Operator]
* link:https://github.com/NVIDIA/doca-platform/tree/public-release-v26.4[DOCA Platform Framework (DPF) GitHub]

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You'll need approval to link to GH repos. cc @kalexand-rh

Comment thread modules/nw-dpf-architecture-overview.adoc
Comment thread modules/nw-dpf-architecture-overview.adoc Outdated
Comment thread modules/nw-dpf-component-placement.adoc Outdated
Comment thread modules/nw-dpf-viewing-dts-metrics.adoc Outdated

In Grafana, go to *Dashboards* and open *DOCA DPU Telemetry (DTS)*.
Use the *DPU (source)* dropdown to focus on a specific DPU or select *All*.
Adjust the time range by using the time-range control on the dashboard toolbar. The dashboard refreshes every 30 seconds.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Adjust the time range by using the time-range control on the dashboard toolbar. The dashboard refreshes every 30 seconds.
Adjust the time range by using the *time-range* control on the dashboard toolbar. The dashboard refreshes every 30 seconds.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm guessing this is a GUI element and is hyphenated like that.

Comment thread networking/networking_operators/dpf_operator/dpf-worker-nodes-provisioning.adoc Outdated
Comment thread networking/networking_operators/dpf_operator/dpf-worker-nodes-provisioning.adoc Outdated
Comment thread modules/nw-dpf-approving-worker-csrs.adoc Outdated
. Label each worker node for the DPU `MachineConfigPool`:
+
In the following command, replace `<worker_node_name>` with the name of the worker node:
+

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Replace <worker_node_name> with the name of the worker node.
+

@JoeAldinger JoeAldinger left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few comments and suggestions. Overall there are some global changes I'd recommend to improve the user experience, increase readability, and condense the docs. Thanks, and let me know if you have any questions.

@josecastillolema

Copy link
Copy Markdown
Member

@szigmon I cant find the release notes here, are they around?

@szigmon

szigmon commented Aug 6, 2026

Copy link
Copy Markdown

@szigmon I cant find the release notes here, are they around?

working on a new PR with all the missing additions

@gaurav-nelson
gaurav-nelson force-pushed the NVIDIA-918-dpf-operator-docs branch from 3e87522 to fc28949 Compare August 7, 2026 13:13
Comment thread modules/nw-dpf-creating-dpuflavor.adoc Outdated
Comment thread modules/nw-dpf-creating-dpuflavor.adoc Outdated
Comment thread modules/nw-dpf-installing-required-operators.adoc Outdated
Comment thread modules/nw-dpf-installing-required-operators.adoc Outdated
Comment thread modules/nw-dpf-release-notes.adoc Outdated
Comment thread networking/networking_operators/dpf_operator/dpf-operator-installation.adoc Outdated
szigmon added a commit to szigmon/openshift-docs that referenced this pull request Aug 9, 2026
…penshift#117142

This commit adds comprehensive enhancements to the NVIDIA DPF Operator documentation,
ensuring full alignment with PR openshift#117142 while providing significant production-ready
improvements for OpenShift v4.22 deployments.

MAJOR ENHANCEMENTS:
• Native OpenShift Console DTS integration (no Grafana dependency)
• Comprehensive troubleshooting framework (8 detailed modules)
• Enhanced release notes for v26.4.1-beta.1
• Complete traffic validation testing procedures

NEW MODULES ADDED (9 files):
• nw-dpf-installing-dts-console-dashboard.adoc - Native console telemetry
• nw-dpf-troubleshooting-framework.adoc - Main troubleshooting guide
• nw-dpf-troubleshooting-dpu-provisioning.adoc - DPU provisioning issues
• nw-dpf-troubleshooting-hosted-cluster.adoc - HyperShift cluster issues
• nw-dpf-troubleshooting-networking.adoc - OVN-K and networking issues
• nw-dpf-troubleshooting-diagnostics.adoc - Diagnostic commands reference
• nw-dpf-ts-bmc-certificates.adoc - BMC certificate troubleshooting
• nw-dpf-ts-dpu-node-status.adoc - DPU node NotReady resolution
• nw-dpf-ts-worker-csr-approval.adoc - CSR approval failure diagnostics

CRITICAL FIXES:
• Fixed HOSTED_CLUSTER_VIP: 203.0.113.200 → 192.168.1.200
• Added missing traffic validation tests (NodePort connectivity)
• Enhanced release notes with current version information
• Updated assemblies for proper module integration

ALIGNMENT WITH PR openshift#117142:
• Verified compatibility with all 69 files from tech writers' PR
• Added missing troubleshooting modules referenced in original PR
• Enhanced beyond original scope for production readiness
• Maintained Red Hat documentation standards throughout

TECHNICAL IMPROVEMENTS:
• All environment variables use proper $VARIABLE syntax
• Spoofed hostnames replace real server names for security
• Complete diagnostic command reference with expected outputs
• Professional troubleshooting workflows for enterprise deployments

Total: 5 modified + 9 new files = 14 files enhanced
Coverage: Complete Chapters 1-11 documentation with production-ready troubleshooting

Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com>
@szigmon

szigmon commented Aug 9, 2026

Copy link
Copy Markdown

@gaurav-nelson Updated enhancement, aligned with your latest revision (fc28949):

Single commit, 14 filesview diff

New modules: console DTS dashboard, comprehensive troubleshooting framework (5 modules), diagnostic commands.
Enhanced modules: release notes (v26.4.1-beta.1), traffic validation (2 extra tests), expanded ts-bmc/dpu/csr troubleshooting, VIP fix in hcp env vars.

Branch: szigmon:dpf-dts-critical-fixes-20260804, ready to cherry-pick.

szigmon added a commit to szigmon/openshift-docs that referenced this pull request Aug 9, 2026
PR was updated Aug 7 after tech writer review (JoeAldinger):
- Removed 18 modules (consolidated operators, removed overview wrappers)
- Added grafana-for-dts, release-notes, ts-bmc/dpu/csr modules

This commit fixes 3 alignment issues:
- dpf-validation-telemetry: match flat +1 structure, remove deleted
  module refs (validating-traffic-overview, configuring-dpu-telemetry),
  remove release-notes (stays in about-dpf-operator per PR), add
  :dpf-version: attribute
- dpf-troubleshooting: restore PR's original ts- modules first, then
  append our new comprehensive modules, remove unsupported-ovnk ref,
  add :dpf-version: attribute
- release-notes: fix assembly comment to about-dpf-operator.adoc

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
szigmon added a commit to szigmon/openshift-docs that referenced this pull request Aug 9, 2026
Aligned with PR openshift#117142 latest revision (fc28949, Aug 7).

New modules (6):
- Console DTS dashboard with native OpenShift integration
- Comprehensive troubleshooting framework
- DPU provisioning troubleshooting
- Hosted cluster troubleshooting
- Networking troubleshooting
- Diagnostic commands and log collection

Enhanced modules (6):
- release-notes: full v26.4.1-beta.1 release notes, unsupported OVN-K
  features, expanded known issues (179 lines, up from 105)
- running-traffic-validation: added worker-to-worker service and
  optional NodePort tests
- hcp-environment-variables: fixed VIP to 192.168.1.200, added export
  commands block
- ts-bmc-certificates: expanded BMC troubleshooting (53 lines)
- ts-dpu-node-status: expanded DPU node diagnostics (84 lines)
- ts-worker-csr-approval: expanded CSR troubleshooting (86 lines)

Assembly updates (2):
- dpf-validation-telemetry: added console dashboard include
- dpf-troubleshooting: added 5 comprehensive troubleshooting modules
  after existing ts- modules

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@gaurav-nelson
gaurav-nelson force-pushed the NVIDIA-918-dpf-operator-docs branch from fc28949 to 3a1e992 Compare August 10, 2026 10:32
@gaurav-nelson

Copy link
Copy Markdown
Contributor Author

/retest

@gaurav-nelson
gaurav-nelson force-pushed the NVIDIA-918-dpf-operator-docs branch 2 times, most recently from cad07fb to 273418a Compare August 10, 2026 12:00

@JoeAldinger JoeAldinger left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few suggestions mostly the new content has a good bit of self referential language in the abstracts that needs to be removed. I left a question about the release notes module that might be worth discussing with engineering.

Comment thread networking/networking_operators/dpf_operator/dpf-hosted-cluster-provisioning.adoc Outdated
Comment thread modules/nw-dpf-installing-required-operators.adoc Outdated
Comment thread modules/nw-dpf-installing-required-operators.adoc Outdated
Comment thread modules/nw-dpf-network-requirements.adoc Outdated
Comment thread modules/nw-dpf-software-requirements.adoc Outdated
Connection to 172.30.102.123 5000 port [tcp/*] succeeded!
----
+
A `succeeded` message confirms that the service is reachable through the DPU-accelerated network.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMO, you don't need the actual output if you are going to describe what the user should be looking for, for example A succeeded message...

Comment thread modules/nw-dpf-installing-grafana-for-dts.adoc Outdated
Comment thread modules/nw-dpf-installing-grafana-for-dts.adoc Outdated
Comment thread networking/networking_operators/dpf_operator/dpf-troubleshooting.adoc Outdated
Comment thread modules/nw-dpf-troubleshooting-diagnostics.adoc Outdated
@gaurav-nelson
gaurav-nelson force-pushed the NVIDIA-918-dpf-operator-docs branch from 273418a to 0e622ef Compare August 11, 2026 00:27
Comment thread modules/nw-dpf-release-notes.adoc Outdated
Comment thread modules/nw-dpf-release-notes.adoc Outdated
Comment thread modules/nw-dpf-release-notes.adoc Outdated
Comment thread modules/nw-dpf-release-notes.adoc Outdated
Comment thread modules/nw-dpf-release-notes.adoc Outdated
Comment thread modules/nw-dpf-release-notes.adoc Outdated
Comment thread modules/nw-dpf-release-notes.adoc Outdated
Comment thread modules/nw-dpf-release-notes.adoc Outdated
@gaurav-nelson
gaurav-nelson force-pushed the NVIDIA-918-dpf-operator-docs branch 2 times, most recently from 7e6d10b to 13dffef Compare August 11, 2026 00:53
Co-authored-by: Cursor <cursoragent@cursor.com>
@gaurav-nelson
gaurav-nelson force-pushed the NVIDIA-918-dpf-operator-docs branch from 13dffef to 65248e6 Compare August 13, 2026 00:33
@openshift-ci

openshift-ci Bot commented Aug 13, 2026

Copy link
Copy Markdown

@gaurav-nelson: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

branch/enterprise-4.22 branch/enterprise-5.0 jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants