Skip to content

docs: add inference providers page and improve configure model index - #1289

Merged
lbliii merged 8 commits into
cwing/chat-completions-modelfrom
cwing/docs-inference-providers
Jun 16, 2026
Merged

lbliii merged 8 commits into
cwing/chat-completions-modelfrom
cwing/docs-inference-providers

Conversation

@cwing-nvidia

@cwing-nvidia cwing-nvidia commented May 11, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • Add inference-providers.mdx — docs page for the inference_provider server covering setup, config reference, usage example
  • Rewrite model-server/index.mdx — rename to "Configure Model", simplify intro to focus on Responses API middleware story, add cloud/self-hosted/training badges, remove implementation details

Notes

Test plan

  • fern docs dev — verify both pages render correctly
  • Tabs component renders on inference-providers page
  • Badge components render on index page
  • All internal links resolve

@copy-pr-bot

copy-pr-bot Bot commented May 11, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@cwing-nvidia
cwing-nvidia changed the base branch from main to cwing/chat-completions-model May 11, 2026 01:24
@cwing-nvidia
cwing-nvidia force-pushed the cwing/docs-inference-providers branch from 518ba89 to fb8a7bf Compare May 11, 2026 01:56
@cwing-nvidia cwing-nvidia mentioned this pull request May 12, 2026
6 tasks
cwing-nvidia and others added 2 commits May 31, 2026 23:03
- Add inference-providers.mdx with setup, usage example, config reference
- Rewrite model-server/index.mdx: rename to Configure Model, simplify
  intro, add training badge to vLLM card, remove implementation details

Signed-off-by: Chris Wing <cwing@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Signed-off-by: Chris Wing <cwing@nvidia.com>
@cwing-nvidia
cwing-nvidia force-pushed the cwing/docs-inference-providers branch from fb8a7bf to 71bc397 Compare June 1, 2026 06:07
Use env.yaml only for secrets (no CLI override tab), move configuration
reference above the usage example, and drop the redundant reasoning section.

Signed-off-by: Chris Wing <cwing@nvidia.com>
@cwing-nvidia
cwing-nvidia marked this pull request as ready for review June 1, 2026 06:25
@cwing-nvidia cwing-nvidia linked an issue Jun 1, 2026 that may be closed by this pull request
@cwing-nvidia cwing-nvidia changed the title docs: add inference providers page and improve model server landing docs: add inference providers page and improve configure model index Jun 1, 2026
Signed-off-by: Chris Wing <cwing@nvidia.com>
Brings the docs branch up to date with the restructured Fern docs on the
updated base. Conflict resolution:
- latest.yml: keep the GA-alias symlink (-> v0.3.0.yml); move the nav title
  change into the editable trunk nav.
- main.yml: rename the model-server nav title to "Configure Model".
- model-server/index.mdx: keep the rewritten page (adds Inference Providers
  card) and apply main's cross-page link de-prefixing (/latest/... -> /...).
- inference-providers.mdx: de-prefix the vLLM link to match.

Signed-off-by: Chris Wing <cwing@nvidia.com>

@marta-sd marta-sd left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @cwing-nvidia , I added one small comment


| Parameter | Type | Default | Description |
|-----------|------|---------|-------------|
| `base_url` | `str` | — | **Required.** Provider's OpenAI-compatible API base URL. |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please add a short note why in the env.yaml the keys have policy prefixes while in this table they don't? It might be confusing for the users.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call — added a short note above the Configuration Reference table (commit b964230) explaining that the policy_* keys in env.yaml are NeMo Gym's shared credential variables and that each provider config maps them onto the server fields: policy_base_url → base_url, policy_api_key → api_key, policy_model_name → model.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed the inline note; the policy_ prefix confusion is a repo-wide convention issue, now tracked in #1658

Add dedicated pages for the OpenAI and Azure OpenAI model servers, link
them from the model-server index, and clarify the inference-providers
page (supported APIs, fixed-model behavior). Reorder page positions to
fit the new pages.

Signed-off-by: Chris Wing <cwing@nvidia.com>
… (#1624)

## Summary

Stacked on top of #1289. Applies an NVIDIA technical-writing style-guide
sweep (`::r` / `doc-style-guide`) to the model-server pages that PR adds
or updates.

### Fixes (8)

| File | Fix |
|------|-----|
| `index.mdx` | `e.g.` → `for example`; `via` → `through` (cloud API
card) |
| `inference-providers.mdx` | `don't` → `do not`; `isn't` → `is not`;
added introductory comma in usage example |
| `azure-openai.mdx` | `don't` → `do not`; `e.g.` → `for example`
(config table) |
| `openai.mdx` | `it's`/`that's` → `it is`/`that is`; `don't` → `do
not`; `e.g.` → `for example` (config table) |

Two categories: **Latinisms** (`e.g.`) and **contractions**, both
disallowed by NVIDIA technical style. No semantic changes.

### Not changed (intentional)

- Spaced em dashes — consistent house style across the pages; left
as-is.
- `RL` left unexpanded — minor, deferred.

## Test plan

- [ ] `fern docs dev` renders all four pages
- [ ] No broken links / component regressions

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Signed-off-by: Lawrence Lane <llane@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

…1289 review)

Address review feedback: clarify why env.yaml keys use the policy_ prefix
while the Configuration Reference table fields do not. The policy_* keys are
NeMo Gym's shared credential variables; each provider config interpolates them
onto the server's own fields (policy_base_url -> base_url, policy_api_key ->
api_key, policy_model_name -> model).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Jun 16, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@lbliii
lbliii merged commit 3e131d0 into cwing/chat-completions-model Jun 16, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

docs: configure models - inference providers

3 participants