Skip to content

docs(fern): adding an evaluation section and fixing other eval references - #1740

Merged
ritaneves merged 6 commits into
mainfrom
rfneves/docs-eval
Jun 25, 2026
Merged

ritaneves merged 6 commits into
mainfrom
rfneves/docs-eval

Conversation

@ritaneves

Copy link
Copy Markdown
Contributor

adding all the changes asked by Seph and restarting the pr because of rebasing issues

… rebasing issues

Signed-off-by: Rita Fernandes Neves <rfernandesne@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Jun 25, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Signed-off-by: Rita Fernandes Neves <rfernandesne@nvidia.com>
Signed-off-by: Rita Fernandes Neves <rfernandesne@nvidia.com>
Signed-off-by: Rita Fernandes Neves <rfernandesne@nvidia.com>
Signed-off-by: Rita Fernandes Neves <rfernandesne@nvidia.com>

@sephmard sephmard left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving — the core items from #1676 are addressed: EvalPlus tutorial improvements, Add a Benchmark moved to Evaluation, --num-repeats stats clarified, agent-as-unit-under-test section, environment list column cleanup, notification removed, and the new Skills page under Evaluation covers BLADE.

Two small follow-ups to track: #1743

  1. BLADE definition: Both the Skills page and the BLADE tutorial jump into the workflow without first grounding the reader in what BLADE is. Suggest opening both with a short intro — what BLADE stands for, that it's a post-run analysis workflow (not a benchmark runner), and the core question it answers ("why did the score change?"). The #1676 review thread has the full suggested framing.

  2. Rename "Skills" to "Benchmark Analysis": The current nav label "Skills" is abstract for a new user. "Benchmark Analysis" describes what the page does without requiring prior knowledge of BLADE. BLADE can then be introduced as the built-in skill that powers it, which also naturally gives it the definition it needs. This leaves room for future skills without another rename.

@ritaneves
ritaneves merged commit a09a048 into main Jun 25, 2026
23 checks passed
@ritaneves
ritaneves deleted the rfneves/docs-eval branch June 25, 2026 20:30
@github-project-automation github-project-automation Bot moved this from Dev Todo to Done in NeMo Gym 0.4.0 - July 1 Jun 25, 2026

This branch was previously deployed

1 inactive deployment
public — 07884208 Deployed Jun 25, 2026 by ritaneves via release / finalize / notify #458
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements to documentation

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants