Skip to content

Pull requests: NVIDIA-NeMo/Evaluator

New pull request New
21 Open 844 Closed
21 Open 844 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: replace Werkzeug dev server with waitress for high-concurrency adapter nemo-evaluator
#896 opened Apr 5, 2026 by agronskiy Loading…
1 of 2 tasks
1
feat: Mount /results dir for deployment job too nemo-evaluator-launcher
#895 opened Apr 5, 2026 by bxyu-nvidia • Draft
1
feat: parametrize exported metric name and set better defaults for W&B nemo-evaluator-launcher
#892 opened Apr 1, 2026 by marta-sd • Draft
@marta-sd
3
chore(beep boop 🤖): Bump uv.lock (main) (2026-03-23) nemo-evaluator nemo-evaluator-launcher
#883 opened Mar 23, 2026 by svcnvidia-nemo-ci Loading…
1 task
fix(evaluator): distinguish interrupted and failed sigterm exits nemo-evaluator nemo-evaluator-launcher tests
#882 opened Mar 23, 2026 by ngoncharenko • Draft
2
fix: support dotted task names in launcher nemo-evaluator-launcher tests
#877 opened Mar 20, 2026 by AdamRajfer Loading…
@AdamRajfer
1
feat: add generic heartbeat for periodic script execution during evaluation documentation Improvements or additions to documentation nemo-evaluator-launcher tests
#876 opened Mar 20, 2026 by AdamRajfer Loading…
4 tasks done
@AdamRajfer
8
fix: make SWEbench live progress script restart-safe
#872 opened Mar 19, 2026 by piojanu • Draft
3 tasks
1
chore(beep boop 🤖): Bump uv.lock (main) (2026-03-16) nemo-evaluator nemo-evaluator-launcher
#851 opened Mar 16, 2026 by svcnvidia-nemo-ci Loading…
1 task
refactor: extract shared helpers for auxiliary deployment srun and ha… nemo-evaluator-launcher
#839 opened Mar 11, 2026 by wprazuch • Draft
1
chore(beep boop 🤖): Bump uv.lock (main) (2026-03-09) nemo-evaluator nemo-evaluator-launcher
#823 opened Mar 9, 2026 by svcnvidia-nemo-ci Loading…
1 task
feat: deprecate config.params.extra.n_samples in favour of num_repeat… nemo-evaluator
#803 opened Mar 5, 2026 by wprazuch • Draft
1
feat(launcher): add judge deployment support for on-cluster judge model serving nemo-evaluator-launcher tests
#802 opened Mar 5, 2026 by gchlebus • Draft
1 of 3 tasks
1
feat: add watch mode for continuous checkpoint evaluation documentation Improvements or additions to documentation nemo-evaluator-launcher tests
#799 opened Mar 4, 2026 by gchlebus • Draft
64
feat: add local no-docker mode for nemo-evaluator-launcher community-request documentation Improvements or additions to documentation nemo-evaluator-launcher tests
#786 opened Mar 1, 2026 by mishana Loading…
@prokotg
26
feat(caching): add seed_cache_dir for cross-run cache reuse documentation Improvements or additions to documentation nemo-evaluator tests
#777 opened Feb 26, 2026 by gchlebus Loading…
4
feat: Add container runtime (podman as new runtime) nemo-evaluator-launcher tests
#741 opened Feb 19, 2026 by wprazuch • Draft
9
ci: Remove environments CI
#735 opened Feb 18, 2026 by ko3n1g • Draft
1
ci: Update release-docs workflow to use FW-CI-templates v0.72.0 CI
#726 opened Feb 16, 2026 by chtruong814 Loading…
feat: first version of BYOB nemo-evaluator tests
#720 opened Feb 11, 2026 by pribalta • Draft
85
feat(results): enhance report generation pipeline and fix incomplete reports nemo-evaluator nemo-evaluator-launcher tests
#708 opened Feb 9, 2026 by sephmard Loading…
1
ProTip! Mix and match filters to narrow down what you’re looking for.