Issues

• keywords:keyword_specific_position counts punctuation as words, so a comma or quote before the target word fails a compliant response

  community-request
  NVIDIA-NeMo/Gym#5414 · Filter by author sven-rankov opened on Oct 31, 2026

• Add a Connect Four environment for the gymnasium agent

  community-request
  NVIDIA-NeMo/Gym#5406 · Filter by author unna97 opened on Oct 31, 2026

• Reserve stop capacity in sandbox providers whose uploads share the command limit

  NVIDIA-NeMo/Gym#5398 · Filter by author gwarmstrong opened on Oct 30, 2026

• calendar: duplicate event IDs can receive full reward

  community-request
  NVIDIA-NeMo/Gym#5381 · Filter by author deavgprime opened on Oct 30, 2026

• abstention: judge responses such as Answer: B receive full correctness reward

  community-request
  NVIDIA-NeMo/Gym#5380 · Filter by author deavgprime opened on Oct 30, 2026

• Run gym eval submit exports as their own job after the benchmark

  area:orchestrationfeature
  NVIDIA-NeMo/Gym#5358 · Filter by author prokotg opened on Oct 30, 2026

• Allow token capture to be turned off per rollout (validation rollouts are captured today)

  area:trainingfeature
  NVIDIA-NeMo/Gym#5340 · Filter by author zyzhou5 opened on Oct 30, 2026

• Keep OpenAI cache-write tokens through the Chat Completions to Responses conversion

  Platform
  NVIDIA-NeMo/Gym#5281 · Filter by author marcromeyn opened on Oct 29, 2026
  

• instruction_following: empty response gets reward 1.0 when every instruction is vacuously satisfied (missing empty-response guard that ifbench and IFBench have)

  community-requestEnvironment & Benchmarks
  NVIDIA-NeMo/Gym#5174 · Filter by author mcmasruntotop opened on Oct 28, 2026
  1

• Reorganize nemo_gym into layered packages with per-package reviewer groups

  area:coreRollouttracking
  NVIDIA-NeMo/Gym#5166 · Filter by author ananthsub opened on Oct 28, 2026
  

• terminal_bench_2_1: a reward.txt planted by the agent is scored as a pass when test.sh times out

  community-requestEnvironment & Benchmarks
  NVIDIA-NeMo/Gym#5164 · Filter by author jimmy-holdout opened on Oct 28, 2026

• format_verification citation_format: spurious-citation check never fires on the example rows, so citing every part scores 1.0

  community-requestEnvironment & Benchmarkswaiting-on-maintainers
  NVIDIA-NeMo/Gym#5162 · Filter by author mila-holdout opened on Oct 28, 2026

• Hide every harness runner from pkill without the stdlib-only opt-in

  Agents
  NVIDIA-NeMo/Gym#5143 · Filter by author gwarmstrong opened on Oct 27, 2026

• gym env start silently skips a server when its type key is not the first key of its config entry

  community-requestPlatform
  NVIDIA-NeMo/Gym#5140 · Filter by author badalyandavit opened on Oct 27, 2026

• HLE benchmark: simple_agent fails to start, max_steps: null rejected by SimpleAgentConfig

  community-requestEnvironment & Benchmarks
  NVIDIA-NeMo/Gym#5139 · Filter by author badalyandavit opened on Oct 27, 2026
  3

• inference_provider: uses_reasoning_parser=true drops prior-turn reasoning from multi-turn requests (differs from vllm_model interleaved reasoning)

  Rollout
  NVIDIA-NeMo/Gym#5136 · Filter by author ushnish-de opened on Oct 27, 2026

• interactive_browser: url_contains accepts any URL that contains the target text, e.g. data:text/html,about.html

  community-requestEnvironment & Benchmarkswaiting-on-maintainers
  NVIDIA-NeMo/Gym#5069 · Filter by author jacob-holdout opened on Oct 25, 2026

• Harbor multi-step tasks in fresh mode: episode-level ng_trajectory/ng_agent_observations left empty; revisit merging per-step evidence and a multi-turn episode contract

  Environment & Benchmarks
  NVIDIA-NeMo/Gym#5063 · Filter by author adil-a opened on Oct 25, 2026

• Harbor Compose: a task's :ro bind into the sandbox becomes a writable copy; make it a real read-only mount

  Platform
  NVIDIA-NeMo/Gym#5062 · Filter by author adil-a opened on Oct 25, 2026

• image_tools: color pivots reward calls whose tolerance or min_size changes the result

  community-requestEnvironment & Benchmarkswaiting-on-maintainers
  NVIDIA-NeMo/Gym#5058 · Filter by author jimmy-holdout opened on Oct 25, 2026
  2

• Telemetry: every server reports rank 0, so they share one service.instance.id

  Platform
  NVIDIA-NeMo/Gym#5048 · Filter by author rrs45 opened on Oct 24, 2026

• swe_agents: tests that bind fixed ports collide under Apptainer and hang until timeout

  community-requestPlatformwaiting-on-maintainers
  NVIDIA-NeMo/Gym#5021 · Filter by author sshiddib opened on Oct 23, 2026

• Missing tool-call parser returns tool calls as plain text, scored as an empty reply with no error

  community-requestPlatform
  NVIDIA-NeMo/Gym#5020 · Filter by author sshiddib opened on Oct 23, 2026

• gym eval submit: swe_agents cannot run on Slurm with Apptainer (no Docker)

  community-requestPlatformwaiting-on-maintainers
  NVIDIA-NeMo/Gym#5019 · Filter by author sshiddib opened on Oct 23, 2026

• swe_agents: interrupted OpenHands setup is treated as complete, so every rollout fails at start

  Agentscommunity-requestwaiting-on-maintainers
  NVIDIA-NeMo/Gym#5018 · Filter by author sshiddib opened on Oct 23, 2026
  1