All pull requests

Pull requests

• Keep provider outages out of evaluation scores

  #722·gauravch-code opened Oct 14, 2026·

  ·
  1

  2

• fix(environment): reject a non-finite reward instead of averaging it in

  #721·Mike-7777777 opened Oct 14, 2026·

  ·

• fix(claude): don't execute a tool call cut off by max_tokens

  #720·Mike-7777777 opened Oct 14, 2026·

  ·

• fix(graders): don't read "NOT MET" or a missing verdict as MET in the judge fallback

  #719·Mike-7777777 opened Oct 14, 2026·

  ·

• docs: grade the letter-count examples with an exact match

  #718·Mike-7777777 opened Oct 14, 2026·

  ·

• fix(eval): report trace exit when a local rollout is cancelled

  #716·Monarch-25 opened Oct 13, 2026·

  ·
  1

  1

• Wait out the API Retry-After on refused requests

  #715·andrew-vogulkin opened Oct 13, 2026·

  ·
  3

• Gateway clients: wait out the gateway's Retry-After

  #711·andrew-vogulkin opened Oct 12, 2026·

  ·
  1

• fix(cli): tear down spawned environments when hud eval gets SIGTERM

  #708·TanishGudise opened Oct 11, 2026·

  ·

• fix(eval): cancel the task when a rollout gives up during tasks.start

  #707·TanishGudise opened Oct 11, 2026·

  ·

• Rebuild the test suite as black-box scenarios

  #700·jdchawla29 opened Oct 9, 2026Collaborator·

  ·

• feat(requests,mcp): honour Retry-After and jitter retries (HUD-3032)

  #696·andrew-vogulkin opened Oct 8, 2026·

  ·

• fix(cancelled-trace bug): quiet ConnectionClosedOK on HUDRuntime tunnel close

  #693·lukass16 opened Oct 6, 2026Contributor·

  ·
  3

• feat(regrade): regrade completed runs without re-running the agent

  #689·gplhegde opened Oct 4, 2026Contributor·4 tasks·

  ·