Issues

• Postgres state restore can silently accept a failed pg_restore (case-sensitive "ERROR" check)

  Bug

  eval-sys/mcpmark#273 · Filter by author saad-aamir opened on Oct 4, 2026

• Run-to-run noise in the v1-0905 logs: about 11 points between single runs on each service

  eval-sys/mcpmark#272 · Filter by author Universeyi opened on Oct 3, 2026

• CI verifier's 300 s poll cannot fit inside task_manager's 300 s subprocess timeout

  eval-sys/mcpmark#270 · Filter by author TagoreZhao opened on Aug 21, 2026

• it_trouble_shooting_hub/asset_retirement_migration can never pass: verifier sends archived to databases.query

  eval-sys/mcpmark#269 · Filter by author TagoreZhao opened on Aug 21, 2026

• [Request] The WebArena images are too large.

  Bug

  eval-sys/mcpmark#268 · Filter by author shopeemcpmark02-star opened on Aug 11, 2026

• test

  eval-sys/mcpmark#267 · Filter by author xiaogecai opened on Jul 25, 2026
  2

• How do I obtain the initial state page in Notion?

  eval-sys/mcpmark#259 · Filter by author xixi-Mercurial opened on May 28, 2026
  3

• Notion setup guide links to expired / 404 Source Hub template

  Bug

  eval-sys/mcpmark#253 · Filter by author hxt725543-creator opened on May 11, 2026
  3

• New benchmarking engine

  eval-sys/mcpmark#250 · Filter by author voorhs opened on Apr 21, 2026
  3

• Notion MCP Server OpenAPI Schema Incomplete

  Bug

  eval-sys/mcpmark#249 · Filter by author callanwu opened on Feb 18, 2026
  3

• How does MCPMark handle MCP server version changes (Notion / GitHub MCP)?

  eval-sys/mcpmark#245 · Filter by author caitianxiao opened on Jan 21, 2026
  3

• Reproducibility Issues with MCPMark Benchmark

  eval-sys/mcpmark#239 · Filter by author H-Sompalle opened on Dec 17, 2025
  7

• TimeZone issue for Time Classification

  Bug

  eval-sys/mcpmark#238 · Filter by author mRSun15 opened on Dec 15, 2025
  5

• Requirements Writing Task Verification Issue

  Bug

  eval-sys/mcpmark#237 · Filter by author mRSun15 opened on Dec 15, 2025
  4

• GitHub setup failed for mcpmark-cicd__issue_management_workflow: ERROR: Cannot import template to a public repository.

  eval-sys/mcpmark#234 · Filter by author RyanSun04 opened on Dec 9, 2025
  3

• Unclear expected result for folder_structure/structure_analysis

  Bug

  eval-sys/mcpmark#227 · Filter by author mRSun15 opened on Nov 23, 2025
  4

  

• Testing MCP service provider

  eval-sys/mcpmark#220 · Filter by author novvoo opened on Oct 30, 2025
  3

• Notion MCP Bug

  Bug

  eval-sys/mcpmark#219 · Filter by author Django-Jiang opened on Oct 29, 2025
  7

• [Request] Use api/mcp call to prepare environment instead of simulating click in notion

  Feature

  eval-sys/mcpmark#202 · Filter by author homorunner opened on Sep 22, 2025
  4