[External Plugin]: oddyssey

[using-system]

Plugin name

oddyssey

Short description

Observability-Driven Development for coding agents: an OpenTelemetry instrumentation expert, a run-observation agent that measures a service through its telemetry on a local Grafana stack or a remote backend (Grafana, Datadog, Dynatrace, Azure Monitor, CloudWatch), a verification pass that replays a stored run, k6 benchmark authoring, and a committed .odd/ memory that carries the loop across runs.

GitHub repository

using-system/oddyssey

Plugin path inside the repository

marketplace/oddyssey

Ref to review

v1.12.1

Commit SHA to review

407c8e2248c12e112098861a9c577027708ba031

Version

1.12.1

License identifier

MIT

Author name

using-system

Author URL

https://github.com/using-system

Homepage URL

https://github.com/using-system/oddyssey#readme

Keywords

observability, opentelemetry, grafana, k6, mcp, ai-agents, developer-tools, performance, telemetry, load-testing

Additional notes for reviewers

Resubmission of #3089 (closed by the submitter after requires-submitter-fixes): the install smoke test and version match failed there because the manifest only existed under .claude-plugin/plugin.json. Since v1.12.0 the build also emits plugin.json at the plugin root in the Agent Plugins v1.0.0 shape ($schema, name, version, description, author, homepage, repository, license, keywords), next to the Claude Code one.

v1.12.1 addresses the review on this issue: the Copilot components now ship under the com.github.copilot/ extension namespace (agents/, commands/, hooks/hooks.json with ${PLUGIN_ROOT} paths and the hook scripts) and the MCP server in a root mcp.json in the spec's shape, beside the Claude Code layout. Verified with Copilot CLI 1.0.83 (--plugin-dir, debug log): 4 agents, the 7 commands translated into skills, the 9 skills, the hooks and the MCP server all load with no warning.

All gates were replayed on this tag/SHA with eng/external-plugin-quality-gates.mjs before the previous edit; on v1.12.1, vally lint (runLint({rootPath})) passes with 9 skills and the install smoke test (ephemeral marketplace, fresh HOME, Copilot CLI 1.0.83) installs the plugin with plugin.json at the installed root at version 1.12.1. The plugin tree is generated from an APM package on every release (scripts/build-marketplace.sh) and is also installable today through copilot plugin marketplace add using-system/oddyssey.

Submission checklist

• The plugin lives in a public GitHub repository.
• The ref and/or sha I provided is immutable (release tag and/or full 40-character commit SHA), not a branch.
• This submission follows this repository's contribution, security, and responsible AI policies.
• This plugin is not already listed in the Awesome Copilot marketplace.

[github-actions]

✅ External plugin intake passed

This submission passed automated intake validation and quality checks and is ready for maintainer review.

• Plugin: oddyssey
• Repository: https://github.com/using-system/oddyssey
• Ref: v1.12.1
• SHA: 407c8e2248c12e112098861a9c577027708ba031

Reviewer signals

These are non-blocking heuristics for maintainer review; they are not evidence of misconduct or low quality.

Signal	Result
Repository age	29 day(s)
Repository activity	0 watchers
Repository counts	7 stars · 0 watchers · 2 forks · 9 open issues/PRs
Homepage heuristics	⚠️ pricing, checkout

Quality gate summary

Legend: ✅ pass · ⚠️ warning · 🛑 fail

Gate	Status
spec compliance (non-blocking)	✅ pass
vally lint	✅ pass
install smoke test	✅ pass
version match	✅ pass
ref/sha consistency	✅ pass
canvas structure	⚪ not_run

• spec compliance: pass
• vally lint: pass
• install smoke test: pass
• version match: pass
• ref/sha consistency: pass
• canvas structure: not_run
• overall: pass

spec compliance output (✅ pass)

Agent Plugins v1.0.0 manifest checks passed for plugin.json.

vally lint output (✅ pass)

✅ backend-configuration (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
✅ get-status (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
✅ k6-guides (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
✅ observability-cli-guides (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
✅ odd-memory (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
✅ otel-guides (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
✅ package-layout (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
✅ run-scenario (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
✅ setup-local-stack (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

9 skill(s) linted, 9 passed

install smoke test output (✅ pass)

Install smoke test succeeded. Verified /tmp/external-plugin-quality-0qHKv1/copilot-home/.copilot/installed-plugins/external-plugin-intake/oddyssey/plugin.json.

Version match output

- v1.12.1: matched version "1.12.1" at "marketplace/oddyssey/plugin.json".
- 407c8e2248c12e112098861a9c577027708ba031: matched version "1.12.1" at "marketplace/oddyssey/plugin.json".

Ref/SHA consistency output

source.ref "v1.12.1" resolves to the same commit as source.sha "407c8e2248c12e112098861a9c577027708ba031".

Canvas structure output

Canvas structure gate skipped because plugin is not tagged with "canvas".

Canonical external.json payload

{
  "name": "oddyssey",
  "description": "Observability-Driven Development for coding agents: an OpenTelemetry instrumentation expert, a run-observation agent that measures a service through its telemetry on a local Grafana stack or a remote backend (Grafana, Datadog, Dynatrace, Azure Monitor, CloudWatch), a verification pass that replays a stored run, k6 benchmark authoring, and a committed .odd/ memory that carries the loop across runs.",
  "version": "1.12.1",
  "author": {
    "name": "using-system",
    "url": "https://github.com/using-system"
  },
  "repository": "https://github.com/using-system/oddyssey",
  "homepage": "https://github.com/using-system/oddyssey#readme",
  "license": "MIT",
  "keywords": [
    "observability",
    "opentelemetry",
    "grafana",
    "k6",
    "mcp",
    "ai-agents",
    "developer-tools",
    "performance",
    "telemetry",
    "load-testing"
  ],
  "source": {
    "source": "github",
    "repo": "using-system/oddyssey",
    "path": "marketplace/oddyssey",
    "ref": "v1.12.1",
    "sha": "407c8e2248c12e112098861a9c577027708ba031"
  }
}

View workflow run

[aaronpowell]

Having a review of the files in the marketplace folder, it's worth noting that the agents, commands, and hooks won't be picked up as those are not supported as top-level folders in the spec, instead, they need to be shipped via vendor extensions in the plugin.json file.

Additionally, the plugin spect requires the MCP server(s) to be defined in a root file called mcp.json whereas you have used .mcp.json, meaning it wouldn't be discovered by Copilot harnesses.

It'd be worth having a review of the spec at https://agent-plugins.org/

[using-system]

Thanks @aaronpowell, good catch — and confirmed on our side: with the v1 $schema in place, Copilot CLI 1.0.83's debug log says the root agents/, hooks/ and .mcp.json are "no longer read", and the commands stopped being translated into skills.

Fixed in v1.12.1 (407c8e2248c12e112098861a9c577027708ba031): the build now ships the Copilot components under com.github.copilot/ (agents/, commands/, hooks/hooks.json in Copilot's dialect with ${PLUGIN_ROOT} paths, plus the hook scripts) and the MCP server in a root mcp.json in the spec's shape, next to the Claude Code layout. Verified with copilot --plugin-dir on the tag: 4 agents, the 7 commands as skills, the 9 skills, the hooks (a git commit on main is refused by our guard) and the MCP server all load, with no warning. vally lint still passes.

I've updated the issue to v1.12.1 / 407c8e2248c12e112098861a9c577027708ba031 / 1.12.1.