Repository navigation
Add agent run dashboard and telemetry setup guide - #32
Merged
Merged
Conversation
There was a problem hiding this comment.
Reviewed 870a554197ba8a85b59030157a9de2f80d3170c3 with four GPT-6.1-Sol and four Claude Opus 5.5 reviewers. Actionable findings are in the threads below.
Validation through the Swamp Blacksmith workflow: TypeScript checking, 72 focused unit tests and 42 existing browser tests passed without retries. Targeted reproductions separately checked the reported edge cases. Native CLI exporter compatibility and live ingestion were not retested.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Agents previously listed individual telemetry rows, making one invocation appear as unrelated entries. This change groups related spans into observed runs with status, duration, models and available input/output tokens. Details expose the span tree, model/tool calls, errors, captured conversation and raw records.
Agents, Traces and Logs preserve captured time bounds and each view’s filters across navigation, reload and browser history. Focused Logs links retain grouped criteria and replace a previous trace focus. Missing telemetry stays visibly incomplete; event/link duplication does not inflate usage. Separate 100-trace and 1,000-record notices disclose coverage limits. A trace is the run boundary, and summaries describe loaded records.
Set up telemetry in Agents now provides Claude Code and Codex configuration, also linked from Get started and the empty state. Users can customize an existing collector URL and copy JSON/TOML or a coding-agent brief. The guide explains configuration merging, content opt-in limits, required field mappings and validation. Claude uses per-signal destinations without disabling existing metrics; Codex guidance prevents duplicate TOML tables. Opening the panel preserves filters and does not change configuration or activate exporters.
Evaluations and cost estimates remain deferred until telemetry and pricing inputs are reliable. Native Claude Code/Codex export compatibility remains unverified; receiving provider telemetry alone does not guarantee complete dashboard runs.
Validation is recorded in
frontend/docs/validation-review.md:/+/nextroutes. Four generated JSON/TOML variants pass real parsers. The full application suite was not repeated for this follow-up.Mayfly implementation record and setup UI decision/demo document the behavior and screenshots. Sol 6.1 implementation/testing, Opus 5.5 reviews and Luna wiki discovery contributed. The final setup review confirmed all initial findings fixed with no remaining regressions or blockers.
Need help on this PR? Tag
@codesmith-botwith what you need.