feat(cli): instrument fern automations generate telemetry#16011
feat(cli): instrument fern automations generate telemetry#16011FedeZara wants to merge 3 commits into
Conversation
There was a problem hiding this comment.
Claude Code Review
This repository is configured for manual code reviews. Comment @claude review to trigger a review and subscribe this PR to future pushes, or @claude review once for a one-time review.
Tip: disable this comment in your organization's Code Review settings.
Emit Tier 1 automation events for fern automations generate with per-generator outcomes and run-level lifecycle tracking. Dedupe Sentry for Fiddle failures via skipErrorReporting and failure_source tagging. Co-authored-by: Cursor <cursoragent@cursor.com>
9a8a30c to
cef4c78
Compare
Co-authored-by: Cursor <cursoragent@cursor.com>
Docs Generation Benchmark ResultsComparing PR branch against median of 5 nightly run(s) on
Docs generation runs |
SDK Generation Benchmark ResultsComparing PR branch against median of 5 nightly run(s) on Full benchmark table (click to expand)
main (generator): generator-only time via --skip-scripts (includes Docker image build, container startup, IR parsing, and code generation — this is the same Docker-based flow customers use via |
Co-authored-by: Cursor <cursoragent@cursor.com>
Summary
Adds Tier 1 automation telemetry for
fern automations generate, including run-level lifecycle events and per-generator success/failure/skip events gated onFERN_AUTOMATION=true.Closes FER-10684
Changes
generation_started,generation_completed,generation_failed,generator_completed,generator_failed, andgenerator_skippedto the automation event registry with attribute helpersGeneratorRunCollectorand run-level events inexecuteAutomationsGenerateskipErrorReportingon FiddlefailAndThrowso container failures are not double-reported to CLI Sentrygenerator_failedwithfailure_source: "container" | "cli": suppress CLI Sentry when the generator failed inside the remote container (TaskAbortSignalfromfailAndThrow); correlate viafern_run_idAutomationTelemetryManagerSentry gatingTest plan
pnpm turbo run compile --filter @fern-api/cliFERN_AUTOMATION=true