Crew Lifecycle Metrics
A forward-looking instrumentation spec and stage-health model for Crew, the AI dev-tool cost product path under research/crew/. Crew has no product code or analytics yet, so this defines what to measure when it is built. It leads with the Platform Engineering Lead (primary) and carries the Startup CTO as a lighter self-serve track.
Pre-approval stop: the next action is review of this page. The canonical markdown was drafted from the in-conversation interview confirmation; this page is the structured approval record. Use the gates below to approve, request edits, or flag concerns. Downstream routing is withheld until a compiled response approves the page.
Drafted canonical outputs under review: research/crew/lifecycle-metrics.md and research/crew/lifecycle-metrics-interview.md. Supporting: tasks/record-todo.md.
Summary
deliverableCrew has no product code or analytics yet, so this is a forward-looking instrumentation spec and a stage-health model — what to measure when Crew is built, not an audit of existing events. It leads with the Platform Eng Lead (cross-tool rollup, showback→chargeback, Finance's "who spent this?") and carries the Startup CTO as a lighter self-serve track.
Five stages drive the structure: Onboarding/Activation → Conversion → Transaction → Retention → Expansion. The pivotal moment across the whole lifecycle is the Cross-Tool Reveal within 5 minutes — connect billing, surface a per-developer/per-team fact no single vendor dashboard can produce. That reveal is the activation event and the seed of every later stage.
Three signals run across stages rather than inside one:
- Attribution coverage % — share of connected spend mapped to a developer or team. A first-class health metric, not a back-office data-quality number, because Crew's value collapses when 20–30% of spend sits unattributed. It gates activation (was the reveal real?), retention (is coverage degrading?), and chargeback-readiness (≥80% mapped).
- Native-convergence watch — Crew's primary falsifier (GitHub budget controls + cost centers, June 2026; Cohrint's expanding coverage). Tracked as a competitive metric.
- Cross-sell readiness (Crew→Trace) — a behavioral trigger event (a user asks a production-cost question), never a forced-upsell counter.
Hard numeric targets and business metrics are deliberately deferred to /metrics; this doc gives evidence-anchored directional ranges only. Measurement is owned by the founder/engineer today, with a noted future split (Growth owns funnel, Eng owns the data pipeline and attribution quality, Founder owns expansion).
Scope & Decisions
approval requiredThese decisions were confirmed in the interview and govern the whole deliverable.
Crew only (research/crew/). Not Trace, not the cross-product line.
Both — full event/property inventory and stage-health model with owners and gaps.
Platform Lead primary, CTO secondary (matches the ICP confidence note).
Directional ranges; hard targets and business metrics deferred to /metrics.
First-class health metric per stage (feeds activation, retention, chargeback-readiness).
Both tracked: cross-sell = behavioral trigger event; native-convergence = competitive watch metric.
Founder/eng owns all now; doc names a future Growth / Eng / Founder split.
Stage Evidence Confidence
visualHow well-supported each stage's metric definitions are by existing Crew research (journey map, ICP, expansion map). Lower bars are not weaknesses in the model — they mark where a downstream artifact (packaging, /metrics, onboarding map) must supply firm numbers.
| Stage | Evidence confidence | Basis |
|---|---|---|
| Onboarding / Activation | 85% | Journey map Critical Moments #1/#2 define activation; threshold unvalidated. |
| Conversion | 80% | Conversion triggers well-evidenced; rates unvalidated. |
| Transaction | 35% | No monetization/packaging artifact; seat-vs-usage undefined. |
| Retention | 85% | Retention ritual + churn indicators named in journey map. |
| Expansion | 65% | Triggers from approved expansion map; rates & cross-sell unvalidated. |
Stage Metrics
approval requiredEach stage lists entry/exit events, the headline metric for the Platform Lead (primary), the CTO (secondary) variant, leading vs. lagging signals, evidence quality, and the notional owner. Directional ranges are anchored to journey-map / ICP evidence; firm targets → /metrics.
Stage 1 — Onboarding / Activation
- Entry → Exit:
account_created→cross_tool_reveal_viewed(first dashboard showing a per-developer/per-team cost fact spanning ≥2 tools). - Headline (Platform Lead):
time_to_first_cross_tool_reveal; % connecting ≥2 providers in first session. Directional: reveal within the first session. - CTO variant:
time_to_first_dashboard— directional <5 minutes self-serve. - Leading: providers connected; connect success rate; attribution coverage % at first load. Lagging: activation rate; session-1 return.
- Failure modes: no reveal within 5 min; connect fails on aggregate-only billing APIs. Evidence: High (definition) / Unvalidated (threshold). Owner: Founder/eng (future Growth).
Stage 2 — Conversion
- Entry → Exit:
activated→converted(Platform Lead: paid/team rollout; CTO: free→paid). - Headline (Platform Lead):
cfo_question_answered("Now I can answer the CFO") + activation→team-rollout rate. Proof is answering Finance, not "saving money." - CTO variant:
aha_surprise_logged("Developer A is $800/mo") → keep/upgrade decision. - Leading: export/share actions; second provider added; invite-teammate. Lagging: activation→paid rate; cycle time (Platform Lead 2–6 wk; CTO 1–3 days). Evidence: High (triggers) / Unvalidated (rates). Owner: Founder/eng (future Growth).
Stage 3 — Transaction (Payment)
- Entry → Exit:
checkout_started→payment_succeeded/payment_failed. - Headline (Platform Lead): payment success rate; involuntary churn (dunning);
invoice_or_po_requested(enterprise signal). CTO variant: self-serve card success; free→paid completion. - Note: no Crew monetization/packaging artifact exists yet — seat-vs-usage undefined; these are structural placeholders. Evidence: Low (inferred). Owner: Founder/eng (future Eng owns billing pipeline).
Stage 4 — Retention
- Entry → Exit:
subscription_active→renewed/churned. - Headline (Platform Lead):
monthly_budget_review_completed(the "source of truth for the finance meeting" ritual — the retention signal);anomaly_alert_action_rate(acted within one business day); attribution-coverage trend. - CTO variant:
monthly_cost_visibility_return; cost-per-output viewed ("once they see cost-per-PR, can't unsee"). - Leading (churn risk): attribution coverage dropping; alerts ignored; dashboard viewed only at renewal/crisis. Lagging: logo + net revenue retention; reactivation. Evidence: High (ritual + indicators). Owner: Founder/eng (future Eng + Growth).
Stage 5 — Expansion
- Entry:
retained. Expansion events:seat_or_team_added,provider_added,showback_to_chargeback_converted,role_added,cross_sell_readiness_triggered. - Headline (Platform Lead): seat/team/cost-center growth; showback→chargeback conversion (visibility becomes governance); role-expansion count.
- CTO variant: team growth; tools added; subscription→usage-billing transition.
- Cross-sell signal (both):
cross_sell_readiness_triggeredfires when a Crew user asks a production-cost question (the Crew→Trace trigger); surface the sibling only on a concrete missing answer. - Evidence: Medium-high (triggers) / Unvalidated (rates); cross-sell has no customer interviews. Owner: Founder.
Cross-Cutting Health Metrics
approval requiredThree signals run across all stages rather than inside one.
| Metric | Definition | Feeds | Health Direction | Evidence |
|---|---|---|---|---|
| Attribution coverage % | Share of connected spend mapped to a developer/team (vs. shared/ambiguous) | Activation (reveal validity), Retention (degradation = churn risk), Expansion (≥80% gates chargeback) | Up/stable good; falling = churn leading indicator | High (journey map names 20–30% unattributed as core failure) |
| Native-convergence index | Count + severity of vendor native budget/cost-center releases; estimated erosion of aggregation value | Conversion (wedge strength), Retention (churn-to-native risk) | Lower pressure = healthier; rising = falsifier materializing | High (ICP "primary falsifier," 6–12 mo window) |
| Cross-sell readiness rate | % of retained accounts surfacing a production-cost (Trace) question | Expansion | Higher = more ready, but only act on concrete asks | Medium (journey + expansion maps; no interviews) |
Event & Property Inventory
deliverableProposed canonical events for when Crew is instrumented. Names are snake_case; properties are suggestions, not final schema.
| Event | Stage | Key Properties |
|---|---|---|
account_created | Onboarding | account_id, persona (platform_lead | cto), company_size, acquisition_source |
provider_connected | Onboarding | account_id, provider (claude_code | cursor | copilot | devin_windsurf), connect_method, connect_status, granularity (per_seat | per_key | aggregate_only) |
cross_tool_reveal_viewed | Onboarding (activation) | account_id, providers_count, time_since_signup_sec, attribution_coverage_pct, reveal_fact_type |
attribution_coverage_sampled | Cross-cutting | account_id, coverage_pct, unattributed_pct, provider_breakdown |
aha_surprise_logged | Conversion (CTO) | account_id, surprise_type, magnitude_usd |
cfo_question_answered | Conversion (Platform Lead) | account_id, breakdown_dimension (team | cost_center), exported, shared_with_role |
report_exported | Conv./Ret./Exp. | account_id, format, audience_role (finance | vp_eng | board), dimension |
teammate_invited | Conv./Expansion | account_id, invited_role |
checkout_started / payment_succeeded / payment_failed | Transaction | account_id, plan, amount_usd, failure_reason |
subscription_active | Retention | account_id, plan, seats, providers_count |
monthly_budget_review_completed | Retention | account_id, consecutive_months, triggered_by (ritual | crisis) |
anomaly_alert_fired / anomaly_alert_acted | Retention | account_id, alert_type, time_to_action_hrs, outcome (celebrate | coach | cap) |
cost_per_output_viewed | Retention | account_id, metric (cost_per_pr | cost_per_ticket | cost_per_sprint) |
seat_or_team_added / provider_added / role_added | Expansion | account_id, delta, new_role |
showback_to_chargeback_converted | Expansion | account_id, cost_centers_count, coverage_pct_at_conversion |
cross_sell_readiness_triggered | Expansion | account_id, question_domain (production_cost | dev_tool_cost), source (search | support | in_app) |
native_vendor_feature_observed | Cross-cutting (manual) | vendor, feature, release_date, aggregation_overlap |
Standard properties on every event: account_id, user_id, persona, timestamp, plan, provider_set.
Evidence Matrix
approval requiredEach major claim mapped to source evidence, inference, confidence, assumption status, and decision impact.
| Claim | Evidence (source) | Inference | Confidence | Assumption | Decision impact |
|---|---|---|---|---|---|
| Activation = Cross-Tool Reveal in <5 min | journey-map.md Critical Moments #1/#2 | The reveal is the first irreversible value moment, so it is the activation event | High (definition) | 5-min threshold unvalidated without live funnel | Sets the headline onboarding metric |
| Attribution coverage % is a first-class metric | journey-map.md + icp.md (20–30% unattributed named as core failure) | Value collapses when spend is unattributed, so coverage gates multiple stages | High | Max achievable coverage varies by vendor API | Elevates coverage to cross-stage health metric |
| Retention = monthly budget-review ritual | journey-map.md Retention ("source of truth for the finance meeting") | Recurring ritual adherence predicts renewal better than logins | High | Cadence assumed monthly; real cadence unmeasured | Sets the headline retention metric |
| Native convergence is the primary falsifier | icp.md Market Context; expansion-map.md Risks | If vendors ship cross-tool budgets, aggregation value erodes — track it | High | Erosion magnitude/timeline (6–12 mo) is an estimate | Adds native-convergence as a competitive watch metric |
| Expansion = shared-account scope expansion | expansion-map.md (approved, Stage 3) | Cross-sell/governance deepening, not a tier ladder, drives expansion events | Medium-high | Cross-sell trigger has no customer interviews | Shapes Stage 5 events and cross-sell signal |
| Transaction metrics are placeholders | Repo scan: no monetization/packaging doc in research/crew/ | Seat-vs-usage undefined, so payment schema cannot be finalized | Low | Packaging undefined | Marks Stage 3 as provisional pending packaging research |
Instrumentation Gaps
open| Gap | Why It Matters | Resolution Path |
|---|---|---|
| No product/analytics layer exists | Every event is hypothetical until Crew is built | Stand up an event pipeline at MVP; this doc is the schema seed |
| Per-developer granularity varies by vendor API | Pooled plans may expose only aggregate spend, capping coverage % | Technical/spec validation per provider; add granularity + confidence indicator |
| No monetization/packaging artifact | Transaction + expansion metrics can't distinguish seat vs. usage | Run packaging research; revisit Stage 3 + 5 schema after |
| Cross-sell trigger is inference, no interviews | cross_sell_readiness_triggered semantics unvalidated | Customer discovery on Crew↔Trace trigger before in-product prompts |
| Native-convergence index has no data source | Competitive falsifier currently narrative | Monthly vendor-doc sweep feeding native_vendor_feature_observed |
| Vendor branding drift (Windsurf→Devin) | Provider enum may go stale | Use devin_windsurf enum; refresh on canonical doc updates |
Baselines & Targets To Define In /metrics
deliverableDirectional anchors only; commit firm numbers in /metrics research/crew.
| Stage | Metric | Directional Anchor | Status |
|---|---|---|---|
| Onboarding | Time-to-first-cross-tool-reveal | First session; CTO <5 min | TARGET → /metrics |
| Onboarding | Activation rate (signup→reveal) | — | BASELINE NEEDED |
| Onboarding | Accounts connecting ≥2 providers | High share (single-tool = no wedge) | TARGET → /metrics |
| Conversion | Activation→paid / team-rollout | — | BASELINE NEEDED |
| Conversion | Conversion cycle time | Platform Lead 2–6 wk; CTO 1–3 days | ANCHORED (journey map) |
| Transaction | Payment success / involuntary churn | — | BASELINE NEEDED (after packaging) |
| Retention | Monthly review ritual adherence | Recurring monthly | TARGET → /metrics |
| Retention | Anomaly-alert action rate | Within 1 business day | ANCHORED (expansion map) |
| Cross-cutting | Attribution coverage % | ≥80% to enable chargeback; <70% = risk | ANCHORED (journey map) |
| Expansion | Showback→chargeback conversion | — | BASELINE NEEDED |
| Expansion | Net revenue retention / cross-sell | — | BASELINE NEEDED |
Record-Todo Candidates
deliverableFuture, non-blocking measurement work. Written to tasks/record-todo.md on approval.
- Define the manual native-convergence sweep cadence + vendor source list feeding
native_vendor_feature_observed. - Validate per-provider attribution granularity (Claude Code, Cursor, Copilot, Devin/Windsurf) and record max achievable coverage % per provider.
- After monetization/packaging research, finalize the Transaction + Expansion event schema (seat vs. usage).
- Customer discovery to validate
cross_sell_readiness_triggeredsemantics before in-product cross-sell prompts. - Define the measurement-owner split trigger (Growth / Eng / Founder) and at what headcount it activates.
Next Steps
routingRouting is proposed; it activates only after this page is approved.
/metrics research/crew— commit firm baselines/targets and the broader success/business-metric framework for the "→ /metrics" and "BASELINE NEEDED" items./onboarding-map research/crew— the activation events here assume a first-30-minutes flow that isn't yet mapped.- Run monetization/packaging research before finalizing Transaction + Expansion schema.
- Add the Record-Todo Candidates to
tasks/record-todo.md.
Compile Responses
Answer one or more gates, or select section feedback, then compile YAML. A complete response with every required gate answered and no unresolved negative feedback can be pasted back to the agent to approve this page and write the canonical artifacts.