Lifecycle Metrics Review

Crew Lifecycle Metrics

A forward-looking instrumentation spec and stage-health model for Crew, the AI dev-tool cost product path under research/crew/. Crew has no product code or analytics yet, so this defines what to measure when it is built. It leads with the Platform Engineering Lead (primary) and carries the Startup CTO as a lighter self-serve track.

Status: review Date: 2026-06-25 Product path: research/crew/ Visual tier: visual

Pre-approval stop: the next action is review of this page. The canonical markdown was drafted from the in-conversation interview confirmation; this page is the structured approval record. Use the gates below to approve, request edits, or flag concerns. Downstream routing is withheld until a compiled response approves the page.

Drafted canonical outputs under review: research/crew/lifecycle-metrics.md and research/crew/lifecycle-metrics-interview.md. Supporting: tasks/record-todo.md.

Summary

deliverable

Crew has no product code or analytics yet, so this is a forward-looking instrumentation spec and a stage-health model — what to measure when Crew is built, not an audit of existing events. It leads with the Platform Eng Lead (cross-tool rollup, showback→chargeback, Finance's "who spent this?") and carries the Startup CTO as a lighter self-serve track.

Five stages drive the structure: Onboarding/Activation → Conversion → Transaction → Retention → Expansion. The pivotal moment across the whole lifecycle is the Cross-Tool Reveal within 5 minutes — connect billing, surface a per-developer/per-team fact no single vendor dashboard can produce. That reveal is the activation event and the seed of every later stage.

Three signals run across stages rather than inside one:

Hard numeric targets and business metrics are deliberately deferred to /metrics; this doc gives evidence-anchored directional ranges only. Measurement is owned by the founder/engineer today, with a noted future split (Growth owns funnel, Eng owns the data pipeline and attribution quality, Founder owns expansion).

Scope & Decisions

approval required

These decisions were confirmed in the interview and govern the whole deliverable.

Scope

Crew only (research/crew/). Not Trace, not the cross-product line.

Intent

Both — full event/property inventory and stage-health model with owners and gaps.

Persona weight

Platform Lead primary, CTO secondary (matches the ICP confidence note).

Targets

Directional ranges; hard targets and business metrics deferred to /metrics.

Attribution coverage %

First-class health metric per stage (feeds activation, retention, chargeback-readiness).

Cross-sell & falsifier

Both tracked: cross-sell = behavioral trigger event; native-convergence = competitive watch metric.

Measurement owner

Founder/eng owns all now; doc names a future Growth / Eng / Founder split.

Approve the scope and persona weighting as written?

Stage Evidence Confidence

visual

How well-supported each stage's metric definitions are by existing Crew research (journey map, ICP, expansion map). Lower bars are not weaknesses in the model — they mark where a downstream artifact (packaging, /metrics, onboarding map) must supply firm numbers.

Evidence confidence in metric definitions, by stage

Stage Metrics

approval required

Each stage lists entry/exit events, the headline metric for the Platform Lead (primary), the CTO (secondary) variant, leading vs. lagging signals, evidence quality, and the notional owner. Directional ranges are anchored to journey-map / ICP evidence; firm targets → /metrics.

Stage 1 — Onboarding / Activation

Stage 2 — Conversion

Stage 3 — Transaction (Payment)

Stage 4 — Retention

Stage 5 — Expansion

Cross-Cutting Health Metrics

approval required

Three signals run across all stages rather than inside one.

MetricDefinitionFeedsHealth DirectionEvidence
Attribution coverage %Share of connected spend mapped to a developer/team (vs. shared/ambiguous)Activation (reveal validity), Retention (degradation = churn risk), Expansion (≥80% gates chargeback)Up/stable good; falling = churn leading indicatorHigh (journey map names 20–30% unattributed as core failure)
Native-convergence indexCount + severity of vendor native budget/cost-center releases; estimated erosion of aggregation valueConversion (wedge strength), Retention (churn-to-native risk)Lower pressure = healthier; rising = falsifier materializingHigh (ICP "primary falsifier," 6–12 mo window)
Cross-sell readiness rate% of retained accounts surfacing a production-cost (Trace) questionExpansionHigher = more ready, but only act on concrete asksMedium (journey + expansion maps; no interviews)
Approve the stage model and cross-cutting tracked signals?

Event & Property Inventory

deliverable

Proposed canonical events for when Crew is instrumented. Names are snake_case; properties are suggestions, not final schema.

EventStageKey Properties
account_createdOnboardingaccount_id, persona (platform_lead | cto), company_size, acquisition_source
provider_connectedOnboardingaccount_id, provider (claude_code | cursor | copilot | devin_windsurf), connect_method, connect_status, granularity (per_seat | per_key | aggregate_only)
cross_tool_reveal_viewedOnboarding (activation)account_id, providers_count, time_since_signup_sec, attribution_coverage_pct, reveal_fact_type
attribution_coverage_sampledCross-cuttingaccount_id, coverage_pct, unattributed_pct, provider_breakdown
aha_surprise_loggedConversion (CTO)account_id, surprise_type, magnitude_usd
cfo_question_answeredConversion (Platform Lead)account_id, breakdown_dimension (team | cost_center), exported, shared_with_role
report_exportedConv./Ret./Exp.account_id, format, audience_role (finance | vp_eng | board), dimension
teammate_invitedConv./Expansionaccount_id, invited_role
checkout_started / payment_succeeded / payment_failedTransactionaccount_id, plan, amount_usd, failure_reason
subscription_activeRetentionaccount_id, plan, seats, providers_count
monthly_budget_review_completedRetentionaccount_id, consecutive_months, triggered_by (ritual | crisis)
anomaly_alert_fired / anomaly_alert_actedRetentionaccount_id, alert_type, time_to_action_hrs, outcome (celebrate | coach | cap)
cost_per_output_viewedRetentionaccount_id, metric (cost_per_pr | cost_per_ticket | cost_per_sprint)
seat_or_team_added / provider_added / role_addedExpansionaccount_id, delta, new_role
showback_to_chargeback_convertedExpansionaccount_id, cost_centers_count, coverage_pct_at_conversion
cross_sell_readiness_triggeredExpansionaccount_id, question_domain (production_cost | dev_tool_cost), source (search | support | in_app)
native_vendor_feature_observedCross-cutting (manual)vendor, feature, release_date, aggregation_overlap

Standard properties on every event: account_id, user_id, persona, timestamp, plan, provider_set.

Evidence Matrix

approval required

Each major claim mapped to source evidence, inference, confidence, assumption status, and decision impact.

ClaimEvidence (source)InferenceConfidenceAssumptionDecision impact
Activation = Cross-Tool Reveal in <5 minjourney-map.md Critical Moments #1/#2The reveal is the first irreversible value moment, so it is the activation eventHigh (definition)5-min threshold unvalidated without live funnelSets the headline onboarding metric
Attribution coverage % is a first-class metricjourney-map.md + icp.md (20–30% unattributed named as core failure)Value collapses when spend is unattributed, so coverage gates multiple stagesHighMax achievable coverage varies by vendor APIElevates coverage to cross-stage health metric
Retention = monthly budget-review ritualjourney-map.md Retention ("source of truth for the finance meeting")Recurring ritual adherence predicts renewal better than loginsHighCadence assumed monthly; real cadence unmeasuredSets the headline retention metric
Native convergence is the primary falsifiericp.md Market Context; expansion-map.md RisksIf vendors ship cross-tool budgets, aggregation value erodes — track itHighErosion magnitude/timeline (6–12 mo) is an estimateAdds native-convergence as a competitive watch metric
Expansion = shared-account scope expansionexpansion-map.md (approved, Stage 3)Cross-sell/governance deepening, not a tier ladder, drives expansion eventsMedium-highCross-sell trigger has no customer interviewsShapes Stage 5 events and cross-sell signal
Transaction metrics are placeholdersRepo scan: no monetization/packaging doc in research/crew/Seat-vs-usage undefined, so payment schema cannot be finalizedLowPackaging undefinedMarks Stage 3 as provisional pending packaging research
Is the evidence sufficient to canonicalize these metric definitions?

Instrumentation Gaps

open
GapWhy It MattersResolution Path
No product/analytics layer existsEvery event is hypothetical until Crew is builtStand up an event pipeline at MVP; this doc is the schema seed
Per-developer granularity varies by vendor APIPooled plans may expose only aggregate spend, capping coverage %Technical/spec validation per provider; add granularity + confidence indicator
No monetization/packaging artifactTransaction + expansion metrics can't distinguish seat vs. usageRun packaging research; revisit Stage 3 + 5 schema after
Cross-sell trigger is inference, no interviewscross_sell_readiness_triggered semantics unvalidatedCustomer discovery on Crew↔Trace trigger before in-product prompts
Native-convergence index has no data sourceCompetitive falsifier currently narrativeMonthly vendor-doc sweep feeding native_vendor_feature_observed
Vendor branding drift (Windsurf→Devin)Provider enum may go staleUse devin_windsurf enum; refresh on canonical doc updates

Baselines & Targets To Define In /metrics

deliverable

Directional anchors only; commit firm numbers in /metrics research/crew.

StageMetricDirectional AnchorStatus
OnboardingTime-to-first-cross-tool-revealFirst session; CTO <5 minTARGET → /metrics
OnboardingActivation rate (signup→reveal)BASELINE NEEDED
OnboardingAccounts connecting ≥2 providersHigh share (single-tool = no wedge)TARGET → /metrics
ConversionActivation→paid / team-rolloutBASELINE NEEDED
ConversionConversion cycle timePlatform Lead 2–6 wk; CTO 1–3 daysANCHORED (journey map)
TransactionPayment success / involuntary churnBASELINE NEEDED (after packaging)
RetentionMonthly review ritual adherenceRecurring monthlyTARGET → /metrics
RetentionAnomaly-alert action rateWithin 1 business dayANCHORED (expansion map)
Cross-cuttingAttribution coverage %≥80% to enable chargeback; <70% = riskANCHORED (journey map)
ExpansionShowback→chargeback conversionBASELINE NEEDED
ExpansionNet revenue retention / cross-sellBASELINE NEEDED

Record-Todo Candidates

deliverable

Future, non-blocking measurement work. Written to tasks/record-todo.md on approval.

Next Steps

routing

Routing is proposed; it activates only after this page is approved.

  1. /metrics research/crew — commit firm baselines/targets and the broader success/business-metric framework for the "→ /metrics" and "BASELINE NEEDED" items.
  2. /onboarding-map research/crew — the activation events here assume a first-30-minutes flow that isn't yet mapped.
  3. Run monetization/packaging research before finalizing Transaction + Expansion schema.
  4. Add the Record-Todo Candidates to tasks/record-todo.md.
Approve the artifact destinations and file changes?

Files: research/crew/lifecycle-metrics.md, research/crew/lifecycle-metrics-interview.md, tasks/record-todo.md, this alignment page, and the central alignment/index.html.

Which downstream route should follow approval?

Compile Responses

Answer one or more gates, or select section feedback, then compile YAML. A complete response with every required gate answered and no unresolved negative feedback can be pasted back to the agent to approve this page and write the canonical artifacts.