Lifecycle Metrics — Confirmed

Crew Lifecycle Metrics

A forward-looking instrumentation spec and stage-health model for Crew, the AI dev-tool cost product path under research/crew/. Crew has no product code or analytics yet, so this defines what to measure when it is built. It leads with the Platform Engineering Lead (primary) and carries the Startup CTO as a lighter self-serve track.

Status: confirmed Review date: 2026-06-25 Confirmed: 2026-06-26 Product path: research/crew/ Visual tier: visual

alignment_status: confirmed. This page is the read-only approval record for the Crew lifecycle-metrics alignment cycle. All required gates were answered and approved with no unresolved negative feedback (compiled response YAML, approval_status: ready-for-agent-review), and the approved canonical artifacts have been written.

Confirmed canonical artifacts: research/crew/lifecycle-metrics.md and research/crew/lifecycle-metrics-interview.md. Supporting: tasks/record-todo.md and the central alignment/index.html. The prior review page is archived at docs/history/archive/2026-06-26/094627/alignment/lifecycle-metrics-crew.html.

Approval source: compiled response YAML covering five required gates (scope/non-goals, candidate/verdict decisions, research completeness, proposed file changes, post-approval route), all status: answered. Approved post-approval route: /onboarding-map research/crew.

Finished but amendable: this page is current for the completed alignment cycle. Later research can amend it only by archiving this confirmed page first and highlighting what changed. Research caveats below remain valid — confirmed means approved and current, not immutable or permanently true.

Summary

deliverable

Crew has no product code or analytics yet, so this is a forward-looking instrumentation spec and a stage-health model — what to measure when Crew is built, not an audit of existing events. It leads with the Platform Eng Lead (cross-tool rollup, showback→chargeback, Finance's "who spent this?") and carries the Startup CTO as a lighter self-serve track.

Five stages drive the structure: Onboarding/Activation → Conversion → Transaction → Retention → Expansion. The pivotal moment across the whole lifecycle is the Cross-Tool Reveal within 5 minutes — connect billing, surface a per-developer/per-team fact no single vendor dashboard can produce. That reveal is the activation event and the seed of every later stage.

Three signals run across stages rather than inside one:

Hard numeric targets and business metrics are deliberately deferred to /metrics; this doc gives evidence-anchored directional ranges only. Measurement is owned by the founder/engineer today, with a noted future split (Growth owns funnel, Eng owns the data pipeline and attribution quality, Founder owns expansion).

Scope & Decisions

approved

These decisions were confirmed in the interview and govern the whole deliverable.

Scope

Crew only (research/crew/). Not Trace, not the cross-product line.

Intent

Both — full event/property inventory and stage-health model with owners and gaps.

Persona weight

Platform Lead primary, CTO secondary (matches the ICP confidence note).

Targets

Directional ranges; hard targets and business metrics deferred to /metrics.

Attribution coverage %

First-class health metric per stage (feeds activation, retention, chargeback-readiness).

Cross-sell & falsifier

Both tracked: cross-sell = behavioral trigger event; native-convergence = competitive watch metric.

Measurement owner

Founder/eng owns all now; doc names a future Growth / Eng / Founder split.

ApprovedApprove the scope and persona weighting as written?

Approve Crew-only scope, Platform Lead primary / CTO secondary, both event-inventory and stage-health model.

Gate: scope/non-goals · status: answered

Stage Evidence Confidence

visual

How well-supported each stage's metric definitions are by existing Crew research (journey map, ICP, expansion map). Lower bars are not weaknesses in the model — they mark where a downstream artifact (packaging, /metrics, onboarding map) must supply firm numbers.

Evidence confidence in metric definitions, by stage

Stage Metrics

approved

Each stage lists entry/exit events, the headline metric for the Platform Lead (primary), the CTO (secondary) variant, leading vs. lagging signals, evidence quality, and the notional owner. Directional ranges are anchored to journey-map / ICP evidence; firm targets → /metrics.

Stage 1 — Onboarding / Activation

Stage 2 — Conversion

Stage 3 — Transaction (Payment)

Stage 4 — Retention

Stage 5 — Expansion

Cross-Cutting Health Metrics

approved

Three signals run across all stages rather than inside one.

MetricDefinitionFeedsHealth DirectionEvidence
Attribution coverage %Share of connected spend mapped to a developer/team (vs. shared/ambiguous)Activation (reveal validity), Retention (degradation = churn risk), Expansion (≥80% gates chargeback)Up/stable good; falling = churn leading indicatorHigh (journey map names 20–30% unattributed as core failure)
Native-convergence indexCount + severity of vendor native budget/cost-center releases; estimated erosion of aggregation valueConversion (wedge strength), Retention (churn-to-native risk)Lower pressure = healthier; rising = falsifier materializingHigh (ICP "primary falsifier," 6–12 mo window)
Cross-sell readiness rate% of retained accounts surfacing a production-cost (Trace) questionExpansionHigher = more ready, but only act on concrete asksMedium (journey + expansion maps; no interviews)
ApprovedApprove the stage model and cross-cutting tracked signals?

Approve the 5-stage model, the headline metrics per stage, and attribution coverage / native-convergence / cross-sell as cross-cutting tracked signals.

Gate: candidate/verdict decisions · status: answered

Event & Property Inventory

deliverable

Proposed canonical events for when Crew is instrumented. Names are snake_case; properties are suggestions, not final schema.

EventStageKey Properties
account_createdOnboardingaccount_id, persona (platform_lead | cto), company_size, acquisition_source
provider_connectedOnboardingaccount_id, provider (claude_code | cursor | copilot | devin_windsurf), connect_method, connect_status, granularity (per_seat | per_key | aggregate_only)
cross_tool_reveal_viewedOnboarding (activation)account_id, providers_count, time_since_signup_sec, attribution_coverage_pct, reveal_fact_type
attribution_coverage_sampledCross-cuttingaccount_id, coverage_pct, unattributed_pct, provider_breakdown
aha_surprise_loggedConversion (CTO)account_id, surprise_type, magnitude_usd
cfo_question_answeredConversion (Platform Lead)account_id, breakdown_dimension (team | cost_center), exported, shared_with_role
report_exportedConv./Ret./Exp.account_id, format, audience_role (finance | vp_eng | board), dimension
teammate_invitedConv./Expansionaccount_id, invited_role
checkout_started / payment_succeeded / payment_failedTransactionaccount_id, plan, amount_usd, failure_reason
subscription_activeRetentionaccount_id, plan, seats, providers_count
monthly_budget_review_completedRetentionaccount_id, consecutive_months, triggered_by (ritual | crisis)
anomaly_alert_fired / anomaly_alert_actedRetentionaccount_id, alert_type, time_to_action_hrs, outcome (celebrate | coach | cap)
cost_per_output_viewedRetentionaccount_id, metric (cost_per_pr | cost_per_ticket | cost_per_sprint)
seat_or_team_added / provider_added / role_addedExpansionaccount_id, delta, new_role
showback_to_chargeback_convertedExpansionaccount_id, cost_centers_count, coverage_pct_at_conversion
cross_sell_readiness_triggeredExpansionaccount_id, question_domain (production_cost | dev_tool_cost), source (search | support | in_app)
native_vendor_feature_observedCross-cutting (manual)vendor, feature, release_date, aggregation_overlap

Standard properties on every event: account_id, user_id, persona, timestamp, plan, provider_set.

Evidence Matrix

approved

Each major claim mapped to source evidence, inference, confidence, assumption status, and decision impact.

ClaimEvidence (source)InferenceConfidenceAssumptionDecision impact
Activation = Cross-Tool Reveal in <5 minjourney-map.md Critical Moments #1/#2The reveal is the first irreversible value moment, so it is the activation eventHigh (definition)5-min threshold unvalidated without live funnelSets the headline onboarding metric
Attribution coverage % is a first-class metricjourney-map.md + icp.md (20–30% unattributed named as core failure)Value collapses when spend is unattributed, so coverage gates multiple stagesHighMax achievable coverage varies by vendor APIElevates coverage to cross-stage health metric
Retention = monthly budget-review ritualjourney-map.md Retention ("source of truth for the finance meeting")Recurring ritual adherence predicts renewal better than loginsHighCadence assumed monthly; real cadence unmeasuredSets the headline retention metric
Native convergence is the primary falsifiericp.md Market Context; expansion-map.md RisksIf vendors ship cross-tool budgets, aggregation value erodes — track itHighErosion magnitude/timeline (6–12 mo) is an estimateAdds native-convergence as a competitive watch metric
Expansion = shared-account scope expansionexpansion-map.md (approved, Stage 3)Cross-sell/governance deepening, not a tier ladder, drives expansion eventsMedium-highCross-sell trigger has no customer interviewsShapes Stage 5 events and cross-sell signal
Transaction metrics are placeholdersRepo scan: no monetization/packaging doc in research/crew/Seat-vs-usage undefined, so payment schema cannot be finalizedLowPackaging undefinedMarks Stage 3 as provisional pending packaging research
ApprovedIs the evidence sufficient to canonicalize these metric definitions?

Evidence is sufficient; directional ranges and deferred targets are acceptable given no live data.

Gate: research completeness · status: answered

Instrumentation Gaps

open
GapWhy It MattersResolution Path
No product/analytics layer existsEvery event is hypothetical until Crew is builtStand up an event pipeline at MVP; this doc is the schema seed
Per-developer granularity varies by vendor APIPooled plans may expose only aggregate spend, capping coverage %Technical/spec validation per provider; add granularity + confidence indicator
No monetization/packaging artifactTransaction + expansion metrics can't distinguish seat vs. usageRun packaging research; revisit Stage 3 + 5 schema after
Cross-sell trigger is inference, no interviewscross_sell_readiness_triggered semantics unvalidatedCustomer discovery on Crew↔Trace trigger before in-product prompts
Native-convergence index has no data sourceCompetitive falsifier currently narrativeMonthly vendor-doc sweep feeding native_vendor_feature_observed
Vendor branding drift (Windsurf→Devin)Provider enum may go staleUse devin_windsurf enum; refresh on canonical doc updates

Baselines & Targets To Define In /metrics

deliverable

Directional anchors only; commit firm numbers in /metrics research/crew.

StageMetricDirectional AnchorStatus
OnboardingTime-to-first-cross-tool-revealFirst session; CTO <5 minTARGET → /metrics
OnboardingActivation rate (signup→reveal)BASELINE NEEDED
OnboardingAccounts connecting ≥2 providersHigh share (single-tool = no wedge)TARGET → /metrics
ConversionActivation→paid / team-rolloutBASELINE NEEDED
ConversionConversion cycle timePlatform Lead 2–6 wk; CTO 1–3 daysANCHORED (journey map)
TransactionPayment success / involuntary churnBASELINE NEEDED (after packaging)
RetentionMonthly review ritual adherenceRecurring monthlyTARGET → /metrics
RetentionAnomaly-alert action rateWithin 1 business dayANCHORED (expansion map)
Cross-cuttingAttribution coverage %≥80% to enable chargeback; <70% = riskANCHORED (journey map)
ExpansionShowback→chargeback conversionBASELINE NEEDED
ExpansionNet revenue retention / cross-sellBASELINE NEEDED

Record-Todo Candidates

written

Future, non-blocking measurement work. Written to tasks/record-todo.md on approval.

Next Steps

routing

This page is confirmed. The approved post-approval route is /onboarding-map research/crew; the agent continues into it directly. The remaining items below are open follow-ups.

  1. /onboarding-map research/crewapproved route, in progress. The activation events here assume a first-30-minutes flow that isn't yet mapped.
  2. /metrics research/crew — commit firm baselines/targets and the broader success/business-metric framework for the "→ /metrics" and "BASELINE NEEDED" items.
  3. Run monetization/packaging research before finalizing Transaction + Expansion schema.
  4. Record-Todo Candidates added to tasks/record-todo.md.

Approval Record

read-only

Final compiled response YAML, approval_status: ready-for-agent-review. All five required gates answered, no unresolved negative feedback. Decisions are preserved here read-only.

SectionGate typeStatusDecision
Scope & Decisionsscope/non-goalsansweredApprove Crew-only scope, Platform Lead primary / CTO secondary, both event-inventory and stage-health model.
Cross-Cutting Health Metricscandidate/verdict decisionsansweredApprove the 5-stage model, the headline metrics per stage, and attribution coverage / native-convergence / cross-sell as cross-cutting tracked signals.
Evidence Matrixresearch completenessansweredEvidence is sufficient; directional ranges and deferred targets are acceptable given no live data.
Artifact Destination & Proposed File Changesproposed file changesansweredApprove writing the two canonical Crew lifecycle-metrics docs, record-todo, this alignment page, and updating the alignment index. (research/crew/lifecycle-metrics.md)
Post-Approval Routepost-approval routeansweredRoute to /onboarding-map research/crew to map the first-30-minutes activation flow.