Observability Export Pipeline

Observability Export Pipeline A data-flow diagram generated by Archify. 01 / Command 02 / Durable journal 03 / Outbox 04 / Export 05 / Consumers Coordinator · accepted command · 01 / Command · runtime.ts Coordinator accepted command runtime.ts Journal · hash-chained events · 02 / Durable journal · sqlite.ts Journal hash-chained events sqlite.ts tracePayload · redacted OTLP span · 02 / Durable journal · observability.ts tracePayload redacted OTLP span observability.ts enqueueMetrics · 10 gauges + 3 histograms · 03 / Outbox · snapshot enqueueMetrics 10 gauges + 3 histograms snapshot Telemetry Outbox · disk-backed rows · 03 / Outbox · at-least-once Telemetry Outbox disk-backed rows at-least-once flushTelemetry · lease 30 s, batch 100 · 04 / Export · fenced acks flushTelemetry lease 30 s, batch 100 fenced acks OtlpHttpExporter · OTLP/HTTP POST · 04 / Export · backoff 1 to 60 s OtlpHttpExporter OTLP/HTTP POST backoff 1 to 60 s OTLP Collector · application supplied · 05 / Consumers OTLP Collector application supplied FAILED rows · kept, no auto requeue · 05 / Consumers · operator review FAILED rows kept, no auto requeue operator review operationalSummary · 6 alert kinds · 05 / Consumers · app escalates operationalSummary 6 alert kinds app escalates event + observation same transaction project span redacted trace export intent same transaction metric snapshot separate call leased rows outside transaction batch max 1000 OTLP/HTTP JSON retry 429, 5xx partial acceptance max 8 attempts alerts from state thresholds Legend primary data policy / PII async batch data store data flow

Commit First

  • • The observation envelope and the redacted trace intent commit with the control event
  • • No collector is contacted until the application creates and invokes an exporter

Bounded Delivery

  • • Rows are leased for 30 s; acks are fenced by an attempt counter
  • • Delivery is at-least-once; exactly-once is explicitly not claimed

Alerts Never Remediate

  • • WORKFLOW_STALLED, EFFECT_UNRESOLVED, APPROVAL_OVERDUE, BUDGET_NEAR_LIMIT, BUDGET_EXHAUSTED, EXPORT_UNHEALTHY
  • • Dedup, scheduling and escalation belong to the application