Scenario
You are operating a production observability platform. The following symptoms appear:
- Tempo has no traces from a service
Available evidence:
- tempo_ingester_spans_received total = 0
Your task
Determine the cause, recover, document, and validate.
Investigation
The investigation follows the discipline taught in Part XCVIII:
- Form hypothesis, find evidence, test, validate.
- Use the available evidence above to bound the search.
- Reach one of the likely root causes.
Recovery procedure
(Do not reveal until you have reasoned through the problem.)
- Identify the failing component.
- Apply the remediation pathway.
- Validate with the verification step.
- Document the incident.
Remediation
- Check collector logs. 2. Verify instrumentation. 3. Fix.
Verification
Traces appear in Tempo
Rollback
Revert
Prevention
Auto-instrumentation at the SDK level