Scenario
You are operating a production observability platform. The following symptoms appear:
- A service is not accepting connections
Available evidence:
- probe_ssl_earliest_cert_expiry shows past date
Your task
Determine the cause, recover, document, and validate.
Investigation
The investigation follows the discipline taught in Part XCVIII:
- Form hypothesis, find evidence, test, validate.
- Use the available evidence above to bound the search.
- Reach one of the likely root causes.
Recovery procedure
(Do not reveal until you have reasoned through the problem.)
- Identify the failing component.
- Apply the remediation pathway.
- Validate with the verification step.
- Document the incident.
Remediation
- Identify the certificate. 2. Renew. 3. Verify with probe.
Verification
TLS handshake succeeds.
Rollback
Revert
Prevention
Alert at 30 / 7 / 1 day thresholds