medium riskservice affecting~30 min

Runbook: Investigate a Failed Grafana Data Source

1 · Prerequisites

Confirm every item is in place before any state change.

Grafana
Data source configuration

2 · Pre-checks

Read-only diagnostic commands. If any of these don't match expected output, stop and investigate further.

· Identify the data source
· Confirm what it should connect to

3 · Procedure

Execute each step in order. Verify the expected output of a step before moving to the next.

1In Grafana, navigate to Data Sources
2Click Test connection
3If connection fails: check URL, credentials, network
4If datasource is provisioned: check the YAML file
5Verify the backend is up
6Verify network ACL between Grafana and backend

4 · Verification

Confirm the procedure actually fixed the problem.

✓Test connection returns OK
✓A panel against the datasource returns data

5 · Rollback

If verification fails, undo the procedure in reverse order.

↶Revert the datasource configuration
↶Reload the datasource provisioning

6 · Escalation

When the runbook isn't enough, contact:

· Escalate if a critical datasource is offline

Purpose

Investigate a Failed Grafana Data Source

When to use this runbook

Use this runbook when the operator needs a guided procedure to handle the situation described above.

Pre-checks

Before starting the procedure, confirm the prerequisites and pre-checks are met. The structured lists are rendered from the frontmatter by the page layout.

Procedure

Follow the steps from the frontmatter procedure steps. The page layout renders the steps as a checklist with copy-to-clipboard affordances.

Verification

After the procedure, the structured verification items from the frontmatter are rendered as a checklist.

Rollback

If the procedure fails or makes things worse, follow the structured rollback steps from the frontmatter.

Escalation

The structured escalation path is rendered from the frontmatter. Use it if the operator cannot complete the procedure safely.