The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
grafana/docs/sources/datasources/tempo/service-graph.md

5.8 KiB

description keywords labels menuTitle title weight refs
Use the Service Graph and Service Graph view [grafana tempo guide tracing] [{products [cloud enterprise oss]}] Service Graph and Service Graph view Service Graph and Service Graph view 500 [{explore-trace-integration {pattern /docs/grafana/} {destination /docs/grafana/<GRAFANA_VERSION>/explore/trace-integration/}] [{pattern /docs/grafana-cloud/} {destination /docs/grafana/<GRAFANA_VERSION>/explore/trace-integration/}} {variable-syntax {pattern /docs/grafana/} {destination /docs/grafana/<GRAFANA_VERSION>/dashboards/variables/variable-syntax/}] [{pattern /docs/grafana-cloud/} {destination /docs/grafana/<GRAFANA_VERSION>/dashboards/variables/variable-syntax/}} {exemplars {pattern /docs/grafana/} {destination /docs/grafana/<GRAFANA_VERSION>/fundamentals/exemplars/}] [{pattern /docs/grafana-cloud/} {destination /docs/grafana/<GRAFANA_VERSION>/fundamentals/exemplars/}} {explore {pattern /docs/grafana/} {destination /docs/grafana/<GRAFANA_VERSION>/explore/}] [{pattern /docs/grafana-cloud/} {destination /docs/grafana/<GRAFANA_VERSION>/explore/}} {provisioning-data-sources {pattern /docs/grafana/} {destination /docs/grafana/<GRAFANA_VERSION>/administration/provisioning/#data-sources}] [{pattern /docs/grafana-cloud/} {destination /docs/grafana/<GRAFANA_VERSION>/administration/provisioning/#data-sources}} {configure-grafana-feature-toggles {pattern /docs/grafana/} {destination /docs/grafana/<GRAFANA_VERSION>/setup-grafana/configure-grafana/#feature_toggles}] [{pattern /docs/grafana-cloud/} {destination /docs/grafana/<GRAFANA_VERSION>/setup-grafana/configure-grafana/#feature_toggles}} {build-dashboards {pattern /docs/grafana/} {destination /docs/grafana/<GRAFANA_VERSION>/dashboards/build-dashboards/}] [{pattern /docs/grafana-cloud/} {destination /docs/grafana/<GRAFANA_VERSION>/dashboards/build-dashboards/}} {data-source-management {pattern /docs/grafana/} {destination /docs/grafana/<GRAFANA_VERSION>/administration/data-source-management/}] [{pattern /docs/grafana-cloud/} {destination /docs/grafana/<GRAFANA_VERSION>/administration/data-source-management/}} {node-graph {pattern /docs/grafana/} {destination /docs/grafana/<GRAFANA_VERSION>/panels-visualizations/visualizations/node-graph/}] [{pattern /docs/grafana-cloud/} {destination /docs/grafana/<GRAFANA_VERSION>/panels-visualizations/visualizations/node-graph/}}]

Service Graph and Service Graph view

The Service Graph is a visual representation of the relationships between services. Each node on the graph represents a service such as an API or database.

You use the Service Graph to detect performance issues; track increases in error, fault, or throttle rates in services; and investigate root causes by viewing corresponding traces.

{{< figure src="/media/docs/grafana/data-sources/tempo/query-editor/tempo-ds-query-node-graph.png" class="docs-image--no-shadow" max-width="500px" alt="Screenshot of a Node Graph" >}}

Display the Service Graph

  1. Configure Grafana Alloy or Tempo or GET to generate Service Graph data.
  2. Link a Prometheus data source in the Tempo data source's Service Graph settings.
  3. Navigate to Explore.
  4. Select the Tempo data source.
  5. Select the Service Graph query type.
  6. Run the query.
  7. (Optional) Filter by service name.

For details, refer to Node Graph panel.

Each circle in the graph represents a service. To open a context menu with additional links for quick navigation to other relevant information, click a service.

Numbers inside the circles indicate the average time per request and requests per second.

Each circle's color represents the percentage of requests in each state:

Color State
Green Success
Red Fault
Yellow Errors
Purple Throttled responses

Open the Service Graph view

Service graph view displays a table of request rate, error rate, and duration metrics (RED) calculated from your incoming spans. It also includes a node graph view built from your spans.

{{< figure src="/media/docs/grafana/data-sources/tempo/query-editor/tempo-ds-query-service-graph.png" class="docs-image--no-shadow" max-width="500px" alt="Screenshot of the Service Graph view" >}}

For details, refer to the Service Graph view documentation.

To open the Service Graph view:

  1. Link a Prometheus data source in the Tempo data source settings.
  2. Navigate to Explore.
  3. Select the Tempo data source.
  4. Select the Service Graph query type.
  5. Run the query.
  6. (Optional) Filter your results.

{{< admonition type="note" >}} Grafana uses the traces_spanmetrics_calls_total metric to display the name, rate, and error rate columns, and traces_spanmetrics_latency_bucket to display the duration column. These metrics must exist in your Prometheus data source. {{< /admonition >}}

To open a query in Prometheus with the span name of that row automatically set in the query, click a row in the rate, error rate, or duration columns.

Linked Prometheus data for Rate from within a service graph

To open a query in Tempo with the span name of that row automatically set in the query, click a row in the links column.