This is documentation for the next version of Grafana documentation. For the latest stable release, go to the latest version.
Troubleshoot Zipkin data source issues
This document provides solutions to common issues you may encounter when configuring or using the Zipkin data source, including connection failures, query errors, JSON upload issues, and configuration problems. For configuration instructions, refer to Configure Zipkin.
Connection errors
These errors occur when Grafana can’t connect to the Zipkin instance.
error reading settings: url is empty
Symptoms:
- Save & test fails immediately
- Health check returns an error
Solutions:
- Open the data source settings and verify the URL field isn’t empty.
- Enter the full URL of your Zipkin instance, such as
http://localhost:9411.
“request failed: 404 Not Found” or other HTTP status errors
Symptoms:
- Save & test fails with an HTTP status error
- Trace queries return errors
Possible causes and solutions:
error creating http client or TLS errors
Symptoms:
- Save & test fails with a connection or TLS error
- HTTPS connections are refused
Solutions:
- If using HTTPS, verify the TLS certificate is valid and trusted by the Grafana server.
- Configure TLS settings in Additional settings > Advanced HTTP settings.
- For self-signed certificates, add the CA certificate to the Grafana server trust store or toggle Skip TLS Verify (not recommended for production).
Save & test times out
Symptoms:
- Save & test hangs and eventually times out
- No error message is returned
Possible causes and solutions:
For Grafana Cloud, if you’re accessing a private Zipkin instance, configure Private data source connect.
Query editor errors
These errors occur when using the query editor in Explore or dashboards.
“Failed to load spans from Zipkin”
Symptoms:
- Error message appears in the query editor
- The Traces cascading selector doesn’t populate services, spans, or traces
This error occurs when the frontend can’t reach the Zipkin API endpoints (/api/v2/services, /api/v2/spans, or /api/v2/traces).
Solutions:
- Verify the Zipkin instance is running and accessible.
- Test the endpoint directly:
curl http://<ZIPKIN_URL>/api/v2/services. - Check that the Grafana server can reach the Zipkin API.
- Review the Grafana server logs for more details. Look for
An error occurred while doing a resource callin the logs.
“An error occurred within the plugin”
Symptoms:
- A generic error appears when querying or browsing traces
- No specific error details are shown in the UI
This is a generic error returned by the Zipkin plugin backend when an internal error occurs. The actual error details are only available in the Grafana server logs.
Solutions:
- Enable debug logging to capture detailed error information.
- Check the Grafana server logs for messages like
An error occurred while doing a resource callorAn error occurred while processing response from resource call. - Verify the Zipkin instance is healthy and responding to API requests.
“No data” or empty results
Symptoms:
- Query runs without error but returns no data
- Trace view shows “No data”
- The cascading selector shows “No traces found” or “[No traces in time range]”
Possible causes and solutions:
Upload errors
These errors occur when importing a JSON trace file.
“JSON is not valid Zipkin format”
Symptoms:
- Error appears after uploading a JSON trace file
- The trace doesn’t render
Possible causes and solutions:
unsupported query type upload. only available in frontend mode
Symptoms:
- Error when trying to use uploaded trace data in a dashboard panel or alert
Upload queries only work in Explore. They can’t be used in dashboard panels or alerting rules because the upload is processed in the browser, not the backend.
Solution:
Use the TraceID query type with the trace ID from your uploaded trace if you need to display it in a dashboard. This requires the trace to exist in your Zipkin instance.
Configuration errors
These errors relate to data source configuration settings.
“Invalid time shift. See tooltip for examples.”
Symptoms:
- Error appears in the trace to logs or trace to metrics configuration
- The Span start time shift or Span end time shift field is highlighted
Solutions:
- Use valid time unit formats:
5s,1m,3h,-30m. - Use a negative value to shift the time to the past (for example,
-1h). - The value must be a number followed by a time unit (
s,m,h).
Trace to logs links don’t appear
Symptoms:
- No log links appear in the trace view
- Links appear for some spans but not others
Possible causes and solutions:
Trace to metrics links don’t appear
Symptoms:
- No metrics links appear in the trace view
Solutions:
- Verify the target metrics data source is configured and working.
- Ensure linked queries are defined with valid query syntax.
- Check that the
$__tagskeyword in queries maps to tags that exist in the span.
Template variable errors
These errors relate to using template variables with the Zipkin data source.
Variable value not substituted in query
Symptoms:
- The trace ID field shows the variable syntax (for example,
${traceId}) instead of the actual value - Query returns no results when using a variable
Solutions:
- Verify the variable is defined in Dashboard settings > Variables.
- Check the variable name matches the syntax used in the query. Variable names are case-sensitive.
- Ensure the variable has a value selected or entered.
- For text box variables, verify the viewer has entered a value.
Enable debug logging
To capture detailed error information for troubleshooting:
Set the Grafana log level to
debugin the configuration file:[log] level = debugReview logs in
/var/log/grafana/grafana.log(or your configured log location).Look for Zipkin-specific entries that include request and response details, such as:
Failed to close response bodyAn error occurred while doing a resource callAn error occurred while processing response from resource call
Reset the log level to
infoafter troubleshooting to avoid excessive log volume.
Get additional help
If you’ve tried these solutions and still encounter issues:
- Check the Grafana community forums for similar issues.
- Review the Grafana GitHub issues for known bugs.
- Consult the Zipkin documentation for service-specific guidance.
- Contact Grafana Support if you have a paid plan. Open a support ticket for Grafana Cloud, or contact support for Grafana Enterprise.
- When reporting issues, include:
- Grafana version
- Error messages (redact sensitive information)
- Steps to reproduce
- Relevant configuration (redact credentials)


