Monitoring New Added 2 October 2026

Prometheus: vector cannot contain metrics with the same labelset

A function such as rate(), or a label_replace() call, dropped the metric name or rewrote a label, so two series that used to differ now have identical labels. A query result cannot hold two series with the same labels. It usually shows up when a selector matches several metric names with a regex on __name__.

Quick fix

Read the commands before running them. Anything that restarts a service, deletes data or changes permissions should be tried on a non-production system first.

Quick fix

# Which series collapse into the same labels?
count by (__name__, job, instance) ({__name__=~"http_.*_total"})

# Keep them apart by copying the name into a normal label first
rate(label_replace({__name__=~"http_.*_total"}, "metric", "$1", "__name__", "(.+)")[5m:])

# Or aggregate explicitly so the duplicates are summed
sum by (job) (rate({__name__=~"http_.*_total"}[5m]))

How to diagnose Monitoring errors

Monitoring failures create a dangerous blind spot: dashboards go flat and the natural assumption is that traffic stopped. The usual causes are scrape targets unreachable (network policy, wrong port, or a service with no endpoints), exporter queues full (the backend is rejecting or throttling), and cardinality explosions that cause the time-series database to reject writes. Always alert on the absence of data, not only on bad values.

If the quick fix above does not resolve it, work through these steps. They apply to this whole class of error, not just to this one message, which is usually what saves the time.

Check the scrape target's status page (/targets in Prometheus). It shows the last scrape error verbatim.
Curl the metrics endpoint from inside the cluster or network segment the scraper runs in: reachability from your laptop proves nothing.
For OpenTelemetry, enable the collector's own telemetry and watch otelcol_exporter_queue_size and otelcol_exporter_send_failed_spans.
Investigate cardinality before increasing memory: a label containing a user ID, request ID or URL path with IDs in it will exhaust any TSDB.
Write a dead-man's-switch alert that fires when a known-always-firing metric stops arriving. It is the only alert that catches a broken pipeline.

Tools worth reaching for

Prometheus /targets
promtool check config
otelcol internal metrics
curl <exporter>/metrics
Grafana Explore

Authoritative references

Primary documentation for this error, worth reading before applying any fix in production.

prometheus.io prometheus.io

Related Monitoring errors

See all 18 Monitoring errors →

Browse other categories

Something missing or wrong?

This entry is maintained by hand. If the fix is out of date, incomplete, or you have a better one, email a correction and it will be reviewed.