Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Salva Corts aae13c376d Add metadata to push payload (#9694) ... **What this PR does / why we need it**: We are adding support for attaching labels to each log line. This is one of the series of the PRs broken up to make it easier to review changes. This PR updates the push payload to send labels with each log entry optionally. The log labels are supposed to be in the same format as the stream labels. Just to put it out, here is how it would look for proto and json push payload with same data: **proto(`endpoint`: `(/loki/api/v1/push|/api/prom/push)`, `Content-Type`: `application/x-protobuf`)**(payload built using [push.Stream](4cd1246b88/pkg/push/types.go (L12))): ``` push.Stream{ Entries: []logproto.Entry{ { Timestamp: time.Unix(0, 1688515200000000000), Line: "log line", Labels: `{foo="bar"}`, }, }, Labels: `{app="test"}`, } ``` **v1(`endpoint`: `/loki/api/v1/push`, `Content-Type`: `application/json`)**: ```json { "streams": [{ "stream": { "app": "test" }, "values": [ ["1688515200000000000", "log line", { "foo": "bar" }] ] }] } ``` **legacy-json(`/api/prom/push`, `Content-Type`: `application/json`)**: ```json { "streams": [{ "labels": "{app=\"test\"}", "entries": [{ "ts": "2023-07-05T00:00:00.000000000Z", "line": "log line", "labels": "{foo=\"bar\"}" }] }] } ``` **Which issue(s) this PR fixes**: **Special notes for your reviewer**: We may need to add more thoughtful tests. **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [x] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` - [ ] For Helm chart changes bump the Helm chart version in `production/helm/loki/Chart.yaml` and update `production/helm/loki/CHANGELOG.md` and `production/helm/loki/README.md`. [Example PR](d10549e3ec) --------- Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com>		3 years ago
..
analytics	Upgrade `golangci-lint` and fix linting errors (#9601)	3 years ago
canary	Upgrade `golangci-lint` and fix linting errors (#9601)	3 years ago
chunkenc	all: remove repetitive the (#9823)	3 years ago
configs	Update prometheus/prometheus from 2.41 to 2.42 (#8571)	3 years ago
distributor	updated to the latest version of dskit (#9920)	3 years ago
ingester	Add targetLabels to SeriesVolume requests (#9878)	3 years ago
iter	Reuse allocated buffer space in merge iterator. (#9538)	3 years ago
logcli	Upgrade `golangci-lint` and fix linting errors (#9601)	3 years ago
loghttp	Add metadata to push payload (#9694)	3 years ago
logproto	Add metadata to push payload (#9694)	3 years ago
logql	Add back cache stats for index stats requests (#9816)	3 years ago
logqlanalyzer	fixed logql-analyzer (#8258)	3 years ago
logqlmodel	Add back cache stats for index stats requests (#9816)	3 years ago
loki	updated to the latest version of dskit (#9920)	3 years ago
lokifrontend	Upgrade `golangci-lint` and fix linting errors (#9601)	3 years ago
push	Add metadata to push payload (#9694)	3 years ago
querier	Add metadata to push payload (#9694)	3 years ago
ruler	updated to the latest version of dskit (#9920)	3 years ago
runtime	Loki: Implement initial phase of `limited_log_push_errors` (#9556)	3 years ago
scheduler	updated to the latest version of dskit (#9920)	3 years ago
server	Configurable TLS MinVersion and CipherSuites (#7227)	3 years ago
sizing	Upgrade `golangci-lint` and fix linting errors (#9601)	3 years ago
storage	updated to the latest version of dskit (#9920)	3 years ago
tracing	Promtail: Add basic tracing support (#7414)	3 years ago
util	Add metadata to push payload (#9694)	3 years ago
validation	Add limit to the series volume endpoint (#9833)	3 years ago