4114 Commits (9bc6e85604bcfb3d486eb4bc48305fdc163f0589)

 

All Branches   

Search

Author	SHA1	Message	Date
Karsten Jeschkies	9bc6e85604	Helm: Allow users to define remote write for metrics. (#7399)	3 years ago
Goutham Veeramachaneni	1260adc756	[mixin] Add cortex-gw-internal to dashboards (#7481)	3 years ago
Sandeep Sukhani	bb2927172a	tsdb post compaction cleanup (#7502) ... **What this PR does / why we need it**: Previously when we were reading the whole tsdb index in memory, there was not much cleanup required after we were done with the index. Now that we are mmaping the tsdb index, we need to close the mmap. I had missed calling `index.Close()` on the compacted-away multi-tenant index. This causes the compactor to retain the files on disk, leading to the compactor running away from disk space. This PR takes care of it. While doing the changes, I noticed that some of the tests failed due to `LabelValues` tsdb implementation returning strings valid only until the underlying byte slice stays valid. Since the underlying byte slice could become invalid when we close the tsdb, we should return a copy instead of yolostring. This can also happen on the query path when a sync closes the index before we get to return the response. This PR also fixes that.	3 years ago
Ed Welch	23cc448881	Loki: log when a query starts in the logql engine (#7469) ... Signed-off-by: Edward Welch <edward.welch@grafana.com> **What this PR does / why we need it**: There are cases where a query cannot finish (OOM of a querier/ruler) and most of our logs are emitted upon completion of a query. This can help us find queries which are OOM crashing a component. Note: It only covers queries executed by the engine, so only instant and range queries. Another PR will be necessary to cover labels/series endpoints. However this approach seemed the best to be able to get this information from ruler executed queries. **Which issue(s) this PR fixes**: Fixes #<issue number> **Special notes for your reviewer**: **Checklist** - [ ] Reviewed the `CONTRIBUTING.md` guide - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Owen Diehl	70f6bf2e45	Index gw lock bugfix (#7497) ... While I'm still in favor of a longer refactor to address the complexity described in https://github.com/grafana/loki/pull/7490, I'm opening this PR as a shorter, more immediate alternative that should fix the deadlocks. This also reduces the number of total lock calls in many cases as we lock to act over entire groups rather than individual items.	3 years ago
Travis Patterson	45d59ba571	Improve rate store refresh latency (#7492) ... Rather than iterating streams and getting rates per stream, keep all necessary information in the rate calculator and just hand back the current rates when asked. This change took p99 latencies from ~1.8s to ~400ms and p50 latences from ~1s to 6ms.	3 years ago
Michel Hollands	fd93a6c999	Add how to connect to Azure using Service Principal (#7485) ... Add documentation for https://github.com/grafana/loki/pull/7179 which added authentication using a Service Principal for Azure.	3 years ago
Travis Patterson	b4ed595461	Remove groupcache (#7126) ... As discussed during the caching retro, this PR removes the experimental distributed cache based on Mailgun's fork of groupcache. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Trevor Whitney	ae2a6f31ae	[Helm] Add flags needed for migration from distributed (#7331) ... **What this PR does / why we need it**: Adds flags to the helm charts that are needed when doing a zero-downtime migration from a `loki-distributed` helm chart deployment. The flags allow for an additional memberlist join member to be specified. This allows the new `grafana/loki` cluster to join the old `grafana/loki-distributed` cluster, forming one big cluster. The ingesters in the `grafana/loki-distributed` cluster can then be taken down 1-by-1, allowing the whole `grafana/loki-distributed` cluster to be deleted once all the ingesters have scaled down. **Which issue(s) this PR fixes**: Fixes #7330 Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz>	3 years ago
Dylan Guedes	da5378c927	Loki: Remove RatelimitedStream proto (#7235) ... **What this PR does / why we need it**: Remove an unused proto (RateLimitedStream). It was only used for an older approach to deal with rate-limited streams but since we changed approaches this isn't necessary anymore.	3 years ago
Dylan Guedes	67de0334e9	Docs: Add max_streams to Promtail configuration doc (#7489) ... **What this PR does / why we need it**: Document `max_streams` configuration, introduced in 2.7. Co-authored-by: Ursula Kallio <ursula.kallio@grafana.com>	3 years ago
Trevor Whitney	16862b1edc	[helm] Mimic loki service account with canary account (#7236) ... **What this PR does / why we need it**: Bring the Loki Canary service account in line with the Loki service account, removing the post install hook, and sharing the top level properties for `automountServiceAccountToken` and `imagePullSecrets`. I'm open to creating canary specific values for these setting if needed, but want to start by sharing the top level values to reduce config if possible. Also default canary to Appversion to be in sync with default Loki version **Which issue(s) this PR fixes**: Fixes two issues raised in comments from @towolf (thanks!) on this [PR](https://github.com/grafana/loki/pull/7173#issuecomment-1256410181). Fixes #7237	3 years ago
Tim Schwenke	ff406bd4a9	Helm: Replace incorrect key loki.authEnabled in example override values (#7432) ... **What this PR does**: Replace `loki.authEnabled` in one of the example override YAMLs with `loki.auth_enabled` to match the actual key name. Also adds missing newline at end of file.	3 years ago
Mohamed-Amine Bouqsimi	7debe7c235	Ruler: enable Loki to configure Alertmanagers per tenant (#7359)	3 years ago
Christian Haudum	0f5dd2bceb	Revert "fluentd: Add un-escaping of control characters in JSON" (#7468) ... Reverts grafana/loki#7396 according to discussing on PR	3 years ago
Michel Hollands	488e64e3ff	Update helm chart version (#7484) ... Update the Loki helm chart version after the changes made in https://github.com/grafana/loki/pull/7479 Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Michel Hollands	ec541d70e9	Add envFrom to the tokengen job (#7479) ... Add an envFrom section to the tokengen job. Fixes https://github.com/grafana/loki/issues/7411 Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Mohamed-Amine Bouqsimi	7e7436d482	operator: Expose and migrate query_timeout in limits config (#7471)	3 years ago
Dylan Guedes	28e192f22e	Loki: Implement random entries assignment when sharding (#7427) ... **What this PR does / why we need it**: Modify sharding to assign random shards when the number of shards is bigger than the number of entries. This helps us to avoid hot-spotting the first shards. By randomizing the entries assignment we help spread the load between all shards.	3 years ago
Ursula Kallio	709c8508da	Update MAINTAINERS.md (#7467) ... This change removes removes Karen Miller, and includes at least one alternative, interim technical writer. Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Ursula Kallio	7fa3e500c3	Change `master` to `main` and include `.md` ext.	3 years ago
BenjaminVouillaumeJT	2d649a7fdd	Promtail: Add additional fields for cloudflare (#7463)	3 years ago
Periklis Tsirakidis	f8604ba0a7	operator: Upgrade operator-sdk to v1.24.1 (#7449)	3 years ago
Pablo	5f665651d5	Promtail: Add basic tracing support (#7414) ... We've been using Promtail's HTTP/gRPC server-based targets with real workloads for some weeks now. The server that these spin out is based on [weaveworks commons](https://github.com/weaveworks/common) HTTP/gRPC servers. These include by default some middlewares that if enabled, inject tracing support. We found this useful when tracking down request handling time, or even more, if the caller also support Jaeger tracing support, cross-correlated requests between the upstream server and Promtail's. This PR adds support for enabling tracing the same way Loki does. At the moment, this will just generate traces for the before-mentioned targets. In the future, the quality and completeness of tracing support can grow organically to enrich spans.	3 years ago
Robert Fratto	2208ea7147	Update Prometheus dependency to latest release (v2.39.1) (#7425)	3 years ago
Periklis Tsirakidis	4176de17d1	Add compactor delete client tls client config (#7426)	3 years ago
Michel Hollands	109b9dce9a	Add remote schema option (#7442) ... Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Mohamed-Amine Bouqsimi	fa305a4a7a	operator: Fix Custom TLS profile setting for LokiStack on OpenShift (#7437)	3 years ago
Periklis Tsirakidis	26d2989086	Expose ring and memberlist handlers through internal server listener (#7436)	3 years ago
Travis Patterson	c1bccac141	Results cache fix improvements (#7444) ... Move middleware to someplace more sensible and incorporate feedback missed in the review for this.	3 years ago
Owen Diehl	b59277b472	Revert "Revert "Update Thanos dependency to latest version"" (#7372) ... Reverts grafana/loki#7371 PR re re-enable Thanos dependency bump.	3 years ago
Travis Patterson	f2297d3d2a	Fix result cache misses on sharded queries (#7429) ... Headers weren't being propagated from query responses on sharded queries causing result cache misses. This PR: - Adds headers to `logproto.Result` so we can save response headers as they come back from queries - Metric-query results are turned into numbers well away from where responses are sent to the frontend: save all headers in the context so they can be pulled out when the final result is calculated - Propagate headers in the final responses	3 years ago
Danny Kopping	c6b2294bbf	Add Li Guozhong as a maintainer (#7440) ... A formal vote has taken place and `liguozhong` has been accepted! 🎉	3 years ago
Richard Treu	5fe714e466	fluentd: Add un-escaping of control characters in JSON (#7396)	3 years ago
Robert Jacob	895e95c4fc	operator: Regenerate manifests (#7438)	3 years ago
李国忠	8dcc4b3ec8	Do not log 'unable to read rules directory' at startup if directory hasn't been created yet (#7434)	3 years ago
Periklis Tsirakidis	9c8a827576	Fix enable of internal server for modules (#7423) ... **What this PR does / why we need it**: Makes adding the internal server modules to the module map more robust. The previous implementation accidentally dropped other modules. **Which issue(s) this PR fixes**: Fixes #<issue number> **Special notes for your reviewer**: **Checklist** - [x] Reviewed the `CONTRIBUTING.md` guide - [ ] Documentation added - [x] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	3 years ago
Karsten Jeschkies	4c0d279e11	Add helm-docs to build image. (#7424)	3 years ago
Mohamed-Amine Bouqsimi	30bdee876e	operator: Add alert relabel config (#7415)	3 years ago
Danny Kopping	2caf5f7c5d	Promtail: correctly hashes the config on reload (#7421)	3 years ago
Karsten Jeschkies	62707bf517	Loki mixin: Correct Loki datasource variable name. (#7422)	3 years ago
Gerard Vanloo	bc18d8f138	operator: Update golang and dependencies (#7418)	3 years ago
Pablo	e73584a3cd	Promtail: Add handler timeout for GCP Logs Push target (#7401) ... **What this PR does / why we need it**: After been running the GCP Logs Push target in actual workloads, we've noticed that GCP sends a lot of traffic, and adjusts that send rate according to the rate at which the receiver can process. To perform that adjustment, GCP considers as a NACK [non 2xx HTTP responses](https://cloud.google.com/pubsub/docs/push#receive_push). This PR adds a target handler timeout (that includes as well the `api.Entry` channel send) to allow the user to configure this maximum processing time, therefore giving GCP notice that the sending rate is too high. This new timeout is optional, and disabled by default. **Which issue(s) this PR fixes**: Related to https://github.com/grafana/cloud-onboarding/issues/2067 **Special notes for your reviewer**: **Checklist** - [ ] Reviewed the `CONTRIBUTING.md` guide - [x] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [x] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	3 years ago
Abder	cc9ba40be0	promtail: Fix exposed metric documentation for request_duration_seconds (#7420) ... **What this PR does / why we need it**: Fixing the documentation about exposed promtail metrics for promtail_request_duration_seconds **Which issue(s) this PR fixes**: No issue related **Special notes for your reviewer**: **Checklist** - [x] Reviewed the `CONTRIBUTING.md` guide - [x] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	3 years ago
Travis Patterson	5ff0641c4e	Bump tail dependency to address windows locking issues (#7417) ... Tail PR: https://github.com/grafana/tail/pull/14	3 years ago
李国忠	435c055488	log panic full stack in boltdb recover block (#7410)	3 years ago
Karsten Jeschkies	85e524788e	Provide example policy for S3 storage. (#7407) ... **What this PR does / why we need it**: This should make it easier for users to set the proper policies for their S3 storage. **Which issue(s) this PR fixes**: Relates to #7403 **Special notes for your reviewer**: **Checklist** - [ ] Reviewed the `CONTRIBUTING.md` guide - [x] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	3 years ago
李国忠	61bbe15171	[promtail] log: simplify log, only print hash (#7405) ... Compute and print MD5 hash of config	3 years ago
Joel Verezhak	46d3dec010	[loki-canary] Allow insecure TLS connections (#7398) ... **What this PR does / why we need it**: This change allows client certificates signed by a self-signed certificate authority to be used by the Loki canary. **Which issue(s) this PR fixes**: Fixes #4366 **Special notes for your reviewer**: This has been tested on linux amd64 with self-signed certificates. **Checklist** - [x] Reviewed the `CONTRIBUTING.md` guide - [x] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [x] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	3 years ago
Vijal Patel	5f7543d047	Fix promtail scrape config job name validation (#7402)	3 years ago