3218 Commits (6a533e5a56479dec9b69eb970ee16cdb833b4004)

 

All Branches   

Search

Author	SHA1	Message	Date
RangerCD	4ee686c22c	Remove ErrStreamMissing (#5234)	3 years ago
JordanRushing	849f45ea8c	Update loki-mixin gcs queries in the Loki operational dashboard (#5232) ... Signed-off-by: Jordan Rushing <jordan.rushing@grafana.com>	3 years ago
Callum Styan	bfef7bad44	Start refactor of storage (chunks) clients metrics into structs (#5057) ... * Refactor azure metrics to be a struct (+ add an overall client metrics struct), add an azure client metric for total egress bytes. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Add changelog entry for new azure metric. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fixes based on Kavi's review. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix one more merge conflict that I missed in the merge commit. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix failing tests. Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Kaviraj Kanagaraj	7713ff78e2	Fix `cortexpb` -> `logproto` rename in some tests (#5231) ... * Fix `cortexpg` -> `logproto` rename in some tests Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix TimestampMs rename Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * queryrange test Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix tests on queryrangebase pacakage\ Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix some typos Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Callum Styan	f24b84c15a	[querier] Abort a query in limitedRoundTripper if parallelism is 0 (#5190) ... * Abort a query in limitedRoundTripper if parallelism is 0. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix failing tests related to fakeLimits change. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Change limitedRoundTripper parallelism error message. Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Cyril Tovena	fa25e54e26	Bump logstash plugin gem (#5230) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Karsten Jeschkies	4716eea0db	Provide Docker target and discovery in Promtail. (#4911) ... **What this PR does / why we need it**: This patch adds support to fetch Docker container logs through the Docker daemon API. This should be more robust than the Loki Docker driver or scraping the logs files. The new Docker target will also collect meta information of the scraped containers. **Which issue(s) this PR fixes**: Addresses #2361 Closes #4703 **Special notes for your reviewer**: **Checklist** - [x] Documentation added - [x] Tests updated - [x] Add an entry in the `CHANGELOG.md` about the changes.	3 years ago
Christian Haudum	2e6e050453	Improve docs on how to install logcli from source (#5126) ... * Improve docs on how to install logcli from source Closes #5108 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Improve docs on how to install logcli from source Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Kaviraj Kanagaraj	db283da088	Add `MaxSurge` and `MaxUnavailable` strategy to all Loki k8 workloads. (#5227) ... * Add `MaxSurge` and `MaxUnavailable` strategy to all loki k8 workloads. This fixes couple of issues. 1. By default these configs are 25% in k8, meaning during rollout 25% of pods are allowed to shutdown immediately. 2. Due to (1), during graceful shutdown process, 25% of all the pods access consul to `unregister()` from shared key value. (2) makes CAS rate of underlying KV store high (leads to lots of retry and failing) sometimes failing to unregister leaving the ring "unhealthy" Also this PR make these configs consistent across all k8 workloads. More details: https://github.com/grafana/dskit/issues/117 * Remove it from statefulset workloads Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Dylan Guedes	3f496e7336	Copy `cortex/pkg/cortexpb` package dependency into Loki (#5151) ... * Fork cortexpb into Cortex `pkg/logproto`. * Use `pkg/logproto` instead of Cortex `pkg/cortexpb`. * Rename `cortexpb` usage to `logproto`. * Fix encoding/decoding test. * Replace cortexpb usage in the ruler/base package. * Remove exemplars from logproto.	3 years ago
Dylan Guedes	3f78d876ff	Copy `cortex/pkg/prom1` package dependency into Loki (#5196) ... * Fork cortex `prom1`. * Use forked `prom1` instead of Cortex one.	3 years ago
aengusrooneygrafana	c9d49cea6f	Update to Unofficial clients for JS (#5180) ... Came across these packages for JS with help from Danny - I thought they would be useful to include in our docs for posterity. CC @dannykopping for info!	3 years ago
Susana Ferreira	50ca4d5186	Addition of cortex' queryrange tests (#5183)	3 years ago
Trevor Whitney	99e046c42f	Default max_outstanding_per_tenant to 2048 (#5204) ... * Default max_outstanding_per_tenant to 2048 * Update changelog	3 years ago
李国忠	d88d20e44f	[instrument] cache: add tracing instrumentation when error !=nil (#5202)	3 years ago
Kaviraj Kanagaraj	0913ea5bf3	Update Loki Team members in the Governance doc. (#5219) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Sandeep Sukhani	0426870f3f	fix broken boltdb-shipper test (#5222)	3 years ago
Sandeep Sukhani	cd1537d06e	step align start and end time of the original query while splitting it (#5217) ... * step align start and end time of the original query while splitting it * also step align queries with step > split interval	3 years ago
Sandeep Sukhani	d87f2a1c8a	per user index changes on the write path (#5193) ... * per user index changes on the write path - add a flag to enable building per user index from the ingesters - when enabled, ingesters would build boltdb files with buckets per tenant	3 years ago
Dylan Guedes	61ff29a574	Copy `cortex/pkg/chunk/purger` package dependency into Loki (#5169) ... * Fork cortex `pkg/chunk/purger`. * Replace `chunk/purger` usage. - Move away from Cortex implementation to instead use the new forked Loki implementation. * Remove unused code from `storage/chunk/purger`. * Remove unused vendored dependencies. * Remove `chunk/purger` implementation. - Loki already has the `compactor/deletion`, so the `chunk/purger` isn't really used.	3 years ago
Friterad Knäskål	4de90321fd	Update docker.md (#5213) ... Create the containers in detached mode and name the promtail container "promtail". Without this fix the first container must be stopped before the second one is started since they are running in foreground. The promtail container didn't have any "--name" flag so docker assigns a random name to it.	3 years ago
RangerCD	b26b73d5be	Remove instance level streams lock (#5179) ... * Feat(ingester): remove instance level streams lock * Fix lint * Solve Load and Delete consistency problem while pushing to ingester	3 years ago
Arve Knudsen	a2dd731586	Chore: Add pkg/util/log package (#5187) ... * Chore: Add pkg/util/log package Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Add changelog entry Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Fix documentation of loki_log_messages_total Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	3 years ago
李国忠	7fca88debd	[enhancement] querier : Add "query_memory_only" to make loki have option to rely only on memory availability like google monarch. (#5093) ... * [enhancement] querier : Add "query_memory_only" to make loki have option to rely only on memory availability like google monarch. * Update pkg/querier/querier.go Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * [enhancement] querier : Add "query_memory_only" to make loki have option to rely only on memory availability like google monarch. #5093 Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com>	3 years ago
Sandeep Sukhani	88b5a767bc	changes on read path for supporting per user index with boltdb-shipper (#5073)	3 years ago
Sandeep Sukhani	49ffe5291d	add objects list caching for boltdb-shipper index store to reduce object storage list api calls (#5160)	3 years ago
Trevor Whitney	9ff24ac736	Remove temporary ruler ring key fix (#5189) ... Ring keys have been moved out of dskit into their respective projects. Edit commit drone hack	3 years ago
Owen Diehl	1b5b8a3109	log headblock conversion error during replay cleanup (#5185)	3 years ago
Kaviraj	5b5d469038	Support `X-Query-Tags` in LogCLI (#5145) ... * Add support for `--query-tags` LogCLI Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Split it into helper func Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Cleanup the tests Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix linter Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix `getHTTPRequestHeader()` in test assert Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Sandeep Sukhani	dad7fca2fd	align metric queries by step and other queries by split interval (#5181)	3 years ago
Cyril Tovena	1a7614ff70	Avoid splitting large range vector aggregation. (#5172) ... * Reduce split by for large range vector Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/querier/queryrange/split_by_interval.go Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * improve fn name. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Shane St Savage	fafa8d1e87	Move VerifyConfig after PrintConfig and LogConfig (#5149) ... Move VerifyConfig after PrintConfig and LogConfig so that config can be dumped and the program can exit instead of starting loki.	3 years ago
李国忠	6c85cda61a	Handle `context` cancellation in some of the `querier` downstream requests (#5178)	3 years ago
Dylan Guedes	66bf9f6474	Copy `cortex/tools/querytee` package dependency into Loki (#5165) ... * Fork Cortex `tools/querytee`. * Use forked querytee instead of Cortex one. * Add `loki/tools` to list of possible paths. * Add opts to querytee proxy.	3 years ago
Kaviraj	5dc888710a	Support "POST" method for distributor ring (#5171) ... Able to "forget" the unhealthy member Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Christian Haudum	86ed98c1fa	Fix promtail deadlock (#5170) ... * Remove unused clientConfigs argument from NewTargetsManagers * Do not create targetScrapeConfigs if stdin target is used * fixup! Remove unused clientConfigs argument from NewTargetsManagers * Close file watcher when target is removed Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Close file watcher when target is removed Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup: add changelog entry Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fixup! Close file watcher when target is removed Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Karsten Jeschkies	b03e2783d6	Package logcli as rpm and deb. (#4667) ... * Package logcli as rpm, deb and apk. * Package logcli on release builds.	3 years ago
Kaviraj	dddace862d	Add nil check for Ruler BasicAuth config. (#5168) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Christian Haudum	985e965796	Fix encoding error in fluentd client (#5163) ... * Fix encoding error in fluentd client This change fixes a bug that is caused by incorrectly trying to encode any values other than string. This bug was a regression introduced with #5107 and caused `NoMethodError` errors. Fixes #5099 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Bump fluent-plugin-grafana-loki to version 1.2.18 Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Cyril Tovena	144bee11af	Retry pulling Cloudflare logs after a stream error (#5158) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Sashank Agarwal	f884f2b82b	revert operator's loki-config changes (#5155)	3 years ago
李国忠	2c20ce6857	[optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200" (#4891) ... * [optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200" * [optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200" #4891 * [optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200" #4891 * [optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200" #4891 * [optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200" #4891 * Update pkg/storage/chunk/cache/instrumented.go Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz> * [optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200" #4891 * [optimization] cache prometheus : fix "loki_cache_request_duration_seconds_bucket" ‘status_code’ label always equals "200" #4891 * Update pkg/querier/queryrange/roundtrip.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update roundtrip.go Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Sas Swart	205ad61b8c	Docs: Update memory ballast documentation (#5106) ... * Add memory ballast * Add changelog entry * Add documentation Add additional information to Flag description * Ensure that ballast_bytes can be configured from config file Add documentation * Add Operational scalability documentation related to memory ballast * Restore config.ballast-bytes cli flag * Move config.ballast-bytes cli flag declaration * Update memory ballast documentation as per https://github.com/grafana/loki/pull/5081\#pullrequestreview-848460132 Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Danny Kopping	0368a09d4c	Ruler: Fix remote write basic auth credentials (#5144) ... * Retrieving original password to avoid marshaling issues Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Fixing test Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding CHANGELOG entry Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Kaviraj	e5c514359b	Fix broken `template_variable` doc link (#4960)	3 years ago
Dylan Guedes	4b1269afab	Remove unused `storegateway` base (#5141)	3 years ago
Cyril Tovena	e2a443452d	Fixes operational dashboard and add azure. (#5127) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Piggy	e5dcadee8a	Fix test in retention/expiration_test.go on slow machines (#5137) ... Signed-off-by: Piggy NL <piggynl@outlook.com>	3 years ago
Trevor Whitney	bf9eb33385	add jsonnet for simple scalable deploymnet (#5138)	3 years ago
Owen Diehl	8c348614e3	Querier worker/inflight metrics (#5124) ... * refactors querier worker metrics to use metrics struct * metrics and logs for querier worker execution * loki_querier_worker_concurrency metric * alter log line * wires up prometheus.registerer args to prevent duplicate registration errors on tests	3 years ago