2625 Commits (2564a810c5872205c7385cd6d0a787b68477188f)

 

All Branches   

Search

Author	SHA1	Message	Date
Callum Styan	e49e318b42	Improve lambda-promtail docs based on Owens review. (#4548) ... * Improve lambda-promtail docs based on Owens review. Signed-off-by: Callum Styan <callumstyan@gmail.com> * One last lambda-promtail docs improvement. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix bolding in lambda-promtail docs + include link to drop filter promtail pipeline stage.	4 years ago
Sankalp Rangare	9e2acd656d	add static labels in stages (#4495) ... Signed-off-by: Sankalp Rangare <sankalprangare786@gmail.com>	4 years ago
Cyril Tovena	ea8e0987b3	Fixes an edge case in the batch chunk iterator. (#4550) ... * no-cache Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * found a bug to fix. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes a edge case in the batch chunk iterator. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	47336cdbe6	Fixes a panic in the labels API when no parameters are supplied. (#4554) ... * Fixes the a panic in the labels API when no parameters are supplied. We were supporting this before. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove bad test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Owen Diehl	a27aec37cf	only exports tenant limits which differ from defaults and export defa… (#4542) ... * only exports tenant limits which differ from defaults and export defaults under `loki_overrides_defaults` metric. * docs & changelog	4 years ago
Ed Welch	6853c387ed	Loki: Apply the ingester ring config to all other rings (distributor, ruler, query-scheduler) (#4546) ... * apply the ingester ring config to all other rings in ApplyDynamicConfig * update the test, only verify ingester config wasn't manipulated by the step to apply the common memberlist config when join_members is defined.	4 years ago
Trevor Whitney	2864a4f728	enable virtual read write targets (#4498) ... Co-Authored-By: Mauro Stettler <mauro.stettler@gmail.com> Co-authored-by: Mauro Stettler <mauro.stettler@gmail.com>	4 years ago
Callum Styan	aa713f54f4	Modify lambda-promtail docs based on rewrite. (#4539) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Callum Styan	29c7fd2b24	Pass repo as registry+repo as temporary workaround for drone ECR publish issues. (#4541) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
李国忠	6fcd02bad4	[querier] s3: add getObject retry (#4453) ... * [querier] s3: add getObject retry * [querier] s3: add getObject retry * [querier] s3: add getObject retry #4452 * [querier] s3: add getObject retry * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Dylan Guedes	e0b4e25962	Document the common config section (#4485) ... * Document the common_config section. * Apply suggestions from code review Fix subsection reference from `filesystem_storage_config` to `local_storage_config` Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
JordanRushing	8cb57424e3	Update CHANGELOG.md and /docs with info on new `overrides-exporter` module for Loki (#4540) ... * Update CHANGELOG.md and /docs with info on new overrides-exporter module for Loki * Apply small changes to `overrides-exporter` docs Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Dylan Guedes	77ea11724b	Loki: Enable FIFO cache by default (#4519) ... * Set default FIFO cache with reasonable defaults. Signed-off-by: Mauro Stettler <mauro.stettler@gmail.com> * Remove FIFO cache feature flag. - We noticed that we always want that behavior, so the logic is better implemented in the `ApplyDinamicConfig` method - Update documentation * Move FIFO cache default behavior. - Move FIFO cache default behavior implementation to ApplyDinamicConfig * Add tests for the new FIFO cache default behavior. - The tests tests the behavior of the four existing caches (query results, query index, write dedupe, and chunk results) - Add changelog entry - Fix lint issues regarding import order - Revert moving of EnableFifoCache check * Apply suggestions from code review - Change `EnableFifoCache` description to mention that it is only applied for chunk and query results cache Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Mauro Stettler <mauro.stettler@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Owen Diehl	b2ad709225	brings storage architecture up to date (#4521) ... * brings storage architecture up to date * pr feedback	4 years ago
Callum Styan	ea78cde659	Add drone build job for lambda-promtail images. (#4480) ... * Add drone build job for lambda-promtail images. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix image tag portion of drone job for lambda-promtail build Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address some review feedback. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Regenerate drone yaml file after some changes. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Danny Kopping	fa305260c6	Temporarily taking over `/docs` while Karen is away (#4538) ... * Temporarily taking over /docs while Karen is away Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding Ed and Owen Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Callum Styan	1493278ff2	Add a a parameter to keep/drop the stream label from cloudwatch. (#4494) ... * Add a a parameter to keep/drop the stream label from cloudwatch. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address Cyril's review comments. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Ensure the keep stream value is properly passed in as an environment variable when deploying via CloudFormatioEnsure the keep stream value is properly passed in as an environment variable when deploying via CloudFormationn Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Dylan Guedes	f4cfd284a6	Docs: Move rule storages configs to their own sections (#4493) ... * Move rule storages configs to their own sections. - Create new docs sections `azure_storage_config`, `gcs_storage_config`, `s3_storage_config`, and `swift_storage_config` with the docs configs from `ruler_config["storage"]` - Reference the new sections in the existing `ruler_config` section - Add missing periods at `ruler_config` configs * Update storages to have a CLI flag prefix - This way we can reuse these configs in different places (different from `-ruler.config`)	4 years ago
Calle Pettersson	0f0ff7d949	Fix branch reference in PR template (#4535)	4 years ago
JordanRushing	93507a00ed	Add quick nil check in TenantLimits for runtime_config (#4531)	4 years ago
Owen Diehl	9e9252825a	Jsonnet/overrides exporter (#4530) ... * adds overrides-exporter jsonnet * default overrides exporter to disabled * fixes exporter name for k8s compat * add exporter svc for http metrics	4 years ago
Owen Diehl	91eba4fb6b	correctly sets subservicesWatcher on scheduler (#4529)	4 years ago
JordanRushing	ca67292b54	Introduce `overrides-exporter` module to Loki (#4520) ... * Introduce overrides-exporter module from cortex into loki; add some test configs for local dev * Fix panic by adding server dependency to overrides-exporter module * Add tests for limits exporter * Remove dummy configs for testing * Add more limits to export * Add more limits; move mockTenantLimits to exporter_test.go * Introduce overrides-exporter module from cortex into loki; add some test configs for local dev * Fix panic by adding server dependency to overrides-exporter module * Add tests for limits exporter * Remove dummy configs for testing * Add more limits to export * Add more limits; move mockTenantLimits to exporter_test.go * Use reflection; add more limits to export * Fix import to satisfy linter * refactors TenantLimits for clarity & efficiency. Also fixes tenantLimits nil check * Fix breaking test with nil check in runtime_config Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Katarina Yang	e3726a19ca	add missing quote to log_queries.md (#4527)	4 years ago
Owen Diehl	aec00c2507	safely checks read ring for potentially nil scheduler (#4525)	4 years ago
Lize	69819c2e07	update promtail base image to debian:bullseye-slim (#4516)	4 years ago
Trevor Whitney	6f28a5dc70	Apply better defaults when boltdb shipper is being used (#4508) ... * changes from PR review * rename object_store -> storage * add local/filesytem support to common object storage config * add better defaults for boltdb shipper * guard against missing schema configs in dynamic config application * fix alphabetical order of storage configs * return an error when more than one storage config is provided	4 years ago
Danny Kopping	703d68bc76	Promtail: allow for customisable stream lag labels (#4507) ... * Allow for customisable stream lag labels Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Updating test Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Allowing for multiple labels Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding field to docs Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Danny Kopping	cc1d478bb2	Clarify error message (#4524) ... Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Ed Welch	2b5f3000b6	Loki: Add a ring to the query scheduler to allow discovery via the ring as an alternative to DNS (#4424) ... * Fork the frontend and scheduler so we can add support for discovery via the ring. * Add a ring to the query scheduler which is then used by the frontend worker and querier workers to find the scheduler address as an alternative to using DNS * update some of the forked code to use dskit grpcclient and grpcutil since #4312 was merged after the original fork was created. * remove query scheduler dependency from querier Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * migrate logging package and make linter happy Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add SafeReadRing for instances when scheduler is not enabled on same instance * Doc changes from code review A few doc fixes Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * go mod tidy on go-kit dep * update changelog * remove ReadRing in favor of SafeReadRing Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Trevor Whitney	2427fab32d	Configuration: add a common config section for object storage (#4473) ... * add common config for object storage Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * wip Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add test to compactor config override Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * update changelog Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * changes from PR review * rename object_store -> storage * add local/filesytem support to common object storage config	4 years ago
Ed Welch	d8e6debaa5	Loki: Fix bug where items are returned to a sync.Pool incorrectly (#4518) ... * Make sure calls to the SampleIteratorWithClose Close() function are idempotent. * the linter hates my fun error messages	4 years ago
Roger Steneteg	0ae0d4da12	fix filetarget to not be stuck if no files was detected on startup (#4461) ... Signed-off-by: Roger Steneteg <rsteneteg@ea.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Vincent Murphy	517ba7c7b1	Update _index.md (#4499) ... ListObjects is not an S3 permission, it is an API which uses the s3:ListBucket permission.	4 years ago
Garrett	a046d79261	make LogQL syntax scope from private to public (#4446) ... * make LogQL syntax scope from private to public The follow-up for https://github.com/grafana/loki/pull/3991, it makes using LogQL syntax outside possible, it also makes LogRange implements Expr interface. * make constructor also public * Revert "make constructor also public" This reverts commit ab9d0a942c.	4 years ago
Callum Styan	6da518c728	Update to go 1.17; go mod vendor required (#4487) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
JordanRushing	afbbc2fc4f	Add metric prefix changes for chunk store and runtime config to upgrading.md (#4436)	4 years ago
Karen Miller	c4562f19ed	Docs: correct the page parameter in the Grafana Cloud advertisement (#4486)	4 years ago
Danny Kopping	cff8324f24	Replacing go-kit/kit/log with go-kit/log (#4484) ... * Replacing go-kit/kit/log with go-kit/log Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the f&^$ing linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding depguard Cleaning go mod Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Updating weaveworks after https://github.com/weaveworks/common/pull/226 was merged Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the mod checker Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Callum Styan	096cf0cfaf	Update golang and loki-build-image image versions. (#4481) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Owen Diehl	7832783b1c	always expoe loki_build_info (#4482)	4 years ago
Owen Diehl	3fb8f3d3c6	restores for state at seconds(now-forDuration) (#4479) ... * restores for state at seconds(now-forDuration) * bump ci	4 years ago
Mauro Stettler	4b59556342	Update cortex to newer version (#4478) ... * update cortex and thanos to newer version * pin k8s.io/apimachinery * fixes for newer libs * add missing method to mock wal data collector * fixing test by using different gokit level pkg * make check-mod	4 years ago
Callum Styan	5f3e9a1943	Update loki-build-image to drone 1.4.0 (#4462) ... * Update loki-build-image to drone 1.4.0 Signed-off-by: Callum Styan <callumstyan@gmail.com> * update build image go versions plus fix install of drone-cli Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update build image version used in makefile Signed-off-by: Callum Styan <callumstyan@gmail.com> * update drone yaml built via new build image (updated drone cli version) Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Dylan Guedes	6498c8cb13	Loki: Change default limits to common values (#4415) ... * Change some default limits to reasonable values. - These new limits protect users from overwhelming their cluster with ingestion load - The new limits are: * ingestion_rate_strategy: global <- currently defaults to local * max_global_streams_per_user: 5000 <- current default is no limit * max_query_length: 721h <- current default is no limit * max_query_parallelism: 32 <- current default is 14 * max_streams_per_user: 0 <- current default is 10000 * reject_old_samples: true <-- current default is false * reject_old_samples_max_age: 168h <-- current default is 336h * Remove parameters from examples - They are not necessary anymore because of the new default values * Add new entries to CHANGELOG and upgrading guide * Apply suggestions from code review Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com> * Change changelog mark entry from '-' to '*' Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	4 years ago
Dylan Guedes	d3d63e1778	Loki: Override distributor's default ring KV store (#4440) ... * Override default KV store for the compactor. - Currently, the default KVstore is consul. This changes it to inmemory to make it easier for new users to run the project without dependencies. - Refactor default flag value tests. Now, it will check for a populated map instead of checking for flags during iteration. * Move distributor flag override to RegisterFlags. * Add missing CHANGELOG and upgrading guide entries.	4 years ago
Trevor Whitney	7118dc3272	Change default values for two GRPC setting we have to set so the queriers can connect to a frontend or scheduler (#4435) ... * change gprc server defaults Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add docs and changelog Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>	4 years ago
Trevor Whitney	81d0f1d533	Add more tests around config parsing changes from common config PR (#4433) ... * add test to demonstrate bug Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * a totally empty yaml file causes weird behavior Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add default unmarshal test for test config wrapper Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add additional tests around default unmarshal to confirm bug is not there Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * clean up tests Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * check errors in test Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>	4 years ago
Kaviraj	2e1279d996	Fix return values of Matrix and Vector during query range in QueryShardingMiddleware (#4457) ... * Fix matrics `result` type being `null` Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add test for vector type as well Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
MrWong99	00168b341a	Remove unused variable in fluentd output plugin (#4261) ... I couldn't figure out why this variable is there. If I am missing any global variables by fluentd feel free to close this PR without any notice	4 years ago