apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Sandeep Sukhani	6bdecd6a50	common index set should not expire before any of the user index sets (#5954 )	3 years ago
Callum Styan	8f62334a58	[promtail] Add a log message stating that client level stream lag labels are deprecated (#5850 ) * Add a log message stating that client level stream lag labels are deprecated and will not be used. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Error on startup if a client level stream lag labels value is set. Signed-off-by: Callum Styan <callumstyan@gmail.com> * fix lint error Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Kaviraj Kanagaraj	3d579fb329	chore: Fix flaky test with `TestSingleIdx`. (#5947 )	3 years ago
Fanis Hatzidakis	e7a1b67c0a	Docs: Fix typo in 429 exceeded rate limit error message (#5944 ) * Fix docs typo in word "limit" * Fix docs typo "unlimited" in limits.go	3 years ago
Sandeep Sukhani	b3c818e132	build generic index shipper to be shared between boltdb-shipper and tsdb-shipper (#5705 ) * build generic index shipper to be shared between boltdb-shipper and tsdb-shipper * changes suggested from pr review * Update pkg/storage/stores/indexshipper/downloads/index_set.go Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> * update comments on trying to open corrupt files * fix references broken due to storage refactoring * lint Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Travis Patterson	5939d5e9d8	Query filtering in the ingester and storage (#5629 ) * Add timestamp to pipeline and extractor interfaces * implement filter extractor and pipeline * implement storage filtering * implement ingester filtering * test cleanup * Refactor pipeline setup to util * linter * enable filtering based on mode * review feedback * review comments * review feedback * no need to include label filters in the test pipeline * review feedpack	3 years ago
Sandeep Sukhani	d1aff7b29f	store: fix bug in getting chunk ids from ingesters when using boltdb-shipper (#5945 ) * initialize async store in store factory function itself * add a comment about QueryIngestersWithin	3 years ago
johgsc	27a536718f	Update _index.md (#5934 ) changed URLs for [Fluentd](https://github.com/grafana/loki/tree/main/clients/cmd/fluentd) and [Fluent Bit](https://github.com/grafana/loki/tree/main/clients/cmd/fluent-bit) since the old URLs where leading to a 404 on GitHub.	3 years ago
johgsc	7980943787	Update CHANGELOG.md (#5935 )	3 years ago
Periklis Tsirakidis	2b4ebbd578	Add SIG operator team to governance doc (#4977 ) * Add SIG operator team to governance doc * Update docs/sources/community/governance.md Co-authored-by: Richard Hartmann <RichiH@users.noreply.github.com> * Update docs/sources/community/governance.md Co-authored-by: Richard Hartmann <RichiH@users.noreply.github.com> Co-authored-by: Richard Hartmann <RichiH@users.noreply.github.com>	3 years ago
Karen Miller	03d4238700	Fix SSD Docker installation (#5916 ) * Fix SSD Docker installation * Clarify endpoints and ports	3 years ago
Ed Welch	d1f6a1968e	Loki: Fix issue with recent change to flush code (#5932 ) * fix flush chunks to pass a reference so we can mutate the chunk contents Signed-off-by: Edward Welch <edward.welch@grafana.com> * update the rest of the helper methods to take a reference of the chunk Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Owen Diehl	4c3959b573	Implements TSDB Head (#5864 ) * begins speccing out TSDB Head * auto incrementing series ref + mempostings * mintime/maxtime methods * tsdb head IndexReader impl * head correctly populates ref lookup * tsdb head tests * adds prometheus license to tsdb head * linting	3 years ago
Cyril Tovena	681195f806	Fixes the index-gateway when using the ring (#5923 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Karsten Jeschkies	c7cbeab8e2	Include tenant ID label in label values. (#5908 )	3 years ago
Dylan Guedes	a41926ec50	Only run boltdb-shipper when appropriate. (#5917 )	3 years ago
Cyril Tovena	1331214939	Fixes a panic when response is nil in the index-gw (#5910 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Robert Jacob	c6d95aa83f	operator: Do not include non-static labels in pod selectors (#5907 )	3 years ago
Periklis Tsirakidis	2dc4571fc3	operator: Align PVC storage size requests for all lokistack t-shirt sizes (#5893 )	3 years ago
Dylan Guedes	b3b96568ed	Loki: Flush chunks one at a time (#5894 ) * Flush chunks one at time. - Calls `store.Put` (flushes chunk to the store) for each chunk individually until it doesn't work instead of calling it for all chunks a single time * Refactor chunk flushing into smaller functions. * Rearrange flushing locks. - Updates our locking strategy to release the chunk lock more frequently. This release the lock after closing and marking a chunk as flushed. * Change where we report `chunksFlushedPerReason` metric.	3 years ago
Christian Haudum	435391661f	Update golangci-lint in build image (#5901 ) * Update golangcli-lint in build image to v1.45.2 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Use correct URL to download golangci-lint See installation instructions https://golangci-lint.run/usage/install/#ci-installation Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Update build image version in .drone.jsonnet Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Cyril Tovena	f691e1bcc3	Introduce a more scalable index-gateway API. (#5892 ) * Introduce a more scalable index-gateway API. Because of the storage refactoring (https://github.com/grafana/loki/pull/5833) we can now introduce a better index-gateway API that fits more our index interface. Such as : ```proto rpc GetChunkRef(GetChunkRefRequest) returns (GetChunkRefResponse) {}; rpc LabelNamesForMetricName(LabelNamesForMetricNameRequest) returns (LabelResponse) {}; rpc LabelValuesForMetricName(LabelValuesForMetricNameRequest) returns (LabelResponse) {}; ``` This will avoid sending thousands of index queries to the index-gateway but instead them just a single request. The index caching, parsing and filtering is now happening all on the index-gateway side. Loki queriers will first check if the new API exists before using it, this way update can be done transparently. However the check happens only on startup, so if you want to start using the new API you need to restart queriers after fully rolling out index-gateways. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Attempt to use the new API on every call. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Christian Simon <christian.simon@grafana.com> * Add test for the GRPC fallback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Christian Simon <christian.simon@grafana.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * review feedback Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes the parameters Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Christian Simon <christian.simon@grafana.com>	3 years ago
Dylan Guedes	c7e18f535c	Do not use boltdb-shipper if no ring or address are given. (#5902 )	3 years ago
Christian Simon	a6bec98b20	Raise version of build image correctly (#5900 ) Was using the makefile first. Now read the docs again: https://github.com/grafana/loki/blob/main/docs/sources/maintaining/release-loki-build-image.md	3 years ago
Marcus Teixeira	23ff2e9ddb	docs: fix query_ingester_only config (#5873 ) * docs: fix query_ingester_only config * fix: change msg when query_store_only and query_ingester_only is enabled	3 years ago
Karsten Jeschkies	7c78b26f80	Enable tenant ID selection for multi-tenant queries. (#5821 ) Closes #5820 Co-authored-by: JordanRushing <rushing.jordan@gmail.com>	3 years ago
Christian Simon	9d0fd3a7e3	Upgrade golang version to v1.17.9 (#5899 ) ``` git ls-files '[Dd]ockerfile' \| grep -v ^vendor/ \| xargs sed -i "s/golang:[0-9\\.]*/golang:1.17.9/g" \| ag 'golang:' ```	3 years ago
JordanRushing	1dc0d978e4	Add a Ring to IndexGateway (#5358 ) * Begin to add a Ring to IndexGateway Signed-off-by: Jordan Rushing <jordan.rushing@grafana.com> * Implement missing methods for IndexGateway. - Implement missing methods for the IndexGateway to be used as a BasicLifecyclerDelegate. The methods are stored in a lifecycle file and follow the same approach of the Ruler ring - Make Gateway public and add missing parameters to the IndexGateway's initialization method * Fix failing linter Signed-off-by: Jordan Rushing <jordan.rushing@grafana.com> * Implement IndexGateway support for dynamic configs. - Add memberlist as a dependency of the IndexGateway - Add IndexGateway support for the common configuration section - Modify Loki to register IndexGateway flags. This fixes the default flag values for the IndexGateway - Make IndexGateway configurations public. Without this, we can't use them. * Implement NewBasicService for the IndexGateway. - If IndexGateway is running with a ring, it uses the IdleService. Otherwise, it uses the BasicService - Implement IndexGateway support to handle ring HTTP pages * Test IndexGateway dynamic configuration. * Implement new IndexGatewayGRPCPool entity. * Make IndexGateway attributes public. * Implement IndexGatewayRing reader. - Implement new IndexGatewayRing service - Add IndexGatewayRing as a Store dependency - Modify store to pass IndexGatewayRing as a parameter - Implement IndexGatewayClient ring mode * Implement Ring mode in the IndexGatewayClient. - Moves IndexGateway configuration to the IndexGatewayClient struct within the boltdb-shipper - Reuse the IndexGatewayClient everywhere - Implement IndexGateway gRPC pool * Add new ring index gateway parameter to new Store calls. * Use errors.Wrap instead of fmt.Errorf. * Extract tenantID from context instead of iterating on queries. * Remove indexGateway ring param. - Instead, add it to the store configuration and bubble it down to deeper modules. * Split IndexGateway server from client implementation. * Fix imports order. * Remove ring as parameter from IndexGateway-related funcs. * Fix default flag value and IndexQuerier type. * Remove additional mode field and reuse it from cfg. * Remove redundant service init. * Add sanity check for IndexGateway client constructor. * Move mode assigning to initStore method. * Reorder IndexGateway constructor. * Rewrite indexClient chunk.IndexClient as querier Index.Querier. * Fix flag registration for IndexGateway server. - In a previous PR I changed how it works and forgot to update how the flag registration occurs. * Fix flag registration for test. * Keep only one reference to indexQuerier. * Add guard-clause on IndexGatewayRing service. - Without this, we would be initializing ring-related things even if the index gateway is in simple mode. * Move IndexGatewayClientCfg to gateway_client file. * Update CHANGELOG.md for `IndexGateway` support for `RingMode` Signed-off-by: JordanRushing <rushing.jordan@gmail.com> * Update GatewayClient to use dskit tenant package Signed-off-by: JordanRushing <rushing.jordan@gmail.com> * Add listenport configuration for IndexGateway and Ring Signed-off-by: JordanRushing <rushing.jordan@gmail.com> * Make IndexGateway replication factor configurable. - Add `replication_factor` flag to the IndexGateway config struct - Modify Index Gateway ring config struct to be inline with a new struct, since it doesn't expose a replication factor config - Modify dynamic config wrapper to reuse a common replication factor on the Index Gateway ring * Randomize replication set access. - If we don't randomize access, we'll always access same Index Gateway instances in same order for the same tenant * Remove unwanted merge HEAD tags. * Move away from stores/chunk package. * Pass util_log in factory. * Change index gateway client ring to ignore replicas. - This is accomplished by using `NewIgnoreUnhealthyInstancesReplicationStrategy` - It is already done by the server * Refactor where the common replication factor is applied. * Housekeeping config_wrapper IndexGateway configs. - Remove unnecessary/wrong comments - Only set replication factor at a single place Co-authored-by: Dylan Guedes <djmgguedes@gmail.com>	3 years ago
Mathias Chapelain	e5ed1578c8	loki: Fix common config net interface name overwritten by ring common config (#5888 ) In the case where `instance_interface_names` is declared in the common configuration AND the common ring configuration is also present, `instance_interface_names` from common configuration is overwritten by default ring configuration for all ring components. This commit fix this issue by overwriting common ring net interface config IF it is deeply equal to the default one. Example: ``` common: instance_interface_names: - interface ring: kvstore: store: inmemory ``` Then, ``` Distributor.DistributorRing.InstanceInterfaceNames == defaults.Common.Ring.InstanceInterfaceNames ``` but should be ``` Distributor.DistributorRing.InstanceInterfaceNames == []string{"interface"} ```	3 years ago
kaige0207	bbebc6b2fb	Update _index.md (#5887 ) Modify the command line description of the grpc_server_max_send_msg_size parameter	3 years ago
Nicolas Vanheuverzwijn	f22dbc2190	Update _index.md (#5871 ) The new default for : - `chunk_retain_period` is `0s`, not `30s` - `chunk_idle_period` is `30m`, not `1h` - `chunk_target_size ` is `1572864`, not `1048576` According to https://grafana.com/docs/loki/v2.4/configuration/#ingester_config	3 years ago
Periklis Tsirakidis	8dee5b9503	operator: Update Loki operand to v2.5.0 (#5884 )	3 years ago
Christian Haudum	99c5b35895	Add more function comments to the rangemapper implementation (#5861 ) * Add more function comments to the rangemapper implementation Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Apply suggestions from code review Co-authored-by: Susana Ferreira <susana.ferreira@grafana.com> Co-authored-by: Susana Ferreira <susana.ferreira@grafana.com>	3 years ago
thepheer	81021c920f	remove excessive underscore from `dockerLabelLogStream` (#5890 )	3 years ago
Karsten Jeschkies	45ffebd4d8	Return HTTP 400 when multiple tenants are present in push. (#5800 )	3 years ago
Ed Welch	c6c301ec27	Docs: Improve the new schema docs (#5869 ) * improve the new schema docs Signed-off-by: Edward Welch <edward.welch@grafana.com> * fix capitalization Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Karsten Jeschkies	c9f3868287	Update dskit to v0.0.0-20220331160727-49faf69f72ca. (#5881 )	3 years ago
Sandeep Sukhani	87ed13715a	document flag for disabling broad index queries (#5880 )	3 years ago
Callum Styan	800b7c6345	[promtail] Mark promtail single client config flags and config file block as deprecated (#5842 ) * Mark promtail single client config flags and config file block as deprecated. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update some promtail docs examples that still use `client` instead of `clients`. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix imports. Signed-off-by: Callum Styan <callumstyan@gmail.com> * properly format url as an array item since we changed to clients from client Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Bryan Boreham	e2d7ee2cff	GCS: refactor creation of http client (#5838 ) Separate the function into one part which creates the RoundTripper and one which wraps it in instrumentation.	3 years ago
Alexandre de Verteuil	b08ddc5f93	Minor fix in docs/sources/logql/log_queries.md (#5868 )	3 years ago
dependabot[bot]	1e0c27fbe4	Bump actions/setup-go from 2 to 3 (#5859 ) Bumps [actions/setup-go](https://github.com/actions/setup-go) from 2 to 3. - [Release notes](https://github.com/actions/setup-go/releases) - [Commits](https://github.com/actions/setup-go/compare/v2...v3) --- updated-dependencies: - dependency-name: actions/setup-go dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	3 years ago
Cyril Tovena	dd7200564b	Improve kafka discovery test. (#5860 ) The `Test_TopicDiscovery` expections were wrong, we only need them to be true at some point since this is reconciliation loop. Fixes #5858 Nice catch ! Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Travis Patterson	ab5d490f90	Fix flaky test (#5307 ) - Ensure the registry is stopped before removing directories - Fix possible panic when stopping registry - Fix race conditions in registry state	3 years ago
Ed Welch	4e421206f0	Docs: Add usage reporting section to 2.5 release notes (#5865 )	3 years ago
Ed Welch	a76fe22942	add some docs for working with the storage schema (#5863 ) Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Robin Opletal	8994eca7e5	fix: adopters link for Heureka Group (#5862 )	3 years ago
Cyril Tovena	8c1095a554	Moves TSDB to the stores package. (#5852 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Rastislav Barlik	3e17245743	Fix wrong indentation in example config (#5828 )	3 years ago
Marc Tudurí	0315102c34	promtail: Add ActiveTargets method (#5839 ) * Add ActiveTargets method to promtail * Update CHANGELOG	3 years ago

1 2 3 4 5 ...

3347 Commits (6bdecd6a5035ec1e2f2ae712b89b95a3b1b6a338) All Branches Search

3347 Commits (6bdecd6a5035ec1e2f2ae712b89b95a3b1b6a338)

All Branches