apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Marcus Teixeira	23ff2e9ddb	docs: fix query_ingester_only config (#5873 ) * docs: fix query_ingester_only config * fix: change msg when query_store_only and query_ingester_only is enabled	3 years ago
kaige0207	bbebc6b2fb	Update _index.md (#5887 ) Modify the command line description of the grpc_server_max_send_msg_size parameter	3 years ago
Sandeep Sukhani	87ed13715a	document flag for disabling broad index queries (#5880 )	3 years ago
Tat Chiu Leung	e65f26d30f	storage: make Azure blobID chunk delimiter configurable (#5777 ) * Make Azure chunk delimiter configurable * Changelog: #5777 * doc update	3 years ago
Ed Welch	e15a03b5e5	Loki: Add more details about usage reporting to the docs and default config files. (#5767 ) * Add more details to usage reporting including putting it in our default config files Signed-off-by: Ed Welch <edward.welch@grafana.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * update verbiage Signed-off-by: Ed Welch <edward.welch@grafana.com> * add newlines Signed-off-by: Ed Welch <edward.welch@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Ed Welch	b136d0dab3	Increase flush_op_timeout to 10m, 10s is often much too short for a big WAL replay which can generate a lot of chunks very quickly. (#5768 ) Signed-off-by: Ed Welch <edward.welch@grafana.com>	3 years ago
Cyril Tovena	95fefa6096	Align usage report config with Grafana (#5406 ) * Align usage report config with Grafana Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fixes tests * Update pkg/usagestats/reporter.go Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Karsten Jeschkies	ae39676cce	Stub multi tenant querier. (#5490 ) What this PR does / why we need it: - Introduce Queries interface and Querier API. - Configure a multi-tenant querier that just passes requests through. Which issue(s) this PR fixes: Closes #231 Special notes for your reviewer: Checklist - [x] Documentation added - [ ] Tests updated - [ ] Add an entry in the `CHANGELOG.md` about the changes.	3 years ago
RangerCD	daacfd0b70	Fix two remote_timeout configs in ingester_client block (#5418 ) * Fix two remote_timeout configs in ingester_client block * Add default value of remote_timeout in document	3 years ago
Benoît Knecht	776e229e94	pkg/ruler/base: Add external_labels option (#5450 ) This option can be used to add a set of labels to all alerts emitted by the ruler. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>	3 years ago
Ed Welch	4ca1fd0adb	set match_max_concurrent true by default (#5435 ) * set match_max_concurrent true by default Signed-off-by: Edward Welch <edward.welch@grafana.com> * add note to upgrade guide, fix up some of the existing notes Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Michel Hollands	d8ed87d04c	Update dskit version (#5392 ) * Update dskit version Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * update changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add debug printing to see interfaces in CI. This will be reverted Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add comment to remember to remove Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use netutil.PrivateNetworkInterfacesWithFallback for the other rings Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Move import to place indicated by linter Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove debug printing Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Determine local interfaces in tests Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rearrange import to satify linter Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update build image in CircleCI Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Change changelegog message to show customer visible changes Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add doc tag and use private network interfaces in common config Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add comment about filtered out non private IP addresses Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update the documentation of the interface names settings Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Cyril Tovena	bbaef790db	Add usage report into Loki. (#5361 ) * Adds leader election process Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fluke Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fixes the kv typecheck * wire up the http client * Hooking into loki services, hit a bug * Add stats variable. * re-vendor dskit and improve to never fail service * Intrument Loki with the package * Add changelog entry Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes compactor test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add configuration documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/usagestats/reporter.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Add boundary check Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add log for success report. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/usagestats/reporter.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com>	3 years ago
Karen Miller	d787a0fe28	Docs: remove "regular" from string definition (#5309 )	3 years ago
Christian Haudum	57b384df8f	Auto-expire old items from FIFO cache (#5148 ) * Remove validity from FIFO cache We can remove the validity setting of 1h in 2.4 for the chunks cache because it doesn't reduce memory usage and instead leads to valid chunks being ignore when querying the cache. Chunks are immutable so it doesn't make sense to not return them if they are present in the cache. Closes #4922 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add periodic task to prune old FIFO cache elements As described in #4921 this PR adds a periodic task that prunes expired items from the FIFO cache to free up memory. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Owen Diehl	91d837e79c	Refactor/remove global splitby (#5243 ) * cleans up internal limits struct, removes unnecessary logic * moves querier.split-queries-by-interval to limits, simplifies resulting code. * docs, changelog * flag supports model.duration instead of time.duration * lint and adds new error for deprecated field * reregisters queryrange flags * comment lint * ensures we validate queryrange config and simplifies embedded struct validate() * 0 still disables * simplify cache key generation and protect against divide by zero	3 years ago
Trevor Whitney	99e046c42f	Default max_outstanding_per_tenant to 2048 (#5204 ) * Default max_outstanding_per_tenant to 2048 * Update changelog	3 years ago
Sas Swart	205ad61b8c	Docs: Update memory ballast documentation (#5106 ) * Add memory ballast * Add changelog entry * Add documentation Add additional information to Flag description * Ensure that ballast_bytes can be configured from config file Add documentation * Add Operational scalability documentation related to memory ballast * Restore config.ballast-bytes cli flag * Move config.ballast-bytes cli flag declaration * Update memory ballast documentation as per https://github.com/grafana/loki/pull/5081\#pullrequestreview-848460132 Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Andre Ziviani	40f56c6291	Docs: Fix documentation with correct default values and add missing options (#4792 ) * update docs with correct default values and add missing options Signed-off-by: Andre Ziviani <andrepziviani@gmail.com> * fix typo Signed-off-by: Andre Ziviani <andrepziviani@gmail.com> * fix typo Signed-off-by: Andre Ziviani <andrepziviani@gmail.com> * add another missing option Signed-off-by: Andre Ziviani <andrepziviani@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * rephrase querier_forget_delay option * remove duplicated option * rephrase max_streams_per_user option * fix typo * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * fix wrong values * standardize boolean naming Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Cyril Tovena	fc49a87d99	Fixes HTTP2 removal for GCS (#5103 ) * Fixes metric name for hedging object store requests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Only allow to disable http2 for GETs Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes http2 removal Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Address review feedback Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Address review feedback Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Trevor Whitney	3091ccd3eb	improve default config values (#5077 ) * improve default config values * change defaults for upstream query range package * update changelog * remove max_tranfer_retries fix as it is covered in another PR, 4792 * increase query ingesters within by 1h This provides an additional buffer on top of the max_chunk_age. Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * add comment reminder to remove query range config hack Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * rollback change to align_queries_with_step and parallelise_shardable_queries * add upgrading docs * re-enable parallelise_shardable_queries by default * add parallelise_shardable_queries back to upgrading doc Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Owen Diehl	e823a5037f	better defaults for flush queue parallelism (#5091 ) * better defaults for flush queue length * changelog	3 years ago
Sas Swart	79c337e234	Add the option to configure memory ballast for Loki (#5081 ) * Add memory ballast * Add changelog entry * Add documentation Add additional information to Flag description * Ensure that ballast_bytes can be configured from config file Add documentation * Add Operational scalability documentation related to memory ballast * Restore config.ballast-bytes cli flag * Move config.ballast-bytes cli flag declaration Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Karen Miller	625d19cddb	Docs: Revise hedging configuration block descriptions (#5069 ) * Docs: Revise hedging configuration block descriptions * Docs: revise 99th percential description per review	3 years ago
Trevor Whitney	46cc256702	expand ruler ring section to add num_tokens property (#4899 ) * expand ruler ring section to add num_tokens property * fix num-tokens prefix * fix wording in common ring section around heartbeat_timeout * rebase on main	3 years ago
Dylan Guedes	c0bec07e0d	Loki: Implement common net interface/instance addr (#4950 ) * Implement common net interface/instance addr. - Implement two new common configurations: instance_interface_names, which is a list of net interfaces used to discover addresses and instance_addr, used to advertise a component address. * Add docs to new common configurations. * Fix lint issue: missing line. * Add missing CHANGELOG entry. * Change default common net interface from `127.0.0.1` to `""`. * Add missing `InstanceAddr` docstring.	3 years ago
Siavash Safi	cd9d9c9b42	Support Redis Cluster Configuration Endpoint (#4947 ) The go-redis options requires multiple redis addresses for a cluster. In some scenarios like AWS ElastiCache, a single configuration endpoint is used to resolve all cluster nodes. This change adds an extra step to resolve all nodes and pass them to go-redis. It remove the need to specify multiple cluster nodes in the configuration. No tests were added for this scenario since it requires patching the Go resolver during runtime. Signed-off-by: Siavash Safi <siavash.safi@gmail.com>	3 years ago
Karen Miller	9a49ab78fe	Docs: revise block names (ring and filesystem) and correct spelling (#5015 ) * Docs: revise block names (ring and filesystem) and correct spelling * Docs: scheduler_ring and compactor_ring point to ring config Change made per review comment.	3 years ago
Cyril Tovena	03be8dac1e	Allow to disable http2 for GCS. (#4942 ) * Allow to disable http2 for GCS. This also tweaks our iddle connection pooling accross the board and reduce the insane parallelism when fetching chunks. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * update changelog Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/storage/chunk/gcp/gcs_object_client.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> * update comment Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update CHANGELOG.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Reduce MaxIdleConns to a more standard value. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Allow to configure max parallelism for fetching chunks Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes tests with no default config Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Shardul Srivastava	d8305ecd0a	Add doc for limit param max_concurrent_tail_requests (#5011 )	3 years ago
Susana Ferreira	2fdd24038b	Move querier.split-queries-by-interval to a per-tenant configuration (#5023 )	3 years ago
Joe Stevens	b5d5123e0b	Docs: Fix parent of wal and wal_cleaner in loki ruler config docs (#4993 ) * fix parent of wal and wal_cleaner in loki ruler config docs * update changelog	3 years ago
Dylan Guedes	2ef5e6faf9	Move `min_sharding_lookback` to the right place. (#5007 ) - This configuration is actually inside the limits section - We shouldn't change the CLI flag to something different to not break existing deployments	3 years ago
Sandy Chen	fc2bc69eaa	feat(): add ManagedIdentity in Azure Blob Storage (#4858 ) * feat(): add ManagedIdentity in Azure * fix(): fix merge error * fix(): fix a problem during conflict resolving * fix(): fix the problems based on reviews * feat(): add deps * Update pkg/storage/chunk/azure/blob_storage_client.go * chore(): adjust mi logics Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Christian Haudum	b3e8b05431	Document correct filesystem config options in reference (#4928 ) Closes #4915 Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Haudum	feb5d711c7	Add `-list-targets` command line flag (#4920 ) * Add -list-targets flag to list available targets Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Mark user-invisible modules as such so they are not shown as run targets when listing available targets using the `-list-targets` flag. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Mention command line flag in configuration docs Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add changelog entry Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Add -list-targets flag to list available targets Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Cyril Tovena	c33a651645	Add rate limiting and metrics to hedging (#4860 ) * Add rate limiting and metrics to hedging Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add changelog entry Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Allow to pass a custom registerer Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	b27894fbf4	Adds the ability to hedge storage requests. (#4826 ) * Adds the ability to hedge request for all backends Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove race from tests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove the race Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove the race Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Testing Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * More testing Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Setup credentials to avoid auth Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * improve tests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * changelog Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Group the configuration Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
李国忠	09f5a90710	[doc] wal: fix default value (#4810 )	4 years ago
Karen Miller	2a6ddffb49	Docs: Modify label names of configuration blocks (#4787 ) * Docs: Add label names of configuration blocks * Docs: Match configuration block name with docs subsection name	4 years ago
Karen Miller	f05cecf194	Docs: inject newlines into knob descriptions to avoid horizontal scroll bar (#4733 )	4 years ago
Owen Diehl	e52e805144	Adds replication_factor doc to common config (#4683 ) Oops, looks like we missed adding this to the configuration docs.	4 years ago
Ed Welch	3fef08ca1a	2.4 release notes, changelog, upgrade guide (#4658 ) * update changelog, release notes, and upgrade guide for 2.4 * tweak release notes a little * make path relative for kafka config * update upgrade guide * more docs fix the cache size not applied to results cache. * fix prefix name in ring_config	4 years ago
Dylan Guedes	90c4821dd3	Docs: Document the common ring section (#4664 ) * Document the common ring section. - Create a new <ring_config> section that document the pkg/util/ring_config.go - Rewrite ruler and scheduler_ring docs to make usage of <ring_config> section - Document new ring under common section * Update docs/sources/configuration/_index.md Co-authored-by: Ed Welch <ed@oqqer.com>	4 years ago
Danny Kopping	5b30589acf	Documenting recording rules per-tenant WAL (#4566 ) * WIP Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Document ruler config options Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Self-review updates Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Clarifying WAL benefit in response to review Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding dashboard link Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Update docs/sources/configuration/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Ensuring ruler and ingester default WAL paths do not conflict Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Trevor Whitney	62ee399e48	default ingester final sleep to 0 unless otherwise specified (#4608 ) * default ingester final sleep to 0 unless otherwise specified * add changelog and upgrading * update config docs	4 years ago
Ed Welch	0c9beadaaa	Loki: Add a ring to the compactor used to control concurrency when not running standalone (#4574 ) * add a ring to the compactor * wiring up the start/stop functionality * add some monitoring for multiple compactors running at the same time. * Add compactor to `read` target * fix tests/validation requirements * Update pkg/storage/stores/shipper/compactor/compactor_ring.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update pkg/storage/stores/shipper/compactor/compactor_ring.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update pkg/storage/stores/shipper/compactor/compactor_ring.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * used a shared ring_config between scheduler and compactor to avoid some duplication * fix lint * better handling of the tokens file with a way to easily tell all the rings to persist tokens * fix query scheduler replication factor * removing "scheduler" from log line which may be called by components other than a scheduler in the future. * update changelog Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Owen Diehl	45113cb375	Enable unordered_writes by default (#4594 ) * enable unordered_writes by default * removes out_of_orders from transfer test * update changelog	4 years ago
Dylan Guedes	331fa6d7b0	Docs: Add virtual targets docs (#4565 ) * Add CHANGELOG entry and updated modes diagram. * Update documentation with the new hybrid mode. - Update targets with new 'read' and 'write' options - Add new docker-compose yaml that exemplifies how to use new 'read' and 'write' targets * Add missing targets to configuration docs. - Missing ones: index-gateway, ingester-querier, query-scheduler	4 years ago
李国忠	6fcd02bad4	[querier] s3: add getObject retry (#4453 ) * [querier] s3: add getObject retry * [querier] s3: add getObject retry * [querier] s3: add getObject retry #4452 * [querier] s3: add getObject retry * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago

1 2 3

114 Commits (23ff2e9ddbcb562a1441764847e14ed55257330d)