apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Cyril Tovena	bbaef790db	Add usage report into Loki. (#5361 ) * Adds leader election process Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fluke Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fixes the kv typecheck * wire up the http client * Hooking into loki services, hit a bug * Add stats variable. * re-vendor dskit and improve to never fail service * Intrument Loki with the package * Add changelog entry Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes compactor test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add configuration documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/usagestats/reporter.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Add boundary check Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add log for success report. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/usagestats/reporter.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com>	4 years ago
Nate Walters	ffc87055b8	Delete docs/sources/copyright directory (#5325 ) Removing copyright notice per https://raintank-corp.slack.com/archives/CH34H23HD/p1643999482151029	4 years ago
Andre Ziviani	699fffe9e5	lambda-promtail: Add ability to ingest logs from S3 (#5065 ) * Add ability to ingest logs from S3 on lambda-promtail * fix ci * fix typo * bump golang and alpine version * update changelog * add s3 permissions on terraform * use for_each instead of count * fix typo * improve function naming * add documentation and an example of a s3 file path * refact logic to identify event type * add missing iam permission to allow lambda to run inside a vpc * fix typo * allow lambda to access only specified s3 buckets * configure a default log retention policy on log group * add missing depends_on to make sure iam role is created before lambda function * update docs * fix label naming convention * fix merge conflict * use new backoff lib and update dependencies * add option to limit batch size * cache s3 client * update docs and terraform * address some feedback on PR * fix typo	4 years ago
Karen Miller	d787a0fe28	Docs: remove "regular" from string definition (#5309 )	4 years ago
Vladyslav Diachenko	f0ef4662fe	Documentation for load testing Loki with xk6-loki (#5182 ) * Add initial page for xk6-loki docs Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * added documentation for xk6-loki query scenario * Add simple installation and usage instructions Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add page about log generation with xk6-loki * Add documentation for k6 write scenario Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup: incorporate feedback from Karen Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fixup: incorporate feedback from Karen Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup: @ppcano's suggestions * fixup: @cyriltovena's suggestions * fixup: make read scenario more generic * Apply suggestions from code review Co-authored-by: Pepe Cano <pepe@loadimpact.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Use correct URL for git clone command Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Pepe Cano <pepe@loadimpact.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com>	4 years ago
Susana Ferreira	82fac990a1	Update promtail to support duration string formats (#5290 ) * Update promtail to support duration string formats * Address comments	4 years ago
Travis Patterson	89b04a97b3	storage: update azure blobstore client to use new sdk (#5302 ) * Update azure blobstore client to use new sdk * changelog * fix hardcoded maxretries * linter * more linting * Fix flaky test	4 years ago
Sashank Agarwal	c88734b72c	Link `replace` pipeline stage to doc (#5200 )	4 years ago
Owen Diehl	96ff7f900b	Revert "Adding a docs page that helps users understand memberlist a bit more (#5186 )" (#5286 ) This reverts commit `7e372cbc56`.	4 years ago
Christian Haudum	57b384df8f	Auto-expire old items from FIFO cache (#5148 ) * Remove validity from FIFO cache We can remove the validity setting of 1h in 2.4 for the chunks cache because it doesn't reduce memory usage and instead leads to valid chunks being ignore when querying the cache. Chunks are immutable so it doesn't make sense to not return them if they are present in the cache. Closes #4922 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add periodic task to prune old FIFO cache elements As described in #4921 this PR adds a periodic task that prunes expired items from the FIFO cache to free up memory. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Jennifer Villa	7e372cbc56	Adding a docs page that helps users understand memberlist a bit more (#5186 ) * Added some new docs on memberlist. * Added a page with more memberlist info.	4 years ago
Dan Poltawski	379ca6b409	Promtail docs: Fix link to `unpack` LogQL documentation (#5274 )	4 years ago
Ed Welch	09a5a2cee3	Logstash: Add config option which allows seting up an allowlist for labels to be mapped to Loki (#5244 ) * add a config called `include_fields` which lets you allowlist a specific set of fields which will be mapped to labels and sent to Loki. Signed-off-by: Edward Welch <edward.welch@grafana.com> * update docs Signed-off-by: Edward Welch <edward.welch@grafana.com> * restore path for Dockerfile so it works in CI Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Owen Diehl	91d837e79c	Refactor/remove global splitby (#5243 ) * cleans up internal limits struct, removes unnecessary logic * moves querier.split-queries-by-interval to limits, simplifies resulting code. * docs, changelog * flag supports model.duration instead of time.duration * lint and adds new error for deprecated field * reregisters queryrange flags * comment lint * ensures we validate queryrange config and simplifies embedded struct validate() * 0 still disables * simplify cache key generation and protect against divide by zero	4 years ago
Dylan Guedes	3d135e5338	Copy `cortex/pkg/configs` package dependency into Loki (#5139 ) * Fork cortex `configs` into Loki. * Use new forked `configs` package. * Remove duplicated import. * Fix lint issues. * Use new forked util/logger. * Drop support for promql rules v1. - This allow us to remove the `legacy_promql` implementation - If a rulesconfig is received in v1 format, we output a specific error, so we can differentiate between a unknown version and a v1 one. * Modify tests to expect error for legacy rules format. * Add changelog and upgrading guide. - Added them as we dropped support for legacy promql rules configuration which might be a breaking change for some environments. * Update vendor/modules after rebasing.	4 years ago
Florian Klink	ca2132d7cb	Update _index.md (#5241 ) We also fixes typo.	4 years ago
Nabeel Saad	d0c6e3d016	Update _index.md (#5159 ) Adding default value for line_format so customers know which is picked up if the option is not provided.	4 years ago
Karsten Jeschkies	4716eea0db	Provide Docker target and discovery in Promtail. (#4911 ) What this PR does / why we need it: This patch adds support to fetch Docker container logs through the Docker daemon API. This should be more robust than the Loki Docker driver or scraping the logs files. The new Docker target will also collect meta information of the scraped containers. Which issue(s) this PR fixes: Addresses #2361 Closes #4703 Special notes for your reviewer: Checklist - [x] Documentation added - [x] Tests updated - [x] Add an entry in the `CHANGELOG.md` about the changes.	4 years ago
Christian Haudum	2e6e050453	Improve docs on how to install logcli from source (#5126 ) * Improve docs on how to install logcli from source Closes #5108 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Improve docs on how to install logcli from source Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
aengusrooneygrafana	c9d49cea6f	Update to Unofficial clients for JS (#5180 ) Came across these packages for JS with help from Danny - I thought they would be useful to include in our docs for posterity. CC @dannykopping for info!	4 years ago
Trevor Whitney	99e046c42f	Default max_outstanding_per_tenant to 2048 (#5204 ) * Default max_outstanding_per_tenant to 2048 * Update changelog	4 years ago
Kaviraj Kanagaraj	0913ea5bf3	Update Loki Team members in the Governance doc. (#5219 ) Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Friterad Knäskål	4de90321fd	Update docker.md (#5213 ) Create the containers in detached mode and name the promtail container "promtail". Without this fix the first container must be stopped before the second one is started since they are running in foreground. The promtail container didn't have any "--name" flag so docker assigns a random name to it.	4 years ago
Arve Knudsen	a2dd731586	Chore: Add pkg/util/log package (#5187 ) * Chore: Add pkg/util/log package Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Add changelog entry Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Fix documentation of loki_log_messages_total Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 years ago
Sas Swart	205ad61b8c	Docs: Update memory ballast documentation (#5106 ) * Add memory ballast * Add changelog entry * Add documentation Add additional information to Flag description * Ensure that ballast_bytes can be configured from config file Add documentation * Add Operational scalability documentation related to memory ballast * Restore config.ballast-bytes cli flag * Move config.ballast-bytes cli flag declaration * Update memory ballast documentation as per https://github.com/grafana/loki/pull/5081\#pullrequestreview-848460132 Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Kaviraj	e5c514359b	Fix broken `template_variable` doc link (#4960 )	4 years ago
Karsten Jeschkies	5f07e95fc8	Document query limit parameter default. (#5133 )	4 years ago
Ed Welch	34a4b242bf	Update to 2.4.2 release (#5121 ) * update project to 2.4.2 release Signed-off-by: Edward Welch <edward.welch@grafana.com> * go.mod cleanup Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Karen Miller	234f18a747	Docs: Draft 2.4.2 release notes (#5105 ) * Docs: Draft 2.4.2 release notes * Docs: revise release note item for PR 4968 * Update docs/sources/release-notes/v2-4.md Co-authored-by: Susana Ferreira <ssncferreira@gmail.com> * add PR link Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: Susana Ferreira <ssncferreira@gmail.com> Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Andre Ziviani	40f56c6291	Docs: Fix documentation with correct default values and add missing options (#4792 ) * update docs with correct default values and add missing options Signed-off-by: Andre Ziviani <andrepziviani@gmail.com> * fix typo Signed-off-by: Andre Ziviani <andrepziviani@gmail.com> * fix typo Signed-off-by: Andre Ziviani <andrepziviani@gmail.com> * add another missing option Signed-off-by: Andre Ziviani <andrepziviani@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * rephrase querier_forget_delay option * remove duplicated option * rephrase max_streams_per_user option * fix typo * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * fix wrong values * standardize boolean naming Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Cyril Tovena	fc49a87d99	Fixes HTTP2 removal for GCS (#5103 ) * Fixes metric name for hedging object store requests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Only allow to disable http2 for GETs Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes http2 removal Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Address review feedback Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Address review feedback Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Trevor Whitney	4b41a3aab4	update helm docs, add simple scalable (#4925 ) * update helm docs, add simple scalable * Update docs/sources/installation/simple-scalable-helm.md Co-authored-by: Dylan Guedes <djmgguedes@gmail.com> * close code snippet * add doc changes from karen Co-authored-by: Dylan Guedes <djmgguedes@gmail.com>	4 years ago
Trevor Whitney	3091ccd3eb	improve default config values (#5077 ) * improve default config values * change defaults for upstream query range package * update changelog * remove max_tranfer_retries fix as it is covered in another PR, 4792 * increase query ingesters within by 1h This provides an additional buffer on top of the max_chunk_age. Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * add comment reminder to remove query range config hack Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * rollback change to align_queries_with_step and parallelise_shardable_queries * add upgrading docs * re-enable parallelise_shardable_queries by default * add parallelise_shardable_queries back to upgrading doc Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Owen Diehl	e823a5037f	better defaults for flush queue parallelism (#5091 ) * better defaults for flush queue length * changelog	4 years ago
Cyril Tovena	21e61315df	LogQL: add __line__ function to \| line_format template (#4879 ) * LogQL: add __line__ function to \| line_format template Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add changelog entry Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/logql/template_functions.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Clone the function map to avoid a race between multiple expr Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Sas Swart	79c337e234	Add the option to configure memory ballast for Loki (#5081 ) * Add memory ballast * Add changelog entry * Add documentation Add additional information to Flag description * Ensure that ballast_bytes can be configured from config file Add documentation * Add Operational scalability documentation related to memory ballast * Restore config.ballast-bytes cli flag * Move config.ballast-bytes cli flag declaration Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Karen Miller	625d19cddb	Docs: Revise hedging configuration block descriptions (#5069 ) * Docs: Revise hedging configuration block descriptions * Docs: revise 99th percential description per review	4 years ago
Trevor Whitney	46cc256702	expand ruler ring section to add num_tokens property (#4899 ) * expand ruler ring section to add num_tokens property * fix num-tokens prefix * fix wording in common ring section around heartbeat_timeout * rebase on main	4 years ago
Susana Ferreira	191a8a6f9d	Store metrics queueTime in seconds (#5052 ) * Store metrics queueTime in seconds * Address comments * Helper function to convert seconds to nanoseconds	4 years ago
Karen Miller	c03614efe5	Docs: add an empty subsection for v2.4.2 bug fix items (#5056 )	4 years ago
Dylan Guedes	c0bec07e0d	Loki: Implement common net interface/instance addr (#4950 ) * Implement common net interface/instance addr. - Implement two new common configurations: instance_interface_names, which is a list of net interfaces used to discover addresses and instance_addr, used to advertise a component address. * Add docs to new common configurations. * Fix lint issue: missing line. * Add missing CHANGELOG entry. * Change default common net interface from `127.0.0.1` to `""`. * Add missing `InstanceAddr` docstring.	4 years ago
Kevin	5030a1f463	Promtail: exclude_user_data description fix (#5038 ) Based on https://github.com/grafana/loki/blob/main/clients/pkg/promtail/scrapeconfig/scrapeconfig.go#L224 the option to exclude user data of windows evens is misspelled in the documentation. This puts the correct exclude_user_data option in the documentation.	4 years ago
Siavash Safi	cd9d9c9b42	Support Redis Cluster Configuration Endpoint (#4947 ) The go-redis options requires multiple redis addresses for a cluster. In some scenarios like AWS ElastiCache, a single configuration endpoint is used to resolve all cluster nodes. This change adds an extra step to resolve all nodes and pass them to go-redis. It remove the need to specify multiple cluster nodes in the configuration. No tests were added for this scenario since it requires patching the Go resolver during runtime. Signed-off-by: Siavash Safi <siavash.safi@gmail.com>	4 years ago
Susana Ferreira	82f8f3c1e5	Log time in queue per request (#4949 ) * Log time in queue per request * Add querierID to log message * Add unescape request url and tenant_ids to log message * Add query enqueue time to metrics.go * Remove "querier request dequeued" log from scheduler * Address comments * Rename enqueue_time to queue_time * Store queue time in nanoseconds (int64) * Use CanonicalMIMEHeaderKey for setting the httpgrpc header	4 years ago
Karen Miller	9a49ab78fe	Docs: revise block names (ring and filesystem) and correct spelling (#5015 ) * Docs: revise block names (ring and filesystem) and correct spelling * Docs: scheduler_ring and compactor_ring point to ring config Change made per review comment.	4 years ago
Karen Miller	94d1550e9c	Docs: improve Promtail installation prose (#5017 )	4 years ago
Cyril Tovena	03be8dac1e	Allow to disable http2 for GCS. (#4942 ) * Allow to disable http2 for GCS. This also tweaks our iddle connection pooling accross the board and reduce the insane parallelism when fetching chunks. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * update changelog Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/storage/chunk/gcp/gcs_object_client.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> * update comment Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update CHANGELOG.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Reduce MaxIdleConns to a more standard value. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Allow to configure max parallelism for fetching chunks Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes tests with no default config Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Dylan Guedes	98ecfefd89	Add distributor ring page (#4938 ) * Implement new IngestionRateStrat Enum. - This new IngestionRateStrat is used internally to represent the chosen ingestion rate strategy, to avoid using plain strings. * Add a ring to the distributor. As of now, the distributor only has a pointer to its lifecycler. Since the ring HTTP handler isn't implemented for the lifecycler but it is for the ruler, this extends the distributor by also holding a ring instance. * Implement /distributor/ring page. * Reuse existing global strat const. * Add distributor ring HTTP page tests. * Add missing CHANGELOG entry. * Document missing ring status pages. * Fork Cortex util/http.go into source code.	4 years ago
Shardul Srivastava	d8305ecd0a	Add doc for limit param max_concurrent_tail_requests (#5011 )	4 years ago
Susana Ferreira	2fdd24038b	Move querier.split-queries-by-interval to a per-tenant configuration (#5023 )	4 years ago

1 2 3 4 5 ...

838 Commits (21fa187fa80ee6a1325b76251153928f696bfd08)