775 Commits (e8d14157256918e623c1ebe232b8db7fb67b9284)

Author	SHA1	Message	Date
Owen Diehl	20515a2402	better per stream rate limits configuration options (#4236) ... * better per stream rate limits configuration options * clean up test config * pr feedback	4 years ago
Jordan Rushing	0f0cb9fc99	Add missing `Inc()` to correctly increment the `dropStage.dropCount` metric on valid dropped log line; update related docs (#4246)	4 years ago
Karen Miller	c97dc1b9eb	Docs: revise max_query_lookback knob definition (#4245)	4 years ago
Karen Miller	825c497b4f	Docs: minor improvements to Loki Canary docs (#4222) ... * Docs: correct path to Promtail configuration file * Docs: minor improvements to Loki Canary docs - reduce size of canary drawing - add a description of what Loki Canary does - update wording of the configuration options - minor grammar improvements throughout the section Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Jordan Rushing	a58aea1bf4	Update limits_config docs to include querier.max_query_lookback flag (#4244)	4 years ago
Karen Miller	11a0d28b61	Docs: first draft, Loki accepts out-of-order writes (#4237) ... * Docs: first draft, Loki accepts out-of-order writes * Update docs/sources/architecture/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Alexandre Vallarino	b0646e7156	fix: typo on loki-external-labels for labels (#4231)	4 years ago
Karsten Jeschkies	29d2394962	Link Kubernetes service discovery configuration. (#4206) ... * Link Kubernetes service discovery configuration. * Use `configuration`.	4 years ago
Callum Styan	1e998899b0	Update tanka installation docs to refer to tanka section about `jb` (#4208) ... installation instead of providing a cli command that may not work. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Benoît Knecht	488a21bff7	pkg/storage/chunk/aws: Add s3.http.ca-file option (#4211) ... * pkg/storage/chunk/aws: Fix insecure-skip-verify documentation The documentation claimed that the `s3.http.insecure-skip-verify` option needed to be set to `false` in order to skip verifying certificates, but it needs to be set to `true`. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> * pkg/storage/chunk/aws: Add s3.http.ca-file option This option lets users set a custom CA file for connections to S3, in case they use a local S3 instance with an internal PKI. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>	4 years ago
Mateusz Gozdek	b3df9f5dfd	cmd/logcli: add --follow flag as an alias for --tail (#4203) ... When using 'logcli query --tail', '--tail' behaves similar to the 'tail' command, which uses '--follow' flag, if you want to continuously follow the appended data to the file. I believe '--follow' flag is more natural for system administrators to use rather than '--tail' if one wants to "follow" the incoming logs, so this commit adds one, as an alias for '--tail'. Closes #3570 Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>	4 years ago
Karsten Jeschkies	e25587bfd7	Document known Docker driver issues. (#4190) ... * Document known Docker driver issues. * Update docs/sources/clients/docker-driver/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/docker-driver/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/docker-driver/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Callum Styan	3ee8ed3b1d	Allow for loki-canary to generate a percentage of out of order log lines (#4126) ... * Allow for loki-canary to generate a percentage of log lines with out of order timestamps, percentage and out of order time range is all configurable. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Switch OoO min/max flags to time duration and properly calculate OoO percentage check. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Change some variable names + add comments to make it more obvious what various parts of the canary code are actually doing. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update pkg/canary/writer/writer.go * Add notes about usage of the out-of-order-percentage flag and the requirement to use pipeline stages. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Karen Miller	368d18c62a	Docs: improve LogQL section (#4145) ... * Docs: improve LogQL section - Add a subsection for examples - Fix typos and wording * Update docs/sources/logql/query_examples.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Update docs/sources/logql/query_examples.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com>	4 years ago
woshicai	345e10128f	update: docs about using azure storage account as storage. (#4152) ... Signed-off-by: charles-woshicai <583605554@qq.com> Co-authored-by: Charles Cai <charles.cai@sap.com>	4 years ago
Owen Diehl	f17b189a3f	Promote/ruler api (#4132) ... * unmark the ruler api as experimental * deprecation notice for experimental prefix * removes vendor changes, adds -ruler.enable-api (without experimental prefix) on our ruler.Config	4 years ago
Owen Diehl	654b543e4e	updates unordered writes config docs (#4131) ... * updates unordered writes config docs * removes experimental flag * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karen Miller	7ee89ed1d9	Docs: correct path to Promtail configuration file (#4175)	4 years ago
Karen Miller	cd79adc8ab	Docs: fluentd client phrasing and formatting (#4147) ... - Adds corrections from closed PR https://github.com/grafana/loki/pull/3880	4 years ago
Karen Miller	a60924792d	Docs: revise section header (out of order writes) (#4134)	4 years ago
Ed Welch	f2eb2eefec	Updating changelog, release notes and references to the previous release version. (#4112)	4 years ago
Owen Diehl	ff59711a02	brief out of order docs (#4125)	4 years ago
Karen Miller	f0d26b4165	Docs: Fix typos and grammar. Inject newlines for readability. (#4113)	4 years ago
Karsten Jeschkies	d36e11d04f	Document operation with the query scheduler. (#4100) ... * Support Cortex Frontend V2. * Format code. * Start query scheduler in Docker compose. * Model query flow in sequence diagram. * Model calls to downstreamer. * Move diagram to docs. * Embed generated SVG. * Descripe calls. * Launch Cortex query scheduler. * Disable sharding for now. * Log which framework is used. * Configure querier to use scheduler. * Remove unwanted docs. * Enable query splitting again. * Document scheduler address. * Document new scheduler options for frontend as well. * Document operation with the query scheduler. * Replace Cortex with Loki image. * Remove unused Corte config. * Correct merger errors. * Clear up confusing sentence. * Update docs/sources/operations/scalability.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Timothy Lister	b3d7740f3d	Update _index.md (#3880) ... Updated fluent-plugin-loki documentation links to point to new location. Original reference docs were moved in this [commit](6e67d1ea5d (diff-04dc5b2136328a0dcb189df97734c7c72e5e1227fa0c03469a6ce608f32f1b66)).	4 years ago
Yashar Nesabian	4369998aea	update boltdb-shipper index period (#4122)	4 years ago
Owen Diehl	92a4e57448	ingester.index-shards config (#4111) ... * consistent shard mapping test & better error msg * ingester.index-shards config * loki fails to start if the ingester & schema factors arent compatible. * lint * docs * update changelog	4 years ago
Karsten Jeschkies	c3aaebe509	Support frontend V2 with query scheduler. (#4071) ... * Support Cortex Frontend V2. * Format code. * Start query scheduler in Docker compose. * Model query flow in sequence diagram. * Model calls to downstreamer. * Move diagram to docs. * Embed generated SVG. * Descripe calls. * Launch Cortex query scheduler. * Disable sharding for now. * Log which framework is used. * Configure querier to use scheduler. * Remove unwanted docs. * Enable query splitting again. * Document scheduler address. * Document new scheduler options for frontend as well. * Remove unused querier option. * Use new query-scheduler module in Loki. * Remove unused option. * Document `max_queriers_per_tenant`.	4 years ago
Karen Miller	f9b0ef33c0	Mark recording rules as an experimental feature. (#4105)	4 years ago
Travis Patterson	8a2081a39e	Distributor: Truncate rather than drop log lines (#4051) ... * Truncate rather than drop logs - When log lines are longer than maxLineSize, truncate them to maxLineSize rather than dropping them Fixes: #3747 * Review feedback: - Rename 'max_line_size_should_truncate' to 'max_line_size_truncate' - Add configurable truncated indicator - Add Truncated Line metric - Changed truncated metrics to have the name mutated_{samples,bytes}_total * Linter * Review Feedback - Make metric variable names match metric names - Add benchmarks - reduce truncation allocs by 100x * Linter * Remove truncation indicator	4 years ago
Jennifer Villa	ab1c38ad99	Update the docs to install Loki with Tanka (#4083) ... * Update to the Loki tanka install docs to reflect changes made in tanka. Also pulled up the docs piece about the bolt-db-shipper-shared-store so users know they must modify it, rather than seeing it as a note further down. I think we're probably still missing one more update to the yaml to add the `schema_config` override, but that can come as a separate pr. * Adding the schema config block. Think we should update here because we otherwise default to gcs, which will throw an error if the user wants to use aws s3. * Updated the value we recommend for 'from' * Update docs/sources/installation/tanka.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Apply suggestions from code review Thank you Karen! Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Tried to get more clarify around how I"m describing the object storage type. * Update docs/sources/installation/tanka.md Typos begone! Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karsten Jeschkies	5a5bcb16e2	Document 0 meaning for retries. (#4096)	4 years ago
Dmitry Tolstoy	d6f2d4a041	Change service names in docker-compose files (#3768) ... Co-authored-by: Dmitry Tolstoy <33700018+A-styler@users.noreply.github.com>	4 years ago
Patrick Huy	968aae4f2a	Doc: Promtail: the label created for the message in the cri stage is called content (#4067)	4 years ago
Karen Miller	808c808714	Clarify prose about querier frontend min-sharding-lookback (#4050) ... * Clarify prose about querier frontend min-sharding-lookback Docs edit of prose from https://github.com/grafana/loki/pull/4047. * Update docs/sources/configuration/_index.md Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com>	4 years ago
Karen Miller	1e85036409	Revise wording of query frontend service configuration (#4052) ... * Revise wording of query frontend service configuration * Add ClusterIP and publishNotReadyAddresses to Kubernetes YAML	4 years ago
Owen Diehl	a8a861b21a	adds query-frontend service hints for k8s, adapted from jsonnet (#4045)	4 years ago
Cyril Tovena	3f3d10afcc	Add min_sharding_lookback limits to the frontends (#4047) ... * Add min_sharding_lookback limits to the frontends Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * improve doc. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Karen Miller	551d68210f	Fix docs typo: IP Matching section "=f" becomes "=" (#4039)	4 years ago
Karen Miller	826fdfa3b9	Docs: add weights to YAML metadata to order the LogQL subsections in the nav panel (#4031)	4 years ago
Bearice Ren	5970ab9b1e	Update _index.md (#4029) ... As mentioned in #3259, permission `s3:ListObjects` is needed, updating the document.	4 years ago
Jack Baldry	e22e666ca4	fix: Restore /config endpoint and correct handlerFunc for buildinfo (#4027) ... As far as I can tell from reading the "next" documentation, the /loki/api/v1/status/buildinfo endpoint should return the build information. The /version endpoint is also listed further down in the documentation but from the code prior to this change, it looks like it should perform the same function as buildinfo endpoint so I have removed it. I've updated the documentation to reflect my changes. Signed-off-by: Jack Baldry <jack.baldry@grafana.com>	4 years ago
Kaviraj	bfb24e6a4c	Ip matcher for LogQL (#3986) ... * IP matcher and filter via netaddr.IP package Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Adding IP filter into label filter gramer 1. ast tests 2. parse tests Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Label filters all test cases passes Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Rename ipFilter -> ipLabelFilter Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * More tests Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove testlogs.txt Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make linter happy Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add more cases to the benchmark Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks 1. support NEQ 2. reduce allocation. 3. Minor tweaks Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make IP filter work as line filter 1. Add necessary interface implementation 2. More tests for parser and ast Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make linter happy Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Bug with filter matcher Its wierd bug. Not handing string() method breaks the parser :( Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Split Line and Label filter to different struct. It got out of hands to handle both in same struct. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add basic doc for IP matcher Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add docs feedback from Karen * Label filter add patter error report * PR remarks 1. Indendation fix 2. Remove string() interface for ip label filte * Linter happy * PR remaks * Fix ip label matcher string() method if pattern is invalid * Fix label filter tests * Have local copy of `pattern` in label filter to use in string() * Rebase conflicts * ast.go fixes	4 years ago
Karen Miller	391984dded	Revise portions of the docs LogQL section (#4012) ... * Revise portions of the docs LogQL section * Update query diagram per review request	4 years ago
Karen Miller	0e519b46e0	Docs: correct fluentbit config value for DqueSync (#4026)	4 years ago
Karen Miller	f811dbfc18	Docs: fix bad links (#4024)	4 years ago
Danny Kopping	ac63ea8500	Promtail: adding pipeline stage inspector (#4011) ... * Adding promtail pipeline stage inspector Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding library Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding docs Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Further appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Removing old version of go-cmp to pass check-mod step Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Making screenshot narrower and correcting link Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Copy changes Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Copy changes Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Sandeep Sukhani	58f9d0c085	add config and documentation about index-gateway (#3956) ... * add config and documentation about index-gateway * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Owen Diehl	7289c064b7	Fixes regexReplaceAll docs (#3998) ... closes #3939	4 years ago
Karen Miller	bc566fbbab	Docs: Revise/update the overview section. (#3980) ... * Docs: Revise/update the overview section. * Update docs/sources/overview/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update docs/sources/overview/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago