3256 Commits (46956d0bf6367aa320de22eb42345b3edb0166ac)

 

All Branches   

Search

Author	SHA1	Message	Date
Karsten Jeschkies	46956d0bf6	Use dskit/tenant intead of loki/pkg/tenant. (#5724)	3 years ago
Michel Hollands	9d62f051b8	Update fluent-bit output name (#5711) ... * Update fluent-bit output name Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Empty commit * Another empty commit	3 years ago
Subomi Oluwalana	732b4ab539	Fixed Getting started docs error (#5504) ... * Simple docs error The docs read "... are what send the logs that Loki generate to Loki" instead of "... are what send the logs that promtail generate to Loki" * Capitalise spelling of Promtail	3 years ago
Karen Miller	34433343e8	Docs: add an empty v2.5 release notes section (#5533)	3 years ago
Paul Ryan	4e3f3b7f7e	Promtail: Fix retry/stop when erroring for out of cloudflare retention range (e.g. over 168 hours old) (#5698) ... * fix: 5696 don't retry when out of range for cloudflare	3 years ago
Alex Tomic	3bf2efa371	logcli: Remove port from TLS server name when provided in --addr (#5477) ... If connecting to a TLS secured endpoint with an explicit port, ensure that ServerName contains only the host and not the port to avoid a cert validation failure	3 years ago
Susana Ferreira	d4dd4eda4a	Update docker repo to grafana/loki-query-tee (#5716) ... * Update docker repo to grafana/loki-querytee * Sign drone.yml file * Update makefile - update target to generate query-tee image with correct name - update error message on drone target * Update Makefile drone target error message Co-authored-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Christian Haudum	6d7422aabf	Assert that push values tuples consist of string values (#5685) ... * Assert that push values tuples consist of string values This fixes a bug in the parsing of push requests that could allowed users sending non-string "log lines" from clients, such as full JSON objects. The values were interpreted as strings, even though they weren't, leading to unexpected log line transformation because the request did not fail. Fixes #5645 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add changelog entry Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Christian Haudum	5ecbbbe5f5	Mark GELF support in Promtail as experimental (#5697) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Haudum	95bf7592e0	Build querytee image as part of CI pipeline (#5700) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Haudum	1a7b170cdb	Update Fluent Bit docs (#5402) ... * Change links to fluentbit.io website The documentation for the Fluent Bit Loki output plugin references the fluentbit.io website multiple times. However, the structure of this website seems to have changed. This commit updates the links to the correct URLs (if possible). Additionally, renamed occurences of "fluentbit" to "Fluent Bit", which seems to be the correct spelling of the product according to their website. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Remove trailing commas from JSON code blocks Trailing commands are syntactically not allowed in JSON. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Sashank Agarwal	b3a2cec7c0	operator: Fix immediate reset of degraded condition (#5691)	3 years ago
Nicolas Vanheuverzwijn	0950034890	Update retention.md (#5706) ... Retention policy actually accept suffix such as `d` and `w` but Go's time.ParseDuration does not. See a2dd731586/pkg/storage/chunk/table_manager.go (L93)	3 years ago
Franz Wong	d67306b657	Promtail: Rename config name limit_config to limits_config (#5707) ... * Rename promtail config name 'limit_config' to 'limits_config' * Add changelog entry * Fix formatting	3 years ago
Robert Jacob	908692794d	operator: Update operator-sdk to 1.18.1 (#5704)	3 years ago
Periklis Tsirakidis	20068ca36c	operator: Replace frontend_worker parallelism with match_max_concurrent (#5693)	3 years ago
Gerard Vanloo	ae4c3b1afc	operator: Fix multiple storage support for boltdb_shipper and schema (#5699)	3 years ago
Susana Ferreira	1d1461824d	Move promtail StreamLagLabels config to upper level config.Config (#5686) ... * Move promtail StreamLagLabels config to upper level config.Config * Fix promtail config load test * Fix promtail configuration reference * Add options promtail config section * Kick GitHub CI Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Sashank Agarwal	dec695f112	operator: make replicationFactor optional (#5701)	3 years ago
Callum Styan	2ebbecfcbd	Require unique client configs when there are multiple clients. (#5688) ... * Require unique client configs when there are multiple clients. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fixing linter error Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Robert Jacob	cb757a4a3a	operator: Update to Go 1.17 (#5695) ... * Update Go 1.17 * Migrations for Go 1.17 * Update bingo and add missing sum files * Update mention in doc * Update changelog * Update Go in workflows	3 years ago
Sashank Agarwal	cb9960d598	operator: Document how to connect to LokiStack gateway component (#5615)	3 years ago
Robert Jacob	4f2f0886d7	operator: Update Loki operand to 2.4.2 (#5655)	3 years ago
Callum Styan	2c2578e84c	Fix bug with new promtail stream lag metric where labels might not be (#5675) ... applied if they don't exist on the source stream Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Salva Corts	0c5900e407	Fix debug image by updating Delve version (#5673)	3 years ago
Karsten Jeschkies	705baa39f4	Speed up re-labelling in multi-tenant queries. (#5663)	3 years ago
Mikael Schirén	f3a86ded23	Add Digitalist as adopter (#5596)	3 years ago
Peter Olivo	0a49d21d40	Fix broken Fluentbit / Fluentd plugin doc links (#5664)	3 years ago
Gerard Vanloo	8154f3f2b4	operator: Update developer addons (#5599)	3 years ago
Gerard Vanloo	27479484f8	operator: Adding instructions to respond to alerts (#5579)	3 years ago
Owen Diehl	3f28a33d93	TSDB Index reuses slices, adds pools (#5630) ... * adds a pool for ChunkMetas * index takes slice pointers for allocation reasons and adds pools for all index types * reuse slices in tsdb benchmarks * adds count to bench script * properly returns series to pool * more ergonomic index signatures while still supporting slice reuse * tsdb index documentation * aligns tsdb-map tooling with new index signatures	3 years ago
Owen Diehl	d084dc7f4b	Tsdb/hash order (#5631) ... * encode fingerprint into series in tsdb * uses series fingerprint in index reads * order tsdb series by fprint * tsdb writes fingerprint offsets table * shardannotation is part of tsdb/index, fixes testware * loads fingerprint offsets from tsdb * removes unnecessary sortedpostings * adds prefix sharding logic * sharded tsdb postings * updates benchmark to pass nil hash * runs tsdb benches with variable count	3 years ago
Karsten Jeschkies	3d5a3936d1	Support limits in multi-tenant queries. (#5626) ... **What this PR does / why we need it**: This changes adds support for the the following limits in multi-tenant queries: - `MaxQuerySeries` - `QuerySplitDuration` - `MaxEntriesLimitPerQuery` - `MinShardingLookback` - `MaxQueryLength` - `MaxQueryParallelism` - `MaxQueriersPerUser` - `MaxCacheFreshness` It always uses the more restricted limit. That means the smallest `MaxQuerySeries` but biggest `QuerySplitDuration`. The split duration is special. Zero means disabled. Also, the global default resolver is the multi tenant resolver when multi-tenant queries are enabled. This will result HTTP 400 errors in case the user sends multiple tenants to endpoints that do not support it. **Which issue(s) this PR fixes**: **Special notes for your reviewer**: **Checklist** - [ ] Documentation added - [x] Tests updated - [x] Add an entry in the `CHANGELOG.md` about the changes. Co-authored-by: JordanRushing <rushing.jordan@gmail.com>	3 years ago
Salva Corts	1f2b450f2d	Add inflight requests metric to scheduler (#5658)	3 years ago
Sashank Agarwal	5105552e79	operator: Update CSV to point to candidate channel and use openshift-operators-redhat ns (#5640)	3 years ago
Sashank Agarwal	5e5067ef40	operator: Document how to connect to distributor component (#5551)	3 years ago
Christian Haudum	95b885691d	Preserve interval parameter when splitting queries by time (#5622) ... * Preserve interval parameter when splitting queries by time Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add tests for interval param on Loki downstream requests Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add changelog entry for #5622 Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Simon	ea62af58e9	Introduce a ChunkRef type as part of logproto (#5643) ... * Change protobuf definitions * Adapt to an embedded ChunkRef struct * Move the Checksum to the ChunkRef	3 years ago
Sandeep Sukhani	6a533e5a56	improve boltdb-shipper logging to help debug index query latency issues (#5651)	3 years ago
Cyril Tovena	59bd44a5df	Remove more chunkstore and schema version below v9 (#5650) ... * Remove more chunkstore and schema version below v9 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes remaining tests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes remaining tests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Cyril Tovena	34f9649c6d	Remove more unused code (#5638) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Sandeep Sukhani	8c06c546ab	debug log number of index entries cached and retrieved from the cache per index query (#5642)	3 years ago
Karsten Jeschkies	86b4869f1a	Remove benchmark cron job. (#5641) ... Summary - The benchmarks were not stable enough. - They did not yield much value as we did not give much attention to them.	3 years ago
Cyril Tovena	df1a8e3632	Remove unused code from cortex (#5633) ... * Remove unused code from cortex Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes the build Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes flakky test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * update vendor Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Christian Simon	b6e6003724	Remove unused storage gateway references (#5627)	3 years ago
Owen Diehl	ec809e665f	Tsdb/sharding-benchmarks (#5628) ... * adds shard to tsdb/index pkg * add sharded tsdb benchmark	3 years ago
Periklis Tsirakidis	14a84bbfde	operator: Use tenant name as id for mode openshift-logging (#5624)	3 years ago
Cyril Tovena	39101308f1	[Frontend] Log Result Cache (#5502) ... * Rough verion still require some fixes * with file saved * Finish off the code and logic Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Refactors metrics and hook the log cache middleware Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add tests, fixes and lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Hash the key Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * better comment Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * better comment Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/querier/queryrange/log_result_cache.go Co-authored-by: Christian Simon <simon@swine.de> * Update pkg/querier/queryrange/log_result_cache.go Co-authored-by: Christian Simon <simon@swine.de> * Fixes typo in variable namme Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Use only one ok bool Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedbacks Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * check array boundaries Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Christian Simon <simon@swine.de>	3 years ago
Callum Styan	01d63c8ae8	[promtail] Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. (#5521) ... * Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Set up new metrics passing for other client types. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix lint issues. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update changelog and docs, also rename nested client configs struct to configs. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Karsten Jeschkies	1deacceca9	Test multi-tenant context propagation. (#5620) ... **What this PR does / why we need it**: The original change injected the user id when the org id was required to fetch all data. **Which issue(s) this PR fixes**: Fixes grafana/loki-private#230 **Special notes for your reviewer**: The changes can be tested as follows 1. Change working directory to `tools/dev/loki-boltdb-storage-s3`. 2. Call `./compose-up.sh` to boot the cluster. 3. Query the logs with ``` curl -v -X GET -G "http://localhost:8007/loki/api/v1/query_range" -H "X-Scope-OrgID: 1|2" --data-urlencode 'query={compose_service=~"log-gen.*"}' | jq '.data.result[].stream' ``` It will should two streams with `__tenant_id: 1` and `__tenant_id_: 2` as part of the labels. **Checklist** - [ ] Documentation added - [ ] Tests updated - [ ] Add an entry in the `CHANGELOG.md` about the changes.	3 years ago