3237 Commits (2ebbecfcbd7e484fdcfad4669cf33fd8dda64eb4)

 

All Branches   

Search

Author	SHA1	Message	Date
Callum Styan	2ebbecfcbd	Require unique client configs when there are multiple clients. (#5688) ... * Require unique client configs when there are multiple clients. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fixing linter error Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Robert Jacob	cb757a4a3a	operator: Update to Go 1.17 (#5695) ... * Update Go 1.17 * Migrations for Go 1.17 * Update bingo and add missing sum files * Update mention in doc * Update changelog * Update Go in workflows	3 years ago
Sashank Agarwal	cb9960d598	operator: Document how to connect to LokiStack gateway component (#5615)	3 years ago
Robert Jacob	4f2f0886d7	operator: Update Loki operand to 2.4.2 (#5655)	3 years ago
Callum Styan	2c2578e84c	Fix bug with new promtail stream lag metric where labels might not be (#5675) ... applied if they don't exist on the source stream Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Salva Corts	0c5900e407	Fix debug image by updating Delve version (#5673)	3 years ago
Karsten Jeschkies	705baa39f4	Speed up re-labelling in multi-tenant queries. (#5663)	3 years ago
Mikael Schirén	f3a86ded23	Add Digitalist as adopter (#5596)	3 years ago
Peter Olivo	0a49d21d40	Fix broken Fluentbit / Fluentd plugin doc links (#5664)	3 years ago
Gerard Vanloo	8154f3f2b4	operator: Update developer addons (#5599)	3 years ago
Gerard Vanloo	27479484f8	operator: Adding instructions to respond to alerts (#5579)	3 years ago
Owen Diehl	3f28a33d93	TSDB Index reuses slices, adds pools (#5630) ... * adds a pool for ChunkMetas * index takes slice pointers for allocation reasons and adds pools for all index types * reuse slices in tsdb benchmarks * adds count to bench script * properly returns series to pool * more ergonomic index signatures while still supporting slice reuse * tsdb index documentation * aligns tsdb-map tooling with new index signatures	3 years ago
Owen Diehl	d084dc7f4b	Tsdb/hash order (#5631) ... * encode fingerprint into series in tsdb * uses series fingerprint in index reads * order tsdb series by fprint * tsdb writes fingerprint offsets table * shardannotation is part of tsdb/index, fixes testware * loads fingerprint offsets from tsdb * removes unnecessary sortedpostings * adds prefix sharding logic * sharded tsdb postings * updates benchmark to pass nil hash * runs tsdb benches with variable count	3 years ago
Karsten Jeschkies	3d5a3936d1	Support limits in multi-tenant queries. (#5626) ... **What this PR does / why we need it**: This changes adds support for the the following limits in multi-tenant queries: - `MaxQuerySeries` - `QuerySplitDuration` - `MaxEntriesLimitPerQuery` - `MinShardingLookback` - `MaxQueryLength` - `MaxQueryParallelism` - `MaxQueriersPerUser` - `MaxCacheFreshness` It always uses the more restricted limit. That means the smallest `MaxQuerySeries` but biggest `QuerySplitDuration`. The split duration is special. Zero means disabled. Also, the global default resolver is the multi tenant resolver when multi-tenant queries are enabled. This will result HTTP 400 errors in case the user sends multiple tenants to endpoints that do not support it. **Which issue(s) this PR fixes**: **Special notes for your reviewer**: **Checklist** - [ ] Documentation added - [x] Tests updated - [x] Add an entry in the `CHANGELOG.md` about the changes. Co-authored-by: JordanRushing <rushing.jordan@gmail.com>	3 years ago
Salva Corts	1f2b450f2d	Add inflight requests metric to scheduler (#5658)	3 years ago
Sashank Agarwal	5105552e79	operator: Update CSV to point to candidate channel and use openshift-operators-redhat ns (#5640)	3 years ago
Sashank Agarwal	5e5067ef40	operator: Document how to connect to distributor component (#5551)	3 years ago
Christian Haudum	95b885691d	Preserve interval parameter when splitting queries by time (#5622) ... * Preserve interval parameter when splitting queries by time Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add tests for interval param on Loki downstream requests Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add changelog entry for #5622 Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Simon	ea62af58e9	Introduce a ChunkRef type as part of logproto (#5643) ... * Change protobuf definitions * Adapt to an embedded ChunkRef struct * Move the Checksum to the ChunkRef	3 years ago
Sandeep Sukhani	6a533e5a56	improve boltdb-shipper logging to help debug index query latency issues (#5651)	3 years ago
Cyril Tovena	59bd44a5df	Remove more chunkstore and schema version below v9 (#5650) ... * Remove more chunkstore and schema version below v9 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes remaining tests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes remaining tests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Cyril Tovena	34f9649c6d	Remove more unused code (#5638) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Sandeep Sukhani	8c06c546ab	debug log number of index entries cached and retrieved from the cache per index query (#5642)	3 years ago
Karsten Jeschkies	86b4869f1a	Remove benchmark cron job. (#5641) ... Summary - The benchmarks were not stable enough. - They did not yield much value as we did not give much attention to them.	3 years ago
Cyril Tovena	df1a8e3632	Remove unused code from cortex (#5633) ... * Remove unused code from cortex Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes the build Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes flakky test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * update vendor Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Christian Simon	b6e6003724	Remove unused storage gateway references (#5627)	3 years ago
Owen Diehl	ec809e665f	Tsdb/sharding-benchmarks (#5628) ... * adds shard to tsdb/index pkg * add sharded tsdb benchmark	3 years ago
Periklis Tsirakidis	14a84bbfde	operator: Use tenant name as id for mode openshift-logging (#5624)	3 years ago
Cyril Tovena	39101308f1	[Frontend] Log Result Cache (#5502) ... * Rough verion still require some fixes * with file saved * Finish off the code and logic Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Refactors metrics and hook the log cache middleware Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add tests, fixes and lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Hash the key Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * better comment Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * better comment Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/querier/queryrange/log_result_cache.go Co-authored-by: Christian Simon <simon@swine.de> * Update pkg/querier/queryrange/log_result_cache.go Co-authored-by: Christian Simon <simon@swine.de> * Fixes typo in variable namme Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Use only one ok bool Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedbacks Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * check array boundaries Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Christian Simon <simon@swine.de>	3 years ago
Callum Styan	01d63c8ae8	[promtail] Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. (#5521) ... * Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Set up new metrics passing for other client types. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix lint issues. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update changelog and docs, also rename nested client configs struct to configs. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Karsten Jeschkies	1deacceca9	Test multi-tenant context propagation. (#5620) ... **What this PR does / why we need it**: The original change injected the user id when the org id was required to fetch all data. **Which issue(s) this PR fixes**: Fixes grafana/loki-private#230 **Special notes for your reviewer**: The changes can be tested as follows 1. Change working directory to `tools/dev/loki-boltdb-storage-s3`. 2. Call `./compose-up.sh` to boot the cluster. 3. Query the logs with ``` curl -v -X GET -G "http://localhost:8007/loki/api/v1/query_range" -H "X-Scope-OrgID: 1|2" --data-urlencode 'query={compose_service=~"log-gen.*"}' | jq '.data.result[].stream' ``` It will should two streams with `__tenant_id: 1` and `__tenant_id_: 2` as part of the labels. **Checklist** - [ ] Documentation added - [ ] Tests updated - [ ] Add an entry in the `CHANGELOG.md` about the changes.	3 years ago
Periklis Tsirakidis	0ca425d471	operator: Use recommended labels for LokiStack components (#5621)	3 years ago
Travis Patterson	88372c93cc	Query Filtering -- Querier (#5482) ... * Query Filtering -- Querier - Get deletes from the index gateway and attach them to store and ingester requests * lint * Fix test -- sometimes svc is nil * don't test for delete overlap on each selector * lint	3 years ago
Cyril Tovena	79f0e349f5	Refactor LogQL syntax into its own package (#5539) ... * Refactor LogQL syntax into its own package Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Merge upstream Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/loghttp/series.go Co-authored-by: Susana Ferreira <ssncferreira@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Susana Ferreira <ssncferreira@gmail.com>	3 years ago
Periklis Tsirakidis	86d196ef21	operator: Use lokistack name as prefix for owned resources (#5607)	3 years ago
Cyril Tovena	8f693e77b0	Update Prometheus to latest (#5545) ... * Update Prometheus to latest Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update promql.QueryTracker Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes querier test to use new grafana/regexp Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes test with new textparse signature Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Danny Kopping	75328872dc	Print stacktrace to stderr for easier readability (#5616) ... Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Kaviraj Kanagaraj	d6621f452f	Replace `PromQL` -> `LogQL` wordings in Querier (#5602)	3 years ago
Owen Diehl	d320873e82	Tsdb/sharding (#5600) ... * sharded support for GetChunkRefs and Series * sharded support for multi-index * linting	3 years ago
Owen Diehl	2eb1046818	Tsdb/multi idx (#5598) ... * begins working on a multi file index for querying across TSDBs * abandons heapsort for multi-index * series struct includes fingerprint and implements rest of multi-idx methods * goimports	3 years ago
Periklis Tsirakidis	857c94ea25	Add RBAC for Prometheus service discovery to Loki component metrics (#5588)	3 years ago
afayngelerindbx	e49c360c36	canary: Adds locking to prevent multiple concurrent invocations of `confirmMissing` from clobbering each other (#5568)	3 years ago
Owen Diehl	f6d15fba48	bounds utility for tsdb lib (#5593)	3 years ago
Owen Diehl	67f961e4dc	more tsdb benchmarks + updates script to work with incompatible branches (#5590) ... * more tsdb benchmarks + updates script to work with incompatible branches * shellcheck	3 years ago
Sandeep Sukhani	d2ce08280f	Compactor improvements (#5587) ... * upload and cleanup index sets concurrently * reuse batch slice used for building a batch of index during compaction	3 years ago
Kaviraj Kanagaraj	294fd33a38	Make Loki adopters visible in README (#5586) ... * Make Loki adopters visible in README Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Update README.md Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Sandeep Sukhani	7f498e9617	cleanup common index source files at the end while compacting index with boltdb-shipper (#5585)	3 years ago
Owen Diehl	824c65598f	store tsdb bounds (#5582)	3 years ago
Sandeep Sukhani	c76544baf9	build a new batch while starting to process a bucket (#5580)	3 years ago
Owen Diehl	dee6a56df1	Tsdb/index interface (#5577) ... * begins speccing out index ifc, impl * block level labelnames/values * single file index test + bugfix * goimports * LabelNames and LabelValues support matchers * s/Interface/Index/	3 years ago