4072 Commits (e73584a3cd48e9c5fe7fe9253b0e2869b9da308f)

 

All Branches   

Search

Author	SHA1	Message	Date
Travis Patterson	bab049ca6f	Only process deletes in batches (#6851) ... * Only process deletes in batches * better logging	3 years ago
Sandeep Sukhani	7c66a363f7	Delete requests processing improvements (#6837) ... * return early while checking whether a chunk is deleted if user does not have any delete requests * track oldest start and latest end time of delete requests for each user * add some tests * Update pkg/storage/stores/indexshipper/compactor/deletion/delete_requests_manager.go Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com> Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com>	3 years ago
Owen Diehl	f9d78e1748	[TSDB] Indexgateway Protobuf refactor (#6841) ... * queryrangebase definitions protos & aliases Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * indexgatewaypb to logproto Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * updates queryrange.proto for new definitions file Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * s/indexgatewaypb/logproto/g Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * renames to indexseries for clobbering reasons Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * more indexgatewaypb removal compatibility work Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * proto fmt Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * rebuild imports Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * goimports -s Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Periklis Tsirakidis	d1365c17ab	operator: Use mod readonly when building container (#6843)	3 years ago
Christian Simon	19c7315bcc	Improve error message when max error message is hit (#6834) ... before: `entry with timestamp 2022-08-02 12:32:37 +0000 UTC ignored, reason: 'entry too far behind' for stream: {foo="bar2"}` after: `entry with timestamp 2022-08-02 12:32:37 +0000 UTC ignored, reason: 'entry too far behind, oldest acceptable timestamp is: 2022-08-03T15:25:57Z' for stream: {foo="bar2"}`	3 years ago
Danny Kopping	c63928e20f	Support building against Go 1.19 (#6833) ... * Support building against Go 1.19 Fixes https://github.com/grafana/loki/issues/6831 Hat-tip to @rfratto in https://github.com/grafana/agent/pull/1985 Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * go mod tidy Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Travis Patterson	3054a0ead5	Add groupcache timeouts (#6808) ... * Add groupcache timeouts * Made groupcache timeouts configurable	3 years ago
Gerard Vanloo	9cab665055	Adding properties file (#6799)	3 years ago
Kaviraj Kanagaraj	7b89f20378	fix(logql): Make `LabelSampleExtractor` work as expected when label doesn't exist in logline (#6766) ... * fix(logql): Make `StringLabelfilter` work as expected Consider Log lines ``` msg=hello subqueries=5 msg=hello subqueries=0 msg=hello ``` If you run following logql ``` {foo="bar"}|logfmt|subqueries!=0 ``` it returns ``` msg=hello subqueries=5 ``` But if you run following logql ``` {foo="bar"}|logfmt|subqueries!="0" # NOTE: "0" as string. ``` it returns ``` msg=hello subqueries=5 msg=hello ``` NOTE: it also returns log lines that doesn't contain `subqueries` label in the first place. This cause subtle error if used in metric queries using that `label` in unwrap. e.g: following logql on above log lines returns ``` sum_over_time({foo="bar"}|logfmt|subqueries!="0"|unwrap subqueries[1m]) ``` Returns `pipeline error: 'SampleExtractionErr'`. Because, the lines without `subqueries` labels are not skipped during `ProcessLine` and during metric extraction, our extractor sets this `SampleExtractionerror`. Fixes: https://github.com/grafana/loki/issues/6713 * Add it on changelog Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix linter Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add more tests and fix the edge case with equality to empty strings Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * typo on the comment Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * handle this edge case during metric extraction. Not in label filter Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix linter Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove commented code Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Update changelog Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Karen Miller	0313f8648f	Change existing labeler action to use type/docs label (#6754)	3 years ago
Pablo	c9ef0621d1	Promtail: Add new target for receiving GCP PubSub Push messages (#6777)	3 years ago
Christian Simon	49a6c03c09	Treat version flag at any position (#6827) ... The behaviour was changed as part of #6802. This should restore the previous behaviour and allow the version to be displayed without config file.	3 years ago
Danny Kopping	66fdb3c572	Log stream flushes to see how many chunks we flush at a time (#6819) ... * Log stream flushes to see how many chunks we flush at a time Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Smuggling in an error wrapping which aides debugging Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Update docs/sources/upgrading/_index.md Co-authored-by: Ed Welch <ed@oqqer.com> * Removing unnecessary label Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Ed Welch <ed@oqqer.com>	3 years ago
Kaviraj Kanagaraj	1c6a2410d6	doc(retention): Add clarity on default behavior. (#6815) ... * doc(retention): Add clarity on default behavior. Currently if you read through the entire doc, it's not super clear what happens if I don't enable retention. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * update Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Owen Diehl	46ae0efc0f	Simplify shard membership calculations (#6810)	3 years ago
Kaviraj Kanagaraj	9f06bc0083	chore(groupcache): Groupcache doesn't need global server handler anymore (#6820) ... Remove it from the constructor Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Julien Duchesne	7b70d3d939	deb and rpm packaging for all binaries (#6456) ... * deb and rpm packaging for all binaries There is currently deb and rpm packages being published for logcli amd64 but they aren't signed In this PR: - Add RPM and deb packages for `logcli`, `loki-canary` `loki` and `promtail` for arm, arm64 and amd64 - Sign them with the Grafana GPG key (packages.grafana.com/gpg.key). This will be the same key for all Grafana products - Add CI steps to test the RPM and deb packages. This launches a docker image with systemd installed, then it installs both loki and promtail and does a `logcli` query on the Loki instance * Remove specific version in test scripts * Bump build image to 0.22.0 * Add restart policy for promtail's service	3 years ago
Danny Kopping	c5daa31b65	Remove reference to non-existent config field (#6781) ... Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Karsten Jeschkies	51b09d771f	Open access to Minio console in dev setup. (#6807)	3 years ago
Michel Hollands	03e4db46eb	Fix log messages for deletion requests (#6727) ... * Fix log messages for deletion requests Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Store deleted lines in log message instead of as a metric Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix linting issue Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Test for equal values Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Config for running with deletion mode Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add back per user counter of deleted lines Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Revert example config changes Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Change test name Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Gyanesh Malhotra	3a0b982fe2	Run `loki -version` without needing a config defined (#6802) ... * fix version. * address pr comment.	3 years ago
Callum Styan	a53ba0bb04	populate the memberlist label by default (#6800) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Callum Styan	4030c12e17	only set the consul kvstore configs if memberlist is not being used (#6809) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Travis Patterson	3bbc5a92f1	Allow fifocache to be configured with groupcache (#6806)	3 years ago
Kaviraj Kanagaraj	acc3a2fe23	chore(groupcache): Fix panic with stats collector wrapper (#6798) ... * chore(groupcache): Fix panic with stats collector wrapper Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * update Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
yngwiewang	de288ccbb8	docs: fix a typo (#6791)	3 years ago
Dylan Guedes	27b9fe50f0	Fix Promtail dashboard. (#6796) ... Fix Promtail production dashboard/panels. Error message was `bad_data: 1:40: parse error: unexpected character inside braces: '~'`.	3 years ago
Gerard Vanloo	ebc13669c0	operator: Changing channel to stable (#6795)	3 years ago
Sandeep Sukhani	2e95a64cb4	query-tee: support for multi backend response comparison and disabling query proxy for select backends (#6736) ... * add support for comparing responses with multiple secondary backends * allow disabling read proxy for select secondary backends * Update tools/querytee/proxy.go Co-authored-by: Salva Corts <salva.corts@grafana.com> Co-authored-by: Salva Corts <salva.corts@grafana.com>	3 years ago
Kaviraj Kanagaraj	e67dd6c91d	chore(groupcache): Support per cache group capacity (#6793) ... * chore(groupcache): Make per cache group capacity Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove unwanted handler got merged during rebase Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix typo on the comment Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Some standard renaming Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Karen Miller	8330ff2c61	Docs: Revise location of some LogQL examples; improve prose (#6751) ... * Docs: Revise location of some LogQL examples; improve prose * Update docs/sources/logql/query_examples.md Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com> * Update docs/sources/logql/metric_queries.md Co-authored-by: Susana Ferreira <ssncferreira@gmail.com> * Revise per review comments. Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com> Co-authored-by: Susana Ferreira <ssncferreira@gmail.com>	3 years ago
Travis Patterson	4ca7676272	Groupcache improvements (#6752) ... * Groupcache communicates with own server * Don't distribute the index cache * Fix tests * go mod fix	3 years ago
Kaviraj Kanagaraj	ef304780cb	chore(groupcache): disable hotcache for chunks (#6784) ... * chore(groupcache): disable hotcache for chunks Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * GetCacheType() Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Adam Brodziak	210b9ec461	Fix YAML syntax and ConfigMap reference (#6735)	3 years ago
Andrii Dembitskyi	ab2d50a2b2	Typo in 'trimPrefix' function signature (#6733)	3 years ago
JordanRushing	ef51858c53	Backport Memberlist dependency version bump to k108 (#6773) ... Signed-off-by: JordanRushing <rushing.jordan@gmail.com>	3 years ago
JordanRushing	2f0c2e675c	Update Memberlist dependency version; tidy and re-vendor (#6717) ... Signed-off-by: JordanRushing <rushing.jordan@gmail.com>	3 years ago
Dylan Guedes	d38c208aa7	Rephrase error message (indexgateway->groupcache). (#6763)	3 years ago
Travis Patterson	cc9c19846f	Fix cache instrumentation (#6753)	3 years ago
Periklis Tsirakidis	4640ee14a2	operator: Update Loki operand to v2.6.1 (#6749)	3 years ago
Periklis Tsirakidis	dbc693be86	operator: Update go4.org/unsafe/assume-no-moving-gc to latest (#6748)	3 years ago
Mohamed-Amine Bouqsimi	be71e48250	operator: Golang version to 1.18 and k8s client to 1.24 (#6741)	3 years ago
Kaviraj Kanagaraj	a1e75da970	doc: Add shuffle sharding doc (#6173) ... * doc: Add shuffle sharding doc Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add query-scheduler config as well Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Update docs/sources/operations/shuffle-sharding.md Co-authored-by: Dan Mihai Dinu <33793329+danmdinu@users.noreply.github.com> * Update docs/sources/operations/shuffle-sharding.md Co-authored-by: Dan Mihai Dinu <33793329+danmdinu@users.noreply.github.com> * Update docs/sources/operations/shuffle-sharding.md Co-authored-by: Dan Mihai Dinu <33793329+danmdinu@users.noreply.github.com> * Update docs/sources/operations/shuffle-sharding.md Co-authored-by: Dan Mihai Dinu <33793329+danmdinu@users.noreply.github.com> * Update docs/sources/operations/shuffle-sharding.md Co-authored-by: Dan Mihai Dinu <33793329+danmdinu@users.noreply.github.com> * Update docs/sources/operations/shuffle-sharding.md Co-authored-by: Dan Mihai Dinu <33793329+danmdinu@users.noreply.github.com> * Update docs/sources/operations/shuffle-sharding.md Co-authored-by: Dan Mihai Dinu <33793329+danmdinu@users.noreply.github.com> * Update docs/sources/operations/shuffle-sharding.md Co-authored-by: Dan Mihai Dinu <33793329+danmdinu@users.noreply.github.com> * Add line explaining what is "query-of-death" exactly means * PR remarsk from Karen Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix image URL Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Update docs/sources/operations/shuffle-sharding.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Dan Mihai Dinu <33793329+danmdinu@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Kaviraj Kanagaraj	fb9a1989d8	chore(groupcache): Disable hotcache during set (#6740) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Owen Diehl	46d811b9ff	use owen-d gomemcache fork for connection sharding (#6722) ... Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Owen Diehl	8ac859c5cd	[Enhancement] Removes memcached failure log (#6720) ... * removed memcached failure log Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * remove memcached fetch error log Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Sandeep Sukhani	26fc489d41	tsdb store refactoring (#6724) ... * do not make global tsdb store instance * upload index to storage during ingester shutdown	3 years ago
Sandeep Sukhani	882010a810	Index shipper move code (#6704) ... * move compactor code to generic indexshipper * move table client to generic indexshipper * move storage package and relevant code for managing files on storage to generic indexshipper * add missing files * lint	3 years ago
Kaviraj Kanagaraj	0d99d80acd	upgrade `go:1.17.9` to `go:1.18.4` (#6726)	3 years ago
Danny Kopping	b8d260edc0	Reinclude .git dir in docker builds (#6723) ... This was removed in #6691, but caused errors in docker builds Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago