apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Cyril Tovena	ba51aad551	Logcli remote storage. (#1814 ) * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Start hooking logcli with local storage config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes org-id and documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Owen Diehl	7effeec642	Sharding optimizations I: AST mapping (#1846 ) * [wip] sharding evaluator/ast * [wip] continues experimenting with ast mapping * refactoring in preparation for binops * evaluators can pass state to other evaluators * compiler alignment * Evaluator method renamed to StepEvaluator * chained evaluator impl * tidying up sharding code * handling for ConcatSampleExpr * downstream iterator * structure for downstreaming asts * outlines sharding optimizations * work on sharding mapper * ast sharding optimizations * test for different logrange positions * shard mapper tests * stronger ast sharding & tests * shardmapper tests for string->string * removes sharding evaluator code * removes unused ctx arg * Update pkg/logql/evaluator.go Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	f41273182c	Support configurable maximum of the limits parameter (#1798 )	6 years ago
Christian Schlotter	57023e00cb	logcli client: use OrgID in LiveTail (#1850 ) Signed-off-by: Schlotter, Christian <christi.schlotter@gmail.com>	6 years ago
Edward Welch	6841c418ef	promtail retry 429 rate limit errors, clarifying risks in the docs of configuring multiple client sections in promtail, also increased the backoff and retry settings in promtail. Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Aditya C S	7f61f111ae	Log error message when source does not exist in extracted values (#1815 )	6 years ago
Cyril Tovena	d5f27ee04d	Adds a counter for total flushed chunks per reason. (#1819 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Cyril Tovena	3829b707c3	Optimize empty filter queries. (#1810 ) * Optimize filter queries such as `{label="foo"} \|~ "" \|~ "." \|= ""` doesn't contains a filter. The query is not really rewritten and the stringer func still returns the correct original query. However the `Filter` func of the `Expr` returns nil which what is being checked when splitting queries in the frontend and also what is being used in the memchunk. see https://github.com/grafana/loki/blob/master/pkg/querier/queryrange/roundtrip.go#L81 and https://github.com/grafana/loki/blob/master/pkg/chunkenc/memchunk.go#L614 Fixes #1792 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Add missing tests with combination of empty or regex. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Cyril Tovena	2a933b7bc3	Test stats memchunk (#1809 ) * Add a test for ensuring stats computed from memchunk are correct. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add some comment Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Peter Štibraný	ca19683511	loki: update Cortex to master (#1799 ) * Update Cortex to master Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Integrate latest Cortex master changes into loki - Frontend worker now needs to be started explicitly - Lifecycler no longer exits on error. Distributor and Ingester do that now Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Lint Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * go mod tidy Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Update Cortex to master. After 0.7 release, it is now showing as v0.7.1-... Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Ed Welch	3abee7829d	Log the full stats and send to stderr instead of stdout (#1808 ) Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Cyril Tovena	1eb139c37c	Add a test for duplicates count in the heap iterator and fixes it. (#1802 ) * Add a tests for duplicate count in the heap iterator and fixes it. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/iter/iterator.go	6 years ago
Cyril Tovena	97165fc0a0	Use ingester client GRPC call options from config. (#1797 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	89263b09a7	Add /ready endpoint to table-manager (#1736 )	6 years ago
johncming	13c9a864c6	pkg/chunkenc: fix leak of pool. (#1793 ) Signed-off-by: johncming <johncming@yahoo.com>	6 years ago
Peter Štibraný	dac8615f39	Convert module names to string. This allows us to remove bit of a code. (#1794 ) Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Cyril Tovena	d34b0a9d30	Regexp simplification (#1787 ) * Refactor line filter to support custom parsing for perl regexp. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Support alternate, concat regex simplification Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add benchmark between normal and simplified regex. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Working through all possible concat operation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes concat operations. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds more type of capture group Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve test robustness Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Support for nexted concat. git push Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes bug with anychar. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add more not supported cases. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Refactor the concat alternates function. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve documentation and refactor code. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes all code using line filter. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve tests to check nil filter. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ensure benchmark is not optimized by the compilation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Peter Štibraný	5ae6ea71f8	Update Cortex to master (#1785 ) * Update Cortex to v0.7.0-rc.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fixed errors after updating to latest master. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fixed errors after updating to latest master. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fixed errors after updating to latest master. queryrange.NewRetryMiddleware in NewLogFilterTripperware is now created without metrics, as that would collide with metrics in NewMetricTripperware. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Make sure to start client.Pool before using it. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use shared singleton memberlist KV. Fix queryrange metrics. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Make lint happy Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * go mod tidy Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Return err early. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Cyril Tovena	3f3152427a	Update cortex vendoring to include frontend status code improvement. (#1746 ) * Update cortex vendoring to include frontend status code improvement. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes signature changes in runtimeconfig.NewRuntimeConfigManager. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Forgot to git add . :facelpalm: Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Ed Welch	f5d79aee7a	Revert "loki: Allow setting a 'step' when querying logs. (#1773 )" (#1777 ) This reverts commit `934a0b8d` Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Ed Welch	934a0b8dc6	loki: Allow setting a 'step' when querying logs. (#1773 ) * Setting a step on log queries will result in similar behavior as metrics, only returning logs at multiples of the step Signed-off-by: Edward Welch <edward.welch@grafana.com> * clear up logic a little to make it easier to follow Signed-off-by: Edward Welch <edward.welch@grafana.com> * try to protect future us from future us Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Edward Welch	8726033bfa	remove the read lines counter when the log file stops being tailed Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Aditya C S	6f3489e661	Fix single job with multiple service discovery elements (#1770 )	6 years ago
talham7391	fa8bf2acba	Clearer error response from push endpoint when labels are malformed (#1750 ) * Clearer error response from push endpoint when labels are malformed * Concise error formatting	6 years ago
Cyril Tovena	4da4d74311	Query range should not support date where start == end. Since we are always checking against start inclusively and not end, this means this type of query will always returns no result. Fixes #1702, the frontend was not handling this type of query correctly. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	75ef5c82c8	Fix error in templating when extracted key has nil value	6 years ago
Cyril Tovena	4fdfbe8e56	Increase discarded samples when line is too long. (#1708 ) * Increase discarded samples when line is too long. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add comment on the public props Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Joe Elliott <joe.elliott@grafana.com>	6 years ago
Cyril Tovena	6328146876	Fixes querier cancellation error to return 499 instead of 500. (#1745 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
David Tennander	5139aa1867	Promtail: Ignore dropped entries in subsequent metric-stages in pipelines. (#1743 ) * Adds testcase for promtail that records metrics after a "match-drop". * Makes subsequent metrics stages in promtail ignore dropped entries. Before this change a "metric" stage after a "match" stage with `action: drop` would result in an error. This specifies the behavior in the docs and adds logic to ignore dropped entries.	6 years ago
Cyril Tovena	9be21a7c6b	This logs queries with latency tag when recording stats. (#1733 ) * This logs queries with latency tag when recording stats. Useful for building a dashboard of slow queries. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * mod-check. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	ac78129e66	Fix nil pointer dereference in ingester client (#1730 )	6 years ago
Cyril Tovena	6363e8da0a	Better logql metric status code. (#1718 ) * Fixes querier logql error to be 400 only for ast parsing error. Improve frontend metrics to use a more granular status_code. Improve prometheus histogram granularity. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add latency type dimensions to bytes throughput metric. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Use IsParseError in panic recovering. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * typo Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Cyril Tovena	cdd08b041a	Expose QueryType function. (#1719 ) * Expose QueryType function. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Expose query type const. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	f9ff2a4b02	Add goimport local-prefixes configuration to .golangci.yml (#1710 )	6 years ago
Aditya C S	45d40a5c00	Fix panic in debug message (#1687 )	6 years ago
Owen Diehl	db6fd7e779	api support for scalars (#1704 ) * adds conversions to loghttp scalar types * logcli prints scalars, lothttp scalars use prometheus json marshaling	6 years ago
Owen Diehl	414f95fedc	Literal Expressions in LogQL (#1677 ) * binops in ast * bin op associativity & precedence * binOpEvaluator work * defers close only if constructed without error * tests binary ops * more binops * updates docs * changelog * number literals in ast * [wip] literalExpr parsing * number parsing * signed literals * propagates evaluator close, handles healthchecks * literal evaluator works on non commutative operations * literalExprs cannot be used as legs of logical/set binops * removes comment * single literalExpr tests * reduces binops with literals in ast construction where possible * doc updates * scalar datatypes in logql * scalar serialization type * increases safety and reduces complexity in ast evaluator * recursive literal binop reduction parse test, improves parse errors on literal construction * vector + literal test	6 years ago
Aditya C S	460bb5b857	Support entire extracted value map in template pipeline stage (#1666 ) Refactor template stage processing. This sets all extracted key available, plus if the source is available adds the extra key `Value` for backward compatibility. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Signed-off-by: Aditya C S <aditya.gnu@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Owen Diehl	d6b85876ca	max line lengths (component + tenant overrides) (#1686 ) * bytesize flag support * max line limits * configurable tenant override options for max line size * bytesize yaml support * validator methods * distributor validator type * human friendly line size output, distributor test * invalid labels distributor test * docs + vendor * removes dead limits code	6 years ago
Cyril Tovena	2f061f3a8a	Ensure status codes are set correctly in the frontend. (#1684 ) * Returns httpgrpc error in roundtriper. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ensure error codes are set correctly in the frontend. Previously we had cases where 400 would endup as 500. We should use httpgrpc.Errorf when possible. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Cyril Tovena	4210fcef35	--dry-run Promtail. (#1652 ) * --dry-run Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove changed on gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes flaky test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ensure position file is readonly when doing dry-run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add information about dry run mode in the troubleshooting section. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more spaces. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Cyril Tovena	24d9956653	This improves the log ouput for statistics in the logcli. (#1644 ) * This improves the log ouput for statistics in the logcli. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Please the linter Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Edward Welch	0202884d27	Automatically prune metrics from the /metrics output of the promtail metrics pipeline stage after an idle period. Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Edward Welch	4aeeeea1c8	Allow a metric defined as a counter to match all lines, useful for creating line count metrics which include all your labels. Found a bug in the the test runner where it didn't fail if the actual error was nil but the test expected an error Added some tests to the counters to test valid configs Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Owen Diehl	6bbb61eb2f	Binary operators in LogQL (#1662 ) * binops in ast * bin op associativity & precedence * binOpEvaluator work * defers close only if constructed without error * tests binary ops * more binops * updates docs * changelog * better logql parsing errors for binops Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * adds ^ operator	6 years ago
Cyril Tovena	814cc87eb2	Pipe data to Promtail (#1649 ) * Adds readerTarget that read from io.Reader Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Updates comment and function names. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds stdin manager Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds default config with labels and support for static configs labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a test with pipeline stages. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes race on shutdown and adds documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes deadlock on server.run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/promtail/troubleshooting.md Co-Authored-By: Owen Diehl <ow.diehl@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * unlock mutex if Promtail.Run is called when Promtail is stopped Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	6 years ago
Cyril Tovena	2af69cb57c	Frontend & Querier query statistics instrumentation. (#1661 ) * wip stats frontend Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * wip stats frontend Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Updates cortex and add a record metric function. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add some tests in the mix Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes unused tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Replace global by an injected interface. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a test to make sure the stats middleware update response statistics. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	b70f691cd4	Support custom prefix name in metrics stage (#1664 )	6 years ago
Robert Fratto	267dbe0085	pkg/promtail/positions: handle empty positions file (#1660 ) If the positions file is empty, unmarshaling it will lead to a nil map being created. This commit ensures that positions is always initialized to be non-nil. Potentially handles #1659.	6 years ago
Owen Diehl	e0a77656fd	removes duplicate logRangeExprExt grammar (#1651 ) * removes duplicate logRangeExprExt grammar * linting errors	6 years ago

1 2 3 4 5 ...

493 Commits (8d1b345ca7cb581f8ae7dda3b8fd2016b1607306)