68 Commits (61fc17536120bcbc201d16a0032aad0375cbfca2)

Author	SHA1	Message	Date
Aditya C S	38ee57c7d5	Feature: Replace stage in pipeline (#2060)	6 years ago
Jérôme Loyet	665712ff18	Add Entry variable to template (#2105) ... The new Entry variable is the log message that could be needed in template. For instance, if I want to convert all my log line to lowercase: - template: source: message template: '{{ ToLower .Entry }}'	6 years ago
Ed Welch	7dd109763c	expand the match_all to also optionally allow counting bytes per stream (#2066) ... Signed-off-by: Ed Welch <edward.welch@grafana.com>	6 years ago
Josh Soref	0d9cf4946a	Spelling (#2014) ... * spelling: access * spelling: actual * spelling: asynchronously * spelling: circleci * spelling: circle * spelling: cognitive * spelling: comment * spelling: computation * spelling: correct * spelling: daemon * spelling: elliott * spelling: enabled * spelling: encbuf * spelling: extracted * spelling: explicitly * spelling: independent * spelling: languages * spelling: loose * spelling: message * spelling: metrics * spelling: mismatch * spelling: nonexistent * spelling: output * spelling: pipeline * spelling: pipe line * spelling: position * spelling: prepend * spelling: query * spelling: receive * spelling: received * spelling: reducible * spelling: registry * spelling: response * spelling: retryable * spelling: scanning * spelling: sourced * spelling: supported * spelling: template * spelling: timeout * spelling: unsupported * spelling: adapter * spelling: deferring * spelling: expirable	6 years ago
Cyril Tovena	a252a8fc01	Fixes possible panic in json pipeline stage. (#1894) ... This was reported to me today and it happens because the previous source can be nil. This was only happening when debug log was on. And the problem was only in the json because it was using .String on a nil value. I've added a test and activate debug during tests to cover those path too. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	7f61f111ae	Log error message when source does not exist in extracted values (#1815)	6 years ago
Cyril Tovena	d34b0a9d30	Regexp simplification (#1787) ... * Refactor line filter to support custom parsing for perl regexp. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Support alternate, concat regex simplification Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add benchmark between normal and simplified regex. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Working through all possible concat operation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes concat operations. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds more type of capture group Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve test robustness Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Support for nexted concat. git push Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes bug with anychar. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add more not supported cases. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Refactor the concat alternates function. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve documentation and refactor code. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes all code using line filter. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve tests to check nil filter. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ensure benchmark is not optimized by the compilation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	75ef5c82c8	Fix error in templating when extracted key has nil value	6 years ago
David Tennander	5139aa1867	Promtail: Ignore dropped entries in subsequent metric-stages in pipelines. (#1743) ... * Adds testcase for promtail that records metrics after a "match-drop". * Makes subsequent metrics stages in promtail ignore dropped entries. Before this change a "metric" stage after a "match" stage with `action: drop` would result in an error. This specifies the behavior in the docs and adds logic to ignore dropped entries.	6 years ago
Aditya C S	f9ff2a4b02	Add goimport local-prefixes configuration to .golangci.yml (#1710)	6 years ago
Aditya C S	45d40a5c00	Fix panic in debug message (#1687)	6 years ago
Aditya C S	460bb5b857	Support entire extracted value map in template pipeline stage (#1666) ... Refactor template stage processing. This sets all extracted key available, plus if the source is available adds the extra key `Value` for backward compatibility. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Signed-off-by: Aditya C S <aditya.gnu@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Edward Welch	0202884d27	Automatically prune metrics from the /metrics output of the promtail metrics pipeline stage after an idle period. ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Edward Welch	4aeeeea1c8	Allow a metric defined as a counter to match all lines, useful for creating line count metrics which include all your labels. ... Found a bug in the the test runner where it didn't fail if the actual error was nil but the test expected an error Added some tests to the counters to test valid configs Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Aditya C S	b70f691cd4	Support custom prefix name in metrics stage (#1664)	6 years ago
wphan	d627cda848	Support microsecond timestamp format (#1426) ... Adds microsecond timestamp support. https://github.com/grafana/loki/issues/1407	6 years ago
Cyril Tovena	b34c2b0bd3	Move to jsoniter instead of default json package (#1249) ... * Move to jsoniter instead of default json package Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes jsoniter on the logcli output Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Peter Štibraný	125cfbfd5b	pkg/promtail/client: Handle fingerprint hash collisions (#1254) ... * Handle fingerprint hash collisions Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Instead of using fingerprints, use label strings as map keys. Label strings are properly sorted key=value pairs. This solution produces more garbage, but doesn't reinvent its own hashing, and keeps code simple. This seems to be a good tradeoff for promtail. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Marco Pracucci	9ec3117245	Move ReservedLabelTenantID out from a dedicated file (#1239)	6 years ago
Marco Pracucci	04f58c880f	promtail: add multi-tenant support (#1135) ... * promtail: added tenant_id support to promtail client * promtail: added tenant stage to dinamically override the tenant ID * promtail: documented client's batch struct and improved tenant stage config pointer usage * Added static value support to tenant stage	6 years ago
Marco Pracucci	04a93b7880	promtail: fix handling of JMESPath expression returning nil while parsing JSON (#1179)	6 years ago
Cyril Tovena	1f6f4337ce	Add logql filter to match stages and drop capability (#1112) ... * Add logql filter to match stages and drop capability * use const string instead and remove unused value * Uses action property instead of drop_entries	6 years ago
Marco Pracucci	7af0c2bdf3	promtail: added action_on_failure support to timestamp stage (#1123)	6 years ago
Marco Pracucci	b94a4361f2	promtail: initialize extracted map with initial labels (#1122)	6 years ago
Edward Welch	04a615a72d	make promtail daemonset name configurable ... also adding a regex test for something else I was working on	6 years ago
Edward Welch	a2e2272653	use a global variable to wrap debug log statments in the pipeline to prevent unnecessary allocations when debug logging is not enabled	6 years ago
Michael Dai	3d1f39fab6	Pipeline: Fixed labels process test with same objects (#869) ... * Fixed labels process test with same objects Signed-off-by: jojohappy <sarahdj0917@gmail.com>	7 years ago
Edward Welch	7deb02b532	add a Name() method to the stage interface so that debug logging can show you the name of the pipeline stage which just processed the log ... remove some unnecessary logging around fsnotify events we don't care about and saving positions Make the Processing Log Lines doc a first class citizen, I reference this a lot and currently it's hidden behind 3 clicks	7 years ago
Edward Welch	3d5319e72a	adding ability to supply timezone to timestamp pipeline stage	7 years ago
Marco Pracucci	e6f8d6ffad	Added date without year support to timestamp stage (#760)	7 years ago
Marco Pracucci	94c252b91f	Parallelly run regex and json stages pipeline tests	7 years ago
Marco Pracucci	d235e483c4	Added source validation to regex and json stages	7 years ago
Marco Pracucci	0a79e2a96e	Converted source in regex and josn stages to string pointer	7 years ago
Marco Pracucci	812aecc795	Added source support to regex and json stages	7 years ago
Edward Welch	d5688b5eb6	adding a golang Template stage	7 years ago
Edward Welch	1249e92ef3	use strconf.FormatFloat instead of fmt.Sprintf for converting floats to strings, this way we can eliminate non significant trailing zeros such that the float value 1 would be "1" as a string instead of "1.000000"	7 years ago
Edward Welch	de83272b2f	Add support to timestamp stage to parse Unix seconds, milliseconds, and nanosecond timestamps	7 years ago
Edward Welch	3b02474597	removing entries.go as we are no longer using the custom Histogram for the log_entries_bytes histogram	7 years ago
Edward Welch	1dc130d8cc	PR Feedback	7 years ago
Edward Welch	04facc4d00	updating docs for new pipeline config. ... removed helm entry in scrape_config.sh because there doesn't seem to be anyway to make it work with new pipeline config	7 years ago
Edward Welch	51bdd15237	renaming `metric` stage to `metrics` as it defines multiple metrics, similar to labels stage which is also plural. ... Adding a couple unit tests to regex and json stage to act as examples	7 years ago
Edward Welch	d60b6f5440	PR feedback	7 years ago
Cyril Tovena	ab2bc8766a	fix flaky timestamp test	7 years ago
Cyril Tovena	2a7a97d052	Remove LogCount	7 years ago
Edward Welch	3a2ac64b7c	cleaning up remaining TODO's, adding tests ... cleaning up GoDoc pipeline_name is now optional for matcher stage	7 years ago
Edward Welch	9a91d58d3a	cleaned up most of the TODO's ... refactored and improved some of the tests, each stage type should now have a test using actual YAML A few TODO's remaining and some comment cleanup	7 years ago
Edward Welch	29eaec1a04	implementing all the functions for the counter and gauge metric types ... metric test is still failing because of missing metrics when the counter is 0 added a lot of TODO's I need to go back and cleanup	7 years ago
Edward Welch	eaecf0ff90	Making the pipeline itself a Stage so that we can use it to better implement the Match stage (and it cleans up the Docker and CRI extensions some too) ... Still needs to fix the metrics test	7 years ago
Edward Welch	07da8e1d11	Refactor to make everything a stage. ... Still needs: Matcher stage work, pipeline test work	7 years ago
Cyril Tovena	9c21460da5	fix linter	7 years ago