apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Kaviraj	94113ee080	Logql `stdin` support only log queries (#4606 ) * Hack stdin client into LogCLI Add flag to choose what kind of client to make request to. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Label filter working Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Demo checkpoint1 Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Metrics query working. Issue was with default value of `step` (1 nanosecond). StepEvaluator try to go through every nanosecond to apply aggregate on sample data during the metric queries. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Basic tests for fileClient * Tests for logqueries direction * Use HeapIterator for Entries. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove some debug statements Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove support for metric queries. Stick with only log queries Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Small rough usage doc * Remove filesampleiterator * Fix some typos and tests * Fix breaking test cases Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make linter happy Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks. 1. Add `--stdin` in examples of the usage 2. Add `--stdin` in all the command help output * PR remarks - Use parsed labels correctly - Fix indendation with --stdin flag * Fix issue with direction * Fix linter * MaxInt64 -> MaxInt (to support even arm32 images) * Add note on calculating `step` value on the client side	4 years ago
Ed Welch	2ac409c23e	Build: simplify how protos are built (#4639 ) * we always seem to be chasing our tails with how protos are generated and Makes use of timestamps to determine if files should be recompiled. Instead of touching files and altering timestamps always delete the compiled proto files when calling `protos` to make sure they are compiled every time. Removed targets to build protos, yaccs, and ragel files when trying to build loki or the canary. This isn't necesary, if you are changing these files you would know you need to build them and the `check-generated-files` should catch any changes to them not committed. * rm -rf * we have a race between check-generated-files and our other steps, so let that run first. also removing `check-generated-files` from the `all` target because its redundant with a separate step and could also race with the parallel lint * remove TOUCH_PROTOS * more cleanup of TOUCH_PROTOS	4 years ago
Callum Styan	096cf0cfaf	Update golang and loki-build-image image versions. (#4481 ) Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Mateusz Gozdek	b3df9f5dfd	cmd/logcli: add --follow flag as an alias for --tail (#4203 ) When using 'logcli query --tail', '--tail' behaves similar to the 'tail' command, which uses '--follow' flag, if you want to continuously follow the appended data to the file. I believe '--follow' flag is more natural for system administrators to use rather than '--tail' if one wants to "follow" the incoming logs, so this commit adds one, as an alias for '--tail'. Closes #3570 Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>	4 years ago
vyzigold	67b6c1aac8	logcli: Add retries to unsuccessful log queries (#3879 ) * Add retries to unsuccessful log queries.	5 years ago
dbluxo	88708d4b22	added support for bearer token authentication (#3749 )	5 years ago
Ed Welch	6e67d1ea5d	Loki/Promtail: Client Refactor (#3623 ) * move docker driver * move fluent-bit output plugin * move fluentd plugin * move logstash plugin * move promtail * match stage uses simple logql label matcher and filter expressions only * remove remaining logql imports * remove helpers package and move contents to util package * move validation and runtime out of util package * fix imports * move build and cfg packages into util * move ParseRequest function to util package * create a new package for logql models and move marshal/unmarshal code to util folder * move ErrorLabel to logqlmodel * move stats package to logqlmodel * decouple loghttp from logql by moving validation to logql package * move gcplog to tools * move PackedEntryKey constant to logqlmodel * fix stats proto import and rebuild protos * fix windows promtail tests * update drone to new dockerfile locations	5 years ago
Ed Welch	36ec92ce5c	Update Go and Alpine versions (#3481 ) * Upgrade go to 1.16 and alpine to 3.13 * update drone to use new build image version * gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Chance Zibolski	054b8fcc91	logcli: Refactor logcli Client interface to use time.Time and time.Duration for LiveTailQueryConn method (#3271 )	5 years ago
Michał Sochoń	3bb7f52f1f	Fix: Update docs for logcli (#3212 ) * Update docs for logcli Fix description for logcli, use proper flag names. Extend docs with example using timestamp. Signed-off-by: Michał Sochoń <kaszpir@gmail.com> * Update cmd/logcli/main.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	5 years ago
Yuichi Sawada	27dddef475	Fix logcli logql document url (#2968 )	5 years ago
Tom Wilkie	1c8dd3e11a	Add a few more instructions to logcli --help. (#2948 ) Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	5 years ago
Cyril Tovena	e6778e9827	Update to go 1.15 (#2877 ) * Upgrade to 1.15. Also upgrade linter and fixes some lint issues. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update CI. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update generated files. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Moar lint 🤦 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * moar lint and tests fixes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Moar tests fixes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Davor Kapsa	fffcfa6e81	fix some misspells (#2725 )	5 years ago
Sandeep Sukhani	65b539c2ab	add compactor details and other boltdb-shipper doc improvments (#2622 )	5 years ago
Tharun Rajendran	ab2dc9e2d3	Added logcli docker image (#2561 ) Signed-off-by: Tharun <rajendrantharun@live.com>	5 years ago
Ed Welch	82845e4f78	Adds --analyize-labels to logcli series command. (#2497 ) Changes the series command to use the common matcher input found in the query and instant-query commands, instead of `logcli series --matcher='{foo="bar"}'` it's now `logcli series '{foo="bar"}'`	5 years ago
Ed Welch	80693cae6f	Logcli: automatically batch requests (#2482 ) * first stab at batching logcli requests * fix other calls to printResult * working batching code * refactor the logcli Client into an interface so that it can be mocked for testing. * fixing some bugs * refactoring the output interface to make testing easier * starting to add tests * adding a bunch of tests fixing up how the MockQuerier works. * updating docs * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>	5 years ago
Aditya C S	68568f141e	colored labels output for logcli (#2470 ) * colored labels output for logcli * add period to all cli description	5 years ago
Cyril Tovena	1e19aa4715	Add performance profile flags for logcli. (#2248 ) * Add performance profile flags for logcli. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update the logcli documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove comment. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove unused import. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	360d9a7f97	Support querying labels on time range in logcli (#2083 )	6 years ago
Ed Welch	c7a1a1fb2e	Loki: Adds an `interval` paramater to query_range queries allowing a sampling of events to be returned based on the provided interval (#1965 ) * Adds an `interval` paramater to query_range queries allowing a sampling of events to be returned based on the provided interval Signed-off-by: Ed Welch <edward.welch@grafana.com> * lint Signed-off-by: Ed Welch <edward.welch@grafana.com> * extract function for parsing parameter Signed-off-by: Ed Welch <edward.welch@grafana.com> * Clarify the experimental nature of interval in the docs. Signed-off-by: Ed Welch <edward.welch@grafana.com> * make min time a constant Signed-off-by: Ed Welch <edward.welch@grafana.com> * Expand the docs around the experimental nature of interval a little more Signed-off-by: Ed Welch <edward.welch@grafana.com>	6 years ago
Mario Constanti	2c8251f1c9	logcli: org-id/tls-skip-verify set via env var (#1922 ) * command line flags --org-id and --tls-skip-verify could be also set via environment variables `LOKI_ORG_ID` and `LOKI_TLS_SKIP_VERIFY`	6 years ago
Ben Ye	9a62deb829	Support series API in logcli (#1861 ) * support series API in logcli Signed-off-by: yeya24 <yb532204897@gmail.com> add changelog Signed-off-by: yeya24 <yb532204897@gmail.com> * update logcli docs Signed-off-by: yeya24 <yb532204897@gmail.com>	6 years ago
Robert Fratto	8948ce1f2e	clarify logcli commands and output (#1712 ) * clarify logcli commands and output This commit attempts to do two things: 1. Differentiate between log entries and raw log lines, where the latter is what is produced by `-oraw`. 2. Explain the difference between `logcli query` and `logcli instant-query`. Fixes #1676. * address feedback * address more feedback * explain that instant-query is not useful for log lines * address review feedback This commit leaves logcli.md unmodified; that will be done in a later commit if the changes are approved. * sync logcli.md with command output	6 years ago
Cyril Tovena	ba51aad551	Logcli remote storage. (#1814 ) * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Start hooking logcli with local storage config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes org-id and documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	f9ff2a4b02	Add goimport local-prefixes configuration to .golangci.yml (#1710 )	6 years ago
Aditya C S	636ed15c65	Fix logcli --quiet parameter parsing issue (#1682 )	6 years ago
Owen Diehl	80e938c412	adds query stats and org id options in logcli (#1638 )	6 years ago
Sandeep Sukhani	2ae8bb2bed	logcli: replaced GRAFANA_* with LOKI_* in logcli env vars, set default server url for logcli to localhost (#1492 ) * replaced GRAFANA_* with LOKI_* in logcli env vars, set default server url for logcli to localhost * add env var details in help text of logcli	6 years ago
Peter Štibraný	49d0d0f0da	Makefile changes to allow easy builds with or without vendoring. Also fixes version bug for both cases. (#1095 ) * Extracted -mod=vendor into a variable * Use ?= to set variable only if not set yet. This enables "MOD_VENDOR= make all" use from command line * Enable/disable vendoring with VENDOR=true or false. Enabled by default * Make go generate use -mod=vendor depending on VENDOR flag * Use GOMOD to specify module version to use. GOMOD can be set to empty string, "vendor", "readonly" and in Go 1.14 to "mod". If not defined, defaults to "vendor". Non empty values are passed to -mod parameter to Go tools, and --modules-download-mode parameter for golangci-cli linting tool. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix versioning info when not using vendoring. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to use Golintci-cli v1.21.0 and Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to version 0.8.0. Changs: Golintci-cli v1.21.0, Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Renamed MOD_VENDOR to MOD_FLAG to better describe its function. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix version info in all command line tools. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use loki-build-image:0.8.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Marco Pracucci	96237b5550	logcli: added --step support to query command (#1103 ) * logcli: added --step support to query command * Changed query range API default step value from 1s to a dynamic value based on start/end input params	6 years ago
sh0rez	794d7da845	feat: -version flag (#1036 ) While we were already setting the version on the built binaries, this now also exposes them as a user-facing flag (`-version`). The already used Prometheus package `github.com/prometheus/common/version` is used for generated the printed string.	6 years ago
Joe Elliott	47637852fb	Logcli: Add Support for New Query Path (#987 ) Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Cyril Tovena	7f3db9d7f0	LogQL: Vector and Range Vector Aggregation. - adds avg,min,max,top,bottomk,stddev,stdvar,count - updates api documentation - adds tests Improve yacc & go lexer to understand duration Remove support for regexp in all queries Clean up querier and logselector	6 years ago
Aditya C S	132989031f	Fix Nolabels parse metrics	6 years ago
Marco Pracucci	e7fb205827	fix(logcli): timestamp timezone handling (#821 ) Logcli used to inconsistently handle timezones in timestamps. This addresses this by adding a new `--timezone` / `-z` flag, to explicitly set the timezone the timestamps shall be formatted in. Furthermore it refactors the output framework inside of logcli to test it easier. Fixes #798	7 years ago
Sandeep Sukhani	459e4e3f4e	Update logcli usage in docs and improve help text	7 years ago
sh0rez	38cb093358	feat(loki): extended tailing (#764 ) * refactor(querier/ingester): TailRequest Lookback window Moves the specifications of the Lookback Window out of the logproto.QueryRequest into it's own type logproto.Lookback. This is required, because the Lookback Window will be used in the TailRequest as well. * feat(querier): parse Lookback from HTTP Request * feat(logcli): send Lookback Window spec with tail request * feat(querier): include historic entries in tail mode Extends tailing by sending a configurable amount of historic entries with before the live entries. This enables a behaviour that is closer to kubectl logs -f and docker logs -f. It is implemented by running a regular Query before subscribing to the ingesters. * fix: adapt tests to Lookback change * feat(querier): check all errors to make the linter happy * fix(logproto): flatten Lookback window spec Flattens the Lookback window spec into the individual queries * fix(ingester): adapt test to Lookback flatten	7 years ago
Edward Welch	da6a13383a	better job of fixing url parsing and host name extraction for logcli	7 years ago
Cyril Tovena	c3e74b3eca	fix path escape (#779 )	7 years ago
Ed	03dc4e63fa	Parse the addr into a URL so we can extract the Host name for use in the TLSConfig (#778 )	7 years ago
Robert Fratto	f74f2c82f4	feat(logcli): add --to flag to specify latest RFC3339 time for query (#776 ) Fixes #774	7 years ago
sh0rez	9d5630d875	feat(logcli): output modes (#731 ) * feat(logcli): quiet mode Adds a quiet mode (-q / --quiet) to suppress the debug messages to stderr * feat(logcli): output modes Adds two alternative output modes (-o / --output) - raw: emits the line as parsed - jsonl: emits the line plus all known metadata as JSONL (JSON Line) Usage: -o [default, raw, jsonl] * feat(logcli): quiet tailing mode * feat(logcli): output modes while tailing Supports the three different output modes in tail mode as well * feat(logcli): print labels in jsonl tail mode * refactor(logcli): clean up entry printing Moves the entry printing into a standardized interface, implements this three times: - default (human readable) - jsonl (for scripts) - raw ('as is')	7 years ago
sh0rez	d43de72f3b	feat(logcli): query from absolute timestamp (#736 ) * feat(logcli): query from absolute timestamp Adds a new flag (`--from`) as to complement `--since`. While since subtracts a relative duration from the current time, from allows to specify the absolute start of the lookback window. Note: `--from` takes precedence over `--since`, but only if set. * fix(logcli): use RFC3339Nano for -from To comply with Prometheus, this flag now honors Nanoseconds as well (was using RFC3339 so far)	7 years ago
Sandeep Sukhani	2a8a03795a	Improvements in live tailing of logs (#541 ) * Improvements in live tailing of logs Instead of polling for new logs, a grpc stream is opened between ingester and querier to get live logs Querier reconnects to disconnected or newly added ingesters * Added more comments to code for live log tailing * Some code refactoring in live log tailing * handling delayfor in logcli, max delayfor to be 5 seconds * some changes in tail response in live tailing * Fixed issue with stopping ingesters gracefully when live tailing is being used * Added tests for tailer in querier * Live tailing made logql compatible, some code refactoring suggested in PR	7 years ago
Sandeep Sukhani	f5c8b22b34	Change tail response for backward compatibilty with future changes (#590 ) Changed it to dict with single key called "streams" and value set to list of logproto.Stream	7 years ago
Cyril Peponnet	7942493524	impr/clients: Handle TLS config and MTLS for logcli and promtail (#540 ) * impr/clients: Handle TLS config and MTLS for logcli and promtail * fix/tls: Please gofmt... * impr/clients: use prometheus HTTPClientConfig for logcli and promtail * fix/promtail: Set proper Client config name * impr/promtail: Use prometheus HTTPClientConfig configuration * adapt with master * address review * fix conflicts * address requested changes * remove file Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	7 years ago
Cyril Peponnet	0885f64e60	impr/logcli: Added label output filters + tests (#563 ) * impr/logcli: Added label filters + tests * Address review * udpate readme	7 years ago
Tom Wilkie	c71a9b0dce	Fix logcli. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago

1 2

80 Commits (fc2bc69eaa46c38d77a9f4cfd0ee1daeecc7e101)