apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Bryan Boreham	77c18d9670	feat(logcli): add --log.level parameter (#19136 )	3 months ago
Trevor Whitney	f38950a02b	feat: add delete commands to logcli (#18375 )	6 months ago
Saya	3286e218b3	feat(logcli): Add timestamp format flag via cli argument for default output (#16672 ) Co-authored-by: Ben McKaig <bmckaig@blackberry.com> Co-authored-by: steelrain74 <ben.mckaig@gmail.com> Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	10 months ago
Jonathan Lange	639ac74c48	feat(logcli): Include common labels (#15611 ) Adds a new `--include-common-labels` flag to logcli query, which causes the output to include all common labels. This is mostly useful with `--quiet` and `--output=jsonl` as it allows users to get structured information from Loki that has all the information that Loki can provide. --- Signed-off-by: Jonathan Lange <jml@mumak.net> Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
renovate[bot]	37d0bb8935	fix(deps): update module gopkg.in/alecthomas/kingpin.v2 to v2.4.0 (#14970 ) Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Paul Rogers <paul.rogers@grafana.com>	1 year ago
Aaron Delaney	c56b95d298	feat: add opt-in support for ProxyFroomEnvironment in logcli (#11742 ) (#14950 )	1 year ago
Jason Tackaberry	4d3f9f5a7b	feat(logcli): add gzip compression option (#14598 ) Passing `--compress` to logcli will enable (or more accurately not disable) compression on the `http.Transport`, allowing Loki to return gzip-compressed payloads. This improves overall execution time and reduces data transfer by 10-15x. Signed-off-by: Jason Tackaberry <tack@urandom.ca>	1 year ago
Trevor Whitney	7983f94b15	feat: detected field values (#14350 )	1 year ago
Paul Rogers	18cef217fc	chore: Linting updates in prep for Go 1.23 (#14071 )	1 year ago
Kaviraj Kanagaraj	88e545fc95	feat(cache): Add `Cache-Control: no-cache` support for Loki instant queries. (#12896 ) Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	2 years ago
Trevor Whitney	210ea93a69	feat: add detected-fields command to logcli (#12739 )	2 years ago
Ed Welch	4c88be0ef2	chore: update loki modules for 3.0 release (#12433 ) Signed-off-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Ashwanth	a118e994d8	Remove shared_store and shared_store_key_prefix from shipper and compactor (#10840 ) What this PR does / why we need it: #### Removes `shared_store` and `shared_store_key_prefix` from index shipper and compactor configs and their corresponding CLI flags. - `-tsdb.shipper.shared-store` - `-boltdb.shipper.shared-store` - `-tsdb.shipper.shared-store.key-prefix` - `-boltdb.shipper.shared-store.key-prefix` - `-boltdb.shipper.compactor.shared-store` - `-boltdb.shipper.compactor.shared-store.key-prefix` `shared_store` has been a confusing option allowing users to easily misconfigure Loki. Going forward `object_store` setting in the [period_config](https://grafana.com/docs/loki/latest/configure/#period_config) (which already configured the store for chunks) will be used to configure store for the index. And the newly added `path_prefix` option under the `index` key in `period_config` will configure the path under which index tables are stored. This change enforces chunks and index files for a given period reside together in the same storage bucket. More details in the upgrade guide. --- `-compactor.delete-request-store` has to be explicitly configured going forward. Without setting this, loki wouldn't know which object store to use for storing delete requests. Path prefix for storing deletes is decided by `-compactor.delete-request-store.key-prefix` which defaults to `index/`. Checklist - [X] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [X] Documentation added - [X] Tests updated - [x] `CHANGELOG.md` updated - [ ] If the change is worth mentioning in the release notes, add `add-to-release-notes` label - [X] Changes that require user attention or interaction to upgrade are documented in `docs/sources/setup/upgrade/_index.md` - [ ] For Helm chart changes bump the Helm chart version in `production/helm/loki/Chart.yaml` and update `production/helm/loki/CHANGELOG.md` and `production/helm/loki/README.md`. [Example PR](`d10549e3ec`)	2 years ago
Trevor Whitney	1584443216	logcli: fix volume routes, add targetLabels and aggregateByLabels (#10059 ) This PR fixes `logcli` to use the new endpoints for volume, which are now `volume` and `volume_range` instead of `series_volume` and `series_volume_range`. This PR also adds support for the additional parameters `targetLabels` and `aggregateBy`.	2 years ago
Trevor Whitney	8aaf5c10a8	add stats, volume, and volume_range commands to logcli (#9966 ) Add `stats`, `volume`, and `volume_range` commands to `logcli`. Does not implement the file client for now. I think it would be cool if in the future the file client could read from a downloaded TSDB index file for these commands.	3 years ago
ndrpnt	afe8f91d0c	logcli: Allow negative filters when omitting stream selector with --stdin (#8566 ) Which issue(s) this PR fixes: Fixes #8565 Special notes for your reviewer: Checklist - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [x] `CHANGELOG.md` updated Co-authored-by: Karsten Jeschkies <karsten.jeschkies@grafana.com>	3 years ago
Angus Dippenaar	5c5b27db50	[logcli] set default instead of error for parallel-max-workers validation (#8641 ) What this PR does / why we need it: Fixes regression reported here: https://github.com/grafana/loki/pull/8518#issuecomment-1446014229 @dannykopping can you please verify that it fixes the issue for you? Checklist - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	3 years ago
Angus Dippenaar	42522d794a	logcli: Add parallel flags (#8518 )	3 years ago
Karsten Jeschkies	1875a1d6d8	Fetch all entries with logcli if limit==0. (#8537 )	3 years ago
Kaviraj Kanagaraj	cbd6ec15ce	feat(logql): Supporting prettifying LogQL expressions (#7906 ) What this PR does / why we need it: Changes 1. Added `Pretty()` method to `Expr` interface. So that every expression would know how to render themselfs as pretty :) 2. Implemented `Pretty()` for every single LogQL expressions 3. Exposed `/api/v1/format_query` endpoint that takes `query` argument and returns formatted version. 4. Integerated into `logcli`. echo `'<query>' \| logcli fmt` would format the query. Why? 1. Readability, helpful in debugging and more importantly, to understand the execution flow example before ``` quantile_over_time(0.99,{container="ingress-nginx",service="hosted-grafana"}\| json\| unwrap response_latency_seconds\| __error__=""[1m]) by (cluster) ``` ``` sum(rate({job="loki", namespace="loki", cluster="loki-dev-us"} \|= "err" [5m])) + sum(rate({job="loki-dev", namespace="loki", cluster="loki-dev-eu"}\|logfmt \| level != "info" [5m])) / sum(rate({job="loki-prod", namespace="loki", cluster="loki-prod-us"} \|logfmt \| level="error"[5m])) ``` ``` label_replace(rate({job="api-server",service="a:c"}\|= "err" [5m]), "foo", "$1", "service", "(.):.") ``` after ``` quantile_over_time( 0.99, {container="ingress-nginx", service="hosted-grafana"} \| json \| unwrap response_latency_seconds \| __error__="" [1m] ) by (cluster) ``` ``` sum( rate( {job="loki", namespace="loki", cluster="loki-dev-us"} \|= "err" [5m] ) ) + sum( rate( {job="loki-dev", namespace="loki", cluster="loki-dev-eu"} \| logfmt \| level!="info" [5m] ) ) / sum( rate( {job="loki-prod", namespace="loki", cluster="loki-prod-us"} \| logfmt \| level="error" [5m] ) ) ``` ``` label_replace( rate({job="api-server", service="a:c"} \|= "err"[5m]), "foo", "$1", "service", "(.):." ) ``` You can find more examples in the `prettier_test.go` Future plans * Integerate into LogQL analyzer * Integrate into Grafana UI. Which issue(s) this PR fixes: Fixes # NA Special notes for your reviewer: This whole idea was inspired from last [PromCon lighting talk](https://youtu.be/pjkWzDVxWk4?t=24469) Checklist - [x] Reviewed the `CONTRIBUTING.md` guide - [x] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Christian Simon <simon@swine.de>	3 years ago
Travis Patterson	af899dcc00	Retry pr (#7579 ) This is the same PR as https://github.com/grafana/loki/pull/7152 but I botched the merge when updating the code. This one works Co-authored-by: Arseniy Antonov <arseny.antonov@gmail.com> Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz>	3 years ago
Javad Hajiani	543b462364	Add missing environment variable names on logcli flags description (#6865 )	3 years ago
Michel Hollands	527b658cc1	logcli: add flag to read remote schema configs (#6539 ) * Add flag to read remote schema Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix lint imports Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Trigger CI * Trigger CI * Addresss review comment Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	4 years ago
joe miller	6d11a1507b	logcli: add --proxy-url flag for http/https proxy support (#6484 ) Add `--proxy-url` flag to `logcli` to support connecting to Loki instances running behind either HTTP or HTTPS CONNECT-style proxies. Examples: http proxy: ``` logcli \ --addr="http://loki-distributed-querier.loki.svc.cluster.local.:3100/" \ --proxy-url "http://envoy.dom.tld" \ query '{app"foo"}' ``` https proxy with mTLS auth: ``` logcli \ --addr="https://loki-distributed-querier.loki.svc.cluster.local.:3100/" \ --proxy-url "https://envoy.dom.tld" \ --cert tls.crt \ --key tls.key \ --ca-cert ca.crt \ query '{app"foo"}' ``` Note that tail (`-f`) support and https proxies only works with a fork of the `gorilla/websocket` lib. There are open PRs that promise to add support for https proxies such as: https://github.com/gorilla/websocket/pull/740 Add the following to `go.mod` to use the fork with https support: ``` replace github.com/gorilla/websocket v1.4.2 => github.com/philipatl/websocket v1.4.3-0.20211206152948-d16969baa130 ```	4 years ago
Marco Cadetg	aa3f06f36b	update auth header env variable usage help (#6169 )	4 years ago
Marco Cadetg	73b39a97bc	specify logcli authorization header by flag (#6164 ) * specify logcli authorization header by flag #6144 * default AuthHeader to Authorization in client lib * use constant for default auth header * for consistency use LOKI_AUTH_HEADER	4 years ago
Alex Tomic	3bf2efa371	logcli: Remove port from TLS server name when provided in --addr (#5477 ) If connecting to a TLS secured endpoint with an explicit port, ensure that ServerName contains only the host and not the port to avoid a cert validation failure	4 years ago
Kaviraj	5b5d469038	Support `X-Query-Tags` in LogCLI (#5145 ) * Add support for `--query-tags` LogCLI Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Split it into helper func Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Cleanup the tests Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix linter Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix `getHTTPRequestHeader()` in test assert Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Kaviraj	94113ee080	Logql `stdin` support only log queries (#4606 ) * Hack stdin client into LogCLI Add flag to choose what kind of client to make request to. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Label filter working Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Demo checkpoint1 Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Metrics query working. Issue was with default value of `step` (1 nanosecond). StepEvaluator try to go through every nanosecond to apply aggregate on sample data during the metric queries. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Basic tests for fileClient * Tests for logqueries direction * Use HeapIterator for Entries. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove some debug statements Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove support for metric queries. Stick with only log queries Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Small rough usage doc * Remove filesampleiterator * Fix some typos and tests * Fix breaking test cases Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make linter happy Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks. 1. Add `--stdin` in examples of the usage 2. Add `--stdin` in all the command help output * PR remarks - Use parsed labels correctly - Fix indendation with --stdin flag * Fix issue with direction * Fix linter * MaxInt64 -> MaxInt (to support even arm32 images) * Add note on calculating `step` value on the client side	4 years ago
Mateusz Gozdek	b3df9f5dfd	cmd/logcli: add --follow flag as an alias for --tail (#4203 ) When using 'logcli query --tail', '--tail' behaves similar to the 'tail' command, which uses '--follow' flag, if you want to continuously follow the appended data to the file. I believe '--follow' flag is more natural for system administrators to use rather than '--tail' if one wants to "follow" the incoming logs, so this commit adds one, as an alias for '--tail'. Closes #3570 Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>	4 years ago
vyzigold	67b6c1aac8	logcli: Add retries to unsuccessful log queries (#3879 ) * Add retries to unsuccessful log queries.	5 years ago
dbluxo	88708d4b22	added support for bearer token authentication (#3749 )	5 years ago
Ed Welch	6e67d1ea5d	Loki/Promtail: Client Refactor (#3623 ) * move docker driver * move fluent-bit output plugin * move fluentd plugin * move logstash plugin * move promtail * match stage uses simple logql label matcher and filter expressions only * remove remaining logql imports * remove helpers package and move contents to util package * move validation and runtime out of util package * fix imports * move build and cfg packages into util * move ParseRequest function to util package * create a new package for logql models and move marshal/unmarshal code to util folder * move ErrorLabel to logqlmodel * move stats package to logqlmodel * decouple loghttp from logql by moving validation to logql package * move gcplog to tools * move PackedEntryKey constant to logqlmodel * fix stats proto import and rebuild protos * fix windows promtail tests * update drone to new dockerfile locations	5 years ago
Chance Zibolski	054b8fcc91	logcli: Refactor logcli Client interface to use time.Time and time.Duration for LiveTailQueryConn method (#3271 )	5 years ago
Michał Sochoń	3bb7f52f1f	Fix: Update docs for logcli (#3212 ) * Update docs for logcli Fix description for logcli, use proper flag names. Extend docs with example using timestamp. Signed-off-by: Michał Sochoń <kaszpir@gmail.com> * Update cmd/logcli/main.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	5 years ago
Yuichi Sawada	27dddef475	Fix logcli logql document url (#2968 )	5 years ago
Tom Wilkie	1c8dd3e11a	Add a few more instructions to logcli --help. (#2948 ) Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	5 years ago
Davor Kapsa	fffcfa6e81	fix some misspells (#2725 )	5 years ago
Ed Welch	82845e4f78	Adds --analyize-labels to logcli series command. (#2497 ) Changes the series command to use the common matcher input found in the query and instant-query commands, instead of `logcli series --matcher='{foo="bar"}'` it's now `logcli series '{foo="bar"}'`	5 years ago
Ed Welch	80693cae6f	Logcli: automatically batch requests (#2482 ) * first stab at batching logcli requests * fix other calls to printResult * working batching code * refactor the logcli Client into an interface so that it can be mocked for testing. * fixing some bugs * refactoring the output interface to make testing easier * starting to add tests * adding a bunch of tests fixing up how the MockQuerier works. * updating docs * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>	5 years ago
Aditya C S	68568f141e	colored labels output for logcli (#2470 ) * colored labels output for logcli * add period to all cli description	6 years ago
Cyril Tovena	1e19aa4715	Add performance profile flags for logcli. (#2248 ) * Add performance profile flags for logcli. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update the logcli documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove comment. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove unused import. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	360d9a7f97	Support querying labels on time range in logcli (#2083 )	6 years ago
Ed Welch	c7a1a1fb2e	Loki: Adds an `interval` paramater to query_range queries allowing a sampling of events to be returned based on the provided interval (#1965 ) * Adds an `interval` paramater to query_range queries allowing a sampling of events to be returned based on the provided interval Signed-off-by: Ed Welch <edward.welch@grafana.com> * lint Signed-off-by: Ed Welch <edward.welch@grafana.com> * extract function for parsing parameter Signed-off-by: Ed Welch <edward.welch@grafana.com> * Clarify the experimental nature of interval in the docs. Signed-off-by: Ed Welch <edward.welch@grafana.com> * make min time a constant Signed-off-by: Ed Welch <edward.welch@grafana.com> * Expand the docs around the experimental nature of interval a little more Signed-off-by: Ed Welch <edward.welch@grafana.com>	6 years ago
Mario Constanti	2c8251f1c9	logcli: org-id/tls-skip-verify set via env var (#1922 ) * command line flags --org-id and --tls-skip-verify could be also set via environment variables `LOKI_ORG_ID` and `LOKI_TLS_SKIP_VERIFY`	6 years ago
Ben Ye	9a62deb829	Support series API in logcli (#1861 ) * support series API in logcli Signed-off-by: yeya24 <yb532204897@gmail.com> add changelog Signed-off-by: yeya24 <yb532204897@gmail.com> * update logcli docs Signed-off-by: yeya24 <yb532204897@gmail.com>	6 years ago
Robert Fratto	8948ce1f2e	clarify logcli commands and output (#1712 ) * clarify logcli commands and output This commit attempts to do two things: 1. Differentiate between log entries and raw log lines, where the latter is what is produced by `-oraw`. 2. Explain the difference between `logcli query` and `logcli instant-query`. Fixes #1676. * address feedback * address more feedback * explain that instant-query is not useful for log lines * address review feedback This commit leaves logcli.md unmodified; that will be done in a later commit if the changes are approved. * sync logcli.md with command output	6 years ago
Cyril Tovena	ba51aad551	Logcli remote storage. (#1814 ) * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Start hooking logcli with local storage config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes org-id and documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Aditya C S	f9ff2a4b02	Add goimport local-prefixes configuration to .golangci.yml (#1710 )	6 years ago
Aditya C S	636ed15c65	Fix logcli --quiet parameter parsing issue (#1682 )	6 years ago

1 2

94 Commits (9d0d1084e39fdfd4a58d701b13ff755f4e5f36eb)