apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
J Stickler	8e59fcac91	Update redirects to use new alias format. (part 2 of 2) (#9890 ) Breaking the alias updates into two PRs to make for smaller reviews. Special notes for your reviewer: @jdbaldry commented on #9717 that the alias format had changed, but we [agreed](https://github.com/grafana/loki/pull/9717#issuecomment-1594960563) that I could update it in a follow up PR. This is that follow up. Also updating previously merged file moves that used the old alias format. <strike>I could not get relative redirects to work for the LIDS or Maintaining files, so had to use the older format, which did work.</strike> Updated weights for some pages. Updated a couple of `menuTitles` that I missed updating on previous PRs. --------- Co-authored-by: Jack Baldry <jack.baldry@grafana.com>	2 years ago
J Stickler	11e2375e6d	Removing 'please' from the docs. (#9658 ) Which issue(s) this PR fixes: Fixes #8922 Special notes for your reviewer: This is to conform with our Style Guide. https://developers.google.com/style/tone#politeness-and-use-of-please	2 years ago
Jack Baldry	8391e557b1	Update doc-validator to v3.0.0 (#9666 ) ## 3.0.0 ### Added - Structured output for use with [`reviewdog`](https://github.com/reviewdog/reviewdog). You can achieve the original error output by piping the output to the following `jq` expression: `jq -r '"ERROR: \(.location.path):\(.location.range.start.line):\(.location.range.start.column): \(.message)"'`. - Suggestions for simple link fixes. In GitHub, [`reviewdog`](https://github.com/reviewdog/reviewdog) comments these suggestions for convenient replacement. - Support for anchors referring to repeated headings. In the case that a page has multiple headings that share the same text, the renderer appends a zero indexed, numbered suffix to the identifier. For example, when there are two headings that are both "Heading text", the first anchor identifier is `heading-text` and the second is `heading-text-1`. - Error when running `doc-validator` on no files. Notes for reviewer: This also updates the `make-docs` procedure. Please ensure you can run `make docs` from the `docs/` directory before approving and merging this PR. --------- Signed-off-by: Jack Baldry <jack.baldry@grafana.com>	2 years ago
indX	a55404766c	Logging: Add HTTP API to change the log level at runtime (#9357 ) What this PR does / why we need it: To be able to change the log level at runtime, particularly from info to debug to enable debugging information during an incident without restarting Loki. Which issue(s) this PR fixes: Fixes #6805 Special notes for your reviewer: Checklist - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [x] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [x] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`: No such changes --------- Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
J Stickler	1bb489c438	TOC Sync: Move LogQL and LogCLI files under Query. (#9200 )	2 years ago
J Stickler	8ee9a2c3c7	TOC Sync: Move API docs under Reference. (#9203 ) Which issue(s) this PR fixes: Fixes #8719 Special notes for your reviewer: Part of the Database products table of contents alignment project. Moves API doc under Reference heading in TOC. Updates front matter for the topic. Fixes links broken by the move. Adds aliases for redirects.	2 years ago
Mitsuru Kariya	185b2b089d	Docs: Fix API document (#9210 ) What this PR does / why we need it: Remove /ready and /metrics from API list of the querier and the query frontend because they are exposed by all components. Remove /loki/api/v1/push from API list of the querier and the query frontend because it is exposed by distributor. Move /api/prom/push from API list of the querier and the query frontend to API list of the distributor because it is exposed by distributor. Add /api/prom/series to API list of the querier and the query frontend. Change reference to /loki/api/v1/label to /loki/api/labels because former is not documented. Which issue(s) this PR fixes: Special notes for your reviewer: Checklist - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Signed-off-by: Mitsuru Kariya <mitsuru.kariya@nttdata.com>	2 years ago
Alain Pham	ca51127592	POST /loki/api/v1/push should not be on query path (#9220 ) POST /loki/api/v1/push is on the write path on the distributor and should not be the query frontend (read path)	2 years ago
Michel Hollands	abd6131bba	Update prepare shutdown (#9175 ) What this PR does / why we need it: This updates the PrepareShutdown method so it supports GET and DELETE methods as well. This makes it similar to Mimir: https://github.com/grafana/mimir/pull/4718. The status is now stored in a local file. A new config setting had to be added for this file as there is no obvious place to store it. Checklist - [X] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [X] Documentation added - [X] Tests updated - [x] `CHANGELOG.md` updated - [x] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Signed-off-by: Michel Hollands <michel.hollands@grafana.com> Co-authored-by: Dylan Guedes <djmgguedes@gmail.com>	2 years ago
René Scheibe	e050d5c494	Docs: Update Loki GitHub URLs (#9080 ) * use `main` instead of `master` branch * fix outdated URLs	2 years ago
Kaviraj Kanagaraj	cce3d3bed9	chore(format_query): Change response type to `application/json` (#9016 )	2 years ago
Gábor Farkas	09f23ecd03	Docs: Improve time range documentation (#8847 ) What this PR does / why we need it: Describes how exactly the `start` and `end` timestamps operate on the time range boundaries. Checklist - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [x] Documentation added --------- Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
Periklis Tsirakidis	1bcf683513	Expose optional label matcher for label values handler (#8824 )	2 years ago
Dylan Guedes	53b9a351e5	Loki: Add a `prepare-shutdown` endpoint (#8786 ) What this PR does / why we need it: Add a new `/ingester/prepare_shutdown` endpoint. This new endpoint configures the ingester to release resources on the next SIGTERM. --------- Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
Jack Baldry	3cb15d62d5	Docs: Add doc-validator tool to lint technical documentation (#6569 ) Source code: https://github.com/grafana/technical-documentation/tree/main/tools/doc-validator Signed-off-by: Jack Baldry <jack.baldry@grafana.com> What this PR does / why we need it: Adds a CI step for pull requests that validates links in technical documentation and performs linting of technical documentation source files. Special notes for your reviewer: - Lots of issues will need to be fixed before we can merge this. - The tool is still in early development so each error should be scrutinized for validity. Checklist - [ ] Documentation added - [na] Tests updated - [na] Is this an important fix or new feature? Add an entry in the `CHANGELOG.md`. - [na] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Signed-off-by: Jack Baldry <jack.baldry@grafana.com>	2 years ago
Ed Welch	2b66c6b126	Loki: add a 'since' query parameter for easier querying using relative time (#7964 ) Signed-off-by: Edward Welch <edward.welch@grafana.com> What this PR does / why we need it: logcli has a command line parameter called `since` which makes it easy to query logs relative to the current time, however this is some syntactic sugar used in logcli to calculate `start` and `end` query parameters for the query sent to Loki. This PR adds native support for a `since` query parameter to make it a little easier to consume the Loki query API without having to calculate precise start/end times with every request. This is useful if you are polling the Loki API from a third party app which doesn't let you easily build dynamic URL's and all you want to do is poll for say the last 3 hours of logs. Which issue(s) this PR fixes: Fixes #<issue number> Special notes for your reviewer: Checklist - [x] Reviewed the `CONTRIBUTING.md` guide - [x] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	2 years ago
Kaviraj Kanagaraj	cbd6ec15ce	feat(logql): Supporting prettifying LogQL expressions (#7906 ) What this PR does / why we need it: Changes 1. Added `Pretty()` method to `Expr` interface. So that every expression would know how to render themselfs as pretty :) 2. Implemented `Pretty()` for every single LogQL expressions 3. Exposed `/api/v1/format_query` endpoint that takes `query` argument and returns formatted version. 4. Integerated into `logcli`. echo `'<query>' \| logcli fmt` would format the query. Why? 1. Readability, helpful in debugging and more importantly, to understand the execution flow example before ``` quantile_over_time(0.99,{container="ingress-nginx",service="hosted-grafana"}\| json\| unwrap response_latency_seconds\| __error__=""[1m]) by (cluster) ``` ``` sum(rate({job="loki", namespace="loki", cluster="loki-dev-us"} \|= "err" [5m])) + sum(rate({job="loki-dev", namespace="loki", cluster="loki-dev-eu"}\|logfmt \| level != "info" [5m])) / sum(rate({job="loki-prod", namespace="loki", cluster="loki-prod-us"} \|logfmt \| level="error"[5m])) ``` ``` label_replace(rate({job="api-server",service="a:c"}\|= "err" [5m]), "foo", "$1", "service", "(.):.") ``` after ``` quantile_over_time( 0.99, {container="ingress-nginx", service="hosted-grafana"} \| json \| unwrap response_latency_seconds \| __error__="" [1m] ) by (cluster) ``` ``` sum( rate( {job="loki", namespace="loki", cluster="loki-dev-us"} \|= "err" [5m] ) ) + sum( rate( {job="loki-dev", namespace="loki", cluster="loki-dev-eu"} \| logfmt \| level!="info" [5m] ) ) / sum( rate( {job="loki-prod", namespace="loki", cluster="loki-prod-us"} \| logfmt \| level="error" [5m] ) ) ``` ``` label_replace( rate({job="api-server", service="a:c"} \|= "err"[5m]), "foo", "$1", "service", "(.):." ) ``` You can find more examples in the `prettier_test.go` Future plans * Integerate into LogQL analyzer * Integrate into Grafana UI. Which issue(s) this PR fixes: Fixes # NA Special notes for your reviewer: This whole idea was inspired from last [PromCon lighting talk](https://youtu.be/pjkWzDVxWk4?t=24469) Checklist - [x] Reviewed the `CONTRIBUTING.md` guide - [x] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Christian Simon <simon@swine.de>	2 years ago
Kaviraj Kanagaraj	4768b6d997	doc(api): Default value for `delete_ring_tokens` on `/ingester/shutdown` endpoint (#7921 ) Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> What this PR does / why we need it: PR documents the default value for `delete_ring_tokens` params on `/ingester/shutdown` endpoint. Which issue(s) this PR fixes: Fixes #NA Special notes for your reviewer: Checklist - [x] Documentation added Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	2 years ago
Travis Patterson	ef47e0ee8a	Fix errors loading deletes after force-removing partially-completed delete (#7125 ) When sharded deletes that are partially completed are force-removed, everything is removed except the shards that are currently being deleted. The shards being deleted aren't necessarily in numerical order so there's no way to know assume which shards have and haven't been deleted. The Delete store assumed it could look up requests in sequential order and returned empty requests where there were gaps in the stored data. This change takes the `sequence number` from the stored key of the delete requests it finds and uses that to look up details.	3 years ago
Michel Hollands	ebdb64b3f5	Small updates to the deletion documentation (#7112 ) What this PR does / why we need it: - Fix a typo - Fix the links in for the deletion API Checklist - [X] Documentation added - [ ] Tests updated - [ ] Is this an important fix or new feature? Add an entry in the `CHANGELOG.md`. - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Ursula Kallio	8da290cd2d	Use backticks for code syntax. (#6967 ) * Use backticks for code syntax. * Fix for real. :)	3 years ago
Travis Patterson	e15da437f0	Shard deletes requests based on time ranges (#6903 ) * Refactor the store API to be in terms of DeleteRequest * backfill remove tests * backfill GetAll tests * Make the delete request store deal in groups of requests instead of single ones * Make cancelation aware of request groups * remove cancelation deadline * shard deletes based on a query parameter * merge request group on gets * global configuration for max query range * sort delete requests by start time so batches are grouped to similar chunks * Fix status when some deletes haven't happened yet * fix tests * Review feedback * review feedback * make max_interval > deletion interval a validation error * list partially completed deletes * list partially completed deletes * fix flaky test * clarify naming * disallow cancelation of partial deletes unless the 'force' flag is passed * more comment specificity for the delete request hash	3 years ago
Travis Patterson	983ab80e7c	Add delete api validations (#6860 ) * break out the middleware * Add validation to the API - Time must be in RFC3339 or a 10-digit-unix-seconds timestamp - Start time must always exist * lint * docs * improve tests * cleanup * cleanup * access runtime config via function on validation	3 years ago
Karen Miller	5b432e3d99	Docs: Fix bad links in the API section (#6688 ) * Docs: Fix a bad link in the API section * Fix 2 more of the same bad link	3 years ago
Karen Miller	1f676adf06	Add API delete curl examples (#6680 ) * Add API delete curl examples * Update docs/sources/api/_index.md Co-authored-by: Jennifer Villa <jvilla2013@gmail.com> * Update docs/sources/api/_index.md Co-authored-by: Jennifer Villa <jvilla2013@gmail.com> * Update docs/sources/api/_index.md Co-authored-by: Jennifer Villa <jvilla2013@gmail.com> * Update docs/sources/api/_index.md Co-authored-by: Jennifer Villa <jvilla2013@gmail.com> Co-authored-by: Jennifer Villa <jvilla2013@gmail.com>	3 years ago
Karen Miller	92aa69bb5c	Docs: Add multi-tenant query curl examples (#6530 ) * Docs: Add multi-tenant query curl examples * Revise per review suggestions.	3 years ago
Karen Miller	27477bf5f5	Docs: improve API docs (#6485 ) * Docs: improve API docs * Implement review suggestions.	3 years ago
Christian Haudum	c12a1f4f43	feature: Add ingester handler for shutdown and forget tokens (#6179 ) * Update grafana/dskit to 07166f9 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add /ingester/shutdown handler This handler replaces the deprecated /ingester/flush_shutdown handler and can be used to gracefully shut down a Loki instance and delete the file that persists the tokens of the ingester ring. In production environments you usually want to persist ring tokens so that during a restart of an ingester instance, or during rollout, the tokens from that instance are not re-distributed to other instances, but instead kept so that the same streams end up on the same instance once it is up and running again. For that, the tokens are written to a file that can be specified via the `-ingester.tokens-file-path` argument. In certain cases, however, you want to forget the tokens and re-distribute them when shutting down an ingester instance. This was already possible by calling `/ingester/flush_shutdown`, deleting the tokens file and terminating the process. The new handler `/ingester/shutdown` combines these manual steps into a single handler. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add changelog entry Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Owen Diehl	3f4a663dbe	Tsdb/index sampling endpoint (#6347 ) * index sampling endpoint * fix bug in withTenantLabelMatcher * show zero values in stats * handles new errcase * fixes comments	3 years ago
Gábor Farkas	0075085e9a	docs: describe ordering in http query results (#6024 ) * docs: describe ordering in http query results * improved text Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * better text Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * better text Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Michel Hollands	f39552c7fa	Add docs for updated deletion api (#5763 ) * Add docs for updated deletion api Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix parameter name Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Clarify that only the delete requests for the current tenant are shown Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update docs/sources/api/_index.md Co-authored-by: Christian Simon <simon@swine.de> * Update docs/sources/operations/storage/logs-deletion.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Update docs/sources/operations/storage/logs-deletion.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Update docs/sources/operations/storage/logs-deletion.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Specify all delete endpoints use authentication Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add description of delete modes Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Christian Simon <simon@swine.de> Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Danny Kopping	8838530976	Document `/services` API endpoint (#6111 ) * Documented /services API endpoint Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Grammar Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Gábor Farkas	0a68bd2d4e	docs: update the labels timespan info (#6019 ) * docs: update the labels timespan info * updated docs Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * updated docs Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Alexandre de Verteuil	149227b889	Minor fixes in docs/sources/api/_index.md (#5915 )	3 years ago
Gábor Farkas	d74fc2c06d	Docs: update documentation about "limit" param (#5540 )	3 years ago
Karen Miller	6f46a8ffeb	Docs: Fix links and formatting of HTTP API page (#5498 )	3 years ago
Dylan Guedes	c3edeac990	Docs: fix link reference to "Step vs Interval" section. (#5495 )	3 years ago
Karsten Jeschkies	ead9444d78	Document all support API timestamp formats. (#5439 ) Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Karsten Jeschkies	5f07e95fc8	Document query limit parameter default. (#5133 )	3 years ago
Susana Ferreira	191a8a6f9d	Store metrics queueTime in seconds (#5052 ) * Store metrics queueTime in seconds * Address comments * Helper function to convert seconds to nanoseconds	3 years ago
Susana Ferreira	82f8f3c1e5	Log time in queue per request (#4949 ) * Log time in queue per request * Add querierID to log message * Add unescape request url and tenant_ids to log message * Add query enqueue time to metrics.go * Remove "querier request dequeued" log from scheduler * Address comments * Rename enqueue_time to queue_time * Store queue time in nanoseconds (int64) * Use CanonicalMIMEHeaderKey for setting the httpgrpc header	3 years ago
Dylan Guedes	98ecfefd89	Add distributor ring page (#4938 ) * Implement new IngestionRateStrat Enum. - This new IngestionRateStrat is used internally to represent the chosen ingestion rate strategy, to avoid using plain strings. * Add a ring to the distributor. As of now, the distributor only has a pointer to its lifecycler. Since the ring HTTP handler isn't implemented for the lifecycler but it is for the ruler, this extends the distributor by also holding a ring instance. * Implement /distributor/ring page. * Reuse existing global strat const. * Add distributor ring HTTP page tests. * Add missing CHANGELOG entry. * Document missing ring status pages. * Fork Cortex util/http.go into source code.	3 years ago
Karen Miller	35ebe967ea	Docs: fix broken links (#4770 ) * Docs: fix broken links * Docs: fix another link name	4 years ago
Ed Welch	3fef08ca1a	2.4 release notes, changelog, upgrade guide (#4658 ) * update changelog, release notes, and upgrade guide for 2.4 * tweak release notes a little * make path relative for kafka config * update upgrade guide * more docs fix the cache size not applied to results cache. * fix prefix name in ring_config	4 years ago
Karen Miller	24accf6a5b	Docs: correctly represent product name (#4416 ) The product name is Grafana Loki. The first use of the product name on each web page should be the full product name. After that, within each page, it is fine to use just Loki. This PR also set up some frontmatter with weights where it was missing on a few files, and correct where "Loki" was not capitalized.	4 years ago
Danny Kopping	66b1d2c822	Reimplementing change from @jacobsakran (#4310 ) I merged their change before the CLA was signed. We reverted that in #4299 and now I'm reopening Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Danny Kopping	ede12d8435	Revert "Bug fixed in line 643 (#4298 )" (#4299 ) This reverts commit `598cad896e`.	4 years ago
jacobsakran	598cad896e	Bug fixed in line 643 (#4298 ) The command: curl -G -s "http://localhost:3100/api/prom/query" --data-urlencode '{foo="bar"}' \| jq gives the message: parse error: Invalid numeric literal at line 1, column 6 Instead, the command: curl -G -s "http://localhost:3100/api/prom/query" --data-urlencode 'query={foo="bar"}' \| jq, works	4 years ago
Ivana Huckova	c9cdd44e13	Update _index.md (#4277 )	4 years ago
Karen Miller	11a0d28b61	Docs: first draft, Loki accepts out-of-order writes (#4237 ) * Docs: first draft, Loki accepts out-of-order writes * Update docs/sources/architecture/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago

6 Commits (79b6c4687d9f57d2520f5386fb52b5f8bbc6aebc)