2310 Commits (af452047d32bd88971307146814e5e82b2bbabda)

 

All Branches   

Search

Author	SHA1	Message	Date
Karen Miller	551b1530da	Docs: remove duplicated arch info from the overview section (#3873) ... * Docs: remove duplicated arch info from the overview section * Update docs/sources/architecture/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update docs/sources/architecture/distributor.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Danny Kopping	8788ddb8d6	Ruler: documentation for recording rules (#3851) ... * Documenting recording rules Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Minor tweaks Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Correcting text Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Update docs/sources/rules/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Sandeep Sukhani	12d418b7cc	docs for logs deletion feature (#3826) ... * docs for logs deletion feature * update doc Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Cyril Tovena	bdee4a3741	Logs ingester and store queries boundaries. (#3849) ... example: ``` ts=2021-06-14T08:43:30.015895283Z caller=spanlogger.go:87 org_id=4336 traceID=0b6bb74a53efd739 level=debug msg="querying ingester" params="selector={stream=\"stdout\", pod=\"loki-canary-6 64d9d8d8f-99k22\"}, direction=BACKWARD, start=2021-06-14 08:17:03.037241855 +0000 UTC, end=2021-06-14 08:17:23.037241855 +0000 UTC, limit=1000, shards=" ts=2021-06-14T08:43:30.016305592Z caller=spanlogger.go:87 org_id=4336 traceID=0b6bb74a53efd739 level=debug msg="querying store" params="selector={stream=\"stdout\", pod=\"loki-canary-664d 9d8d8f-99k22\"}, direction=BACKWARD, start=2021-06-14 08:17:03.037241855 +0000 UTC, end=2021-06-14 08:17:23.037241855 +0000 UTC, limit=1000, shards=" ``` Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	59bb6d3fba	LogQL: Pattern Parser (#3837) ... * The beginning of a fun story. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Working on adding ragel. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adding AST parsing with Yacc and Ragel. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Got a pattern parser working. Reworking ast to works with bytes and not runes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Setup tests and the matches algorithm. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * moar tests case. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add some validation for the pattern expression. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Hooking to LogQL + performance boost. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve bound check. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes generated files from being linted. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/logql/_index.md Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Update docs/sources/logql/_index.md Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Review feedback Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/logql/_index.md Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Docs suggestions Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Nolan Crooks	6d026d211d	[Docs] Minor tweaks (#3846)	4 years ago
Cyril Tovena	f8dcf47ad3	Fixes Loki reads dashboard. (#3854) ... Recently realized the latency for ingester isn't working. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Trevor Whitney	de93a1bd54	Promtail: add consul agent service discovery (#3834) ... * working prototype Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * update test for new responses and metadata labels Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * fix linting issues Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * clarify license/copyright/attribution to prometheus code Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * undo changes to go.sum when adding consul dep Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add documentation around consul and consulagent scrape configs Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Ed Welch <edward.welch@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Kaviraj	450d91555b	Add explicit `main` to pull loki and promtail to install it via Tanka (#3848) ... Rationale is, by default `jb` command, assumes `master` branch, but Loki repo renamed the `master` to `main` branch.	4 years ago
Sandeep Sukhani	d362df7a98	ignore download of missing boltdb files possibly removed during compaction (#3563)	4 years ago
Bpaddyswk	7d666cceb2	lz4: update lz4 version to v4.1.7 to avoid possibly panic (#3835) ... * lz4: update lz4 version to v4.1.7 to avoid possibly panic * lz4: add lz4 v4.1.7 to vendor	4 years ago
Julien Duchesne	69e38a3b5e	Add step to identify windows Drone runner (#3832) ... I'm migrating our agents to GCP, I want to make sure it's working	4 years ago
Cyril Tovena	7e658e8766	Fixes a flaky retention test. (#3833) ... This was due because the condition was using a string array that may be not in correct order. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Sergey Kranga	22c4b072a0	fix template example for regexReplaceAll function (#3576) ... Fixes an example for `regexReplaceAll` template function: - use correct function name - add missing $ sign when referencing a regex submatch	4 years ago
Julien Duchesne	6f5e6b637b	Fix broken link in `Windows Event Log` scraping docs (#3828)	4 years ago
Sandeep Sukhani	cd38e987d8	Logs deletion fixes (#3827) ... * fix temp file suffix in delete requests table * log error on failure in removal of temp file only when the error is not os.IsNotExist * fix the cli flag for delete requests cancellation period	4 years ago
Karen Miller	0d27c21dd4	Doc updates: (#3823) ... - Revise section titles - Add weight metadata to specify ordering of subsections - Remove TOC info from content prose, as it is already in the right side navigation panel - Remove a redundant section about upgrading.	4 years ago
Karen Miller	82cd54722a	Docs: add and order missing design docs (#3824)	4 years ago
dbluxo	88708d4b22	added support for bearer token authentication (#3749)	4 years ago
Thomas Belian	ddbf04f64c	Change redis configuration value for enabling TLS to correct syntax (#3798) ... enable_tls: true doesn't work and this syntax is taken from cortex documentation, works, and is tested with AWS ElastiCache Redis cluster	4 years ago
Danny Kopping	110ff6fb9e	Extracting queue interface (#3816) ... Exporting metrics entry type Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
manu	6ba49f43ae	fixed typo (levels -> labels) (#3815)	4 years ago
Kaviraj	f980febd97	Update the docker-driver doc about default labels (#3814) ... * Update the docker-driver doc about default labels Add more information on `container_name` default label and when it will be added to log line. * Update docs/sources/clients/docker-driver/configuration.md Co-authored-by: Rui Lopes <rgl@ruilopes.com> * Make it clear when to use pipeline_stages vs relabelling on docker-driver Co-authored-by: Rui Lopes <rgl@ruilopes.com>	4 years ago
Danny Kopping	3642face57	Allowing for multiple defined targets (#3807) ... Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Cyril Tovena	71677dbc8f	Retention doc (#3775) ... * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finish docs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Addresses Karen's feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/operations/storage/retention.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/storage/retention.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/storage/retention.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/storage/retention.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Aleg Malinovsky	1d14ff0b10	Update _index.md (#3810) ... duplicated word	4 years ago
Sandeep Sukhani	c3af249fe0	add a dashboard for log deletion requests in loki (#3794)	4 years ago
Danny Kopping	0bf7b608d4	Exposing remote writer for use in integration tests (#3797) ... Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Cyril Tovena	f4bdf5db4e	Update README.md (#3503) ... * Update README.md Add oss-fuzz badge. * Update README.md	4 years ago
李国忠	6be2fb0aed	[doc] mtric -> metric (#3578)	4 years ago
Sparkle	df06ba088c	upgrade the fluent-bit to latest version (#3793)	4 years ago
Michel Hollands	3c47735dea	Add a QueryFrontendTripperware module (#3792) ... Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	4 years ago
Karen Miller	3940f059f0	Docs: remove unnecessary lists of sections (#3790) ... Links to the sections are in the right side navigation panel.	4 years ago
Danny Kopping	babed450c7	Ruler: Recording Rules (#3766) ... * WIP: hack to get recording rules working and pushing to Cortex/Prometheus Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Refactoring Adding remote_write config for ruler Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Minor refactorings Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Moving manager subpackage into ruler package to avoid dependency cycles This also mirrors Cortex's package structure Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Minor refactorings Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Skipping commit if remote-write client is not defined Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Updating use of cortex client Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Memoizing appenders, using queue for samples & labels Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding buffer size configurability Refactoring Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding metric to show current buffer size Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Refactoring for better responsibility separation & testability Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding per-tenant overrides of remote-write queue capacity Renaming "buffer size" to "queue capacity" to be more accurate Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding tests for evicting queue Minor refactoring Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding more tests and refactoring Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding queue benchmark Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Reducing redundancy in metric names Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Testing that only metric queries can be run Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Minor fixes pre-review Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Guarding against unprotected nil pointer dereference in Prometheus remote.Client Adding remote-write client validation Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Setting tenant ID header on remote-write client Adding User-Agent string Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Updating benchmark to use complex struct rather than int to be more reflective of usage Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Registering flags Removing extraneous checks Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding metric to track remote-write commit errors Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Refactoring based on review Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Performance improvements based on review Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Return error on invalid queue capacity Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Removing global queue capacity config - using limits Minor refactoring Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Reusing memory in request preparation Refactoring for testability Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Moving remote-write metrics into struct Refactoring Unexporting and refactoring memstore metrics to match Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Applying review suggestions Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Allowing for runtime changing of per-tenant remote-write queue capacity Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Sandeep Sukhani	c90366dbe7	just log a warning when a store type other than boltdb-shipper is detected when custom retention is enabled (#3785) ... * just log a warning when a store type other than boltdb-shipper is detected when custom retention is enabled * gofmt * Update msg Co-authored-by: Ed Welch <ed@oqqer.com> Co-authored-by: Ed Welch <ed@oqqer.com>	4 years ago
Fredrik Ekre	faeccdc831	[docs] add LokiLogger.jl to unofficial clients. (#3756)	4 years ago
Sandeep Sukhani	61b60092af	initialize retention and deletion components only when they are enabled (#3772)	4 years ago
Sandeep Sukhani	d765921735	revendor cortex to latest master (#3771)	4 years ago
Sandeep Sukhani	966bed72d3	reduce allocs in delete requests manager by reusing slice for tracing non-deleted intervals for chunks (#3769)	4 years ago
Ed Welch	e384efd107	fix make docs target (#3764)	4 years ago
Cyril Tovena	526dc4bbe7	Fixes parser labels hint for grouping. (#3763) ... * Fixes parser labels hint for grouping. This PR include those now. Fixes #3707 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes array allocations. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	89b32835c2	Improve mark file processing. (#3762) ... This makes boltdb batch for deleting entries smaller and so goroutines for deletion of chunks are not stuck. Also improve metrics to refresh more often. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	e5a3afedff	Add fromJson to the template stage. (#3736) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Fiona Liao	bc10123698	Remove unnecessary backtick from example (#3757)	4 years ago
Owen Diehl	1f6453fb81	exposes loki codec (#3758)	4 years ago
Cyril Tovena	15d417efe1	Replace satori.uuid with gofrs/uuid (#3743) ... * Replace satori.uuid with gofrs/uuid Fixes #3742 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix new import. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Sandeep Sukhani	3b26c63c82	Boltdb shipper deletion fixes (#3746) ... * use return instead of break in select case * skip compaction on delete requests table	4 years ago
atxviking	f6dcd3f3a4	Fix document links for api push example (#3690)	4 years ago
3Xpl0it3r	89bdc9c10a	add debug information for extracted data (#3711) ... * fix the promtail-default-config download link in doc * add debug information for extreacted in stage * add Debug variable * format	4 years ago
jadd	38e06015ba	Update troubleshooting.md (#3715) ... fix some typo. change utf8 em dash to ascii dash	4 years ago