3547 Commits (3a1fdd03f466aa1d526c191a55848bef7b30eb38)

 

All Branches   

Search

Author	SHA1	Message	Date
Danny Kopping	3a1fdd03f4	Define a reason why the fifocache has evicted an item (#6335) ... * Define a reason why the fifocache has evicted an item Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Fixing tests Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Making reason more clear Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Do not increment eviction counter on Stop() Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
JordanRushing	c9b374dd08	Set `MetricsNamespace` configurable for MemberlistKV module in Loki (#6330) ... Signed-off-by: JordanRushing <rushing.jordan@gmail.com>	3 years ago
Michał Jaroń	57d543eff7	Update _index.md - an unofficial Loki client added (#6312) ... I would like to add mjaron-tinyloki-java to unofficial Loki clients. It is standalone small library without any dependencies. It may be an alternative to other libraries which use many dependencies and require more configuration to send logs.	3 years ago
JordanRushing	405cdab96a	Expose Memberlist status page on MemberlistKV module init (#6322) ... * Expose Memberlist status page on MemberlistKV module init Signed-off-by: JordanRushing <rushing.jordan@gmail.com> * Add Server dependency to MemberlistKV module to properly serve status page Signed-off-by: JordanRushing <rushing.jordan@gmail.com>	3 years ago
JordanRushing	e0528b6f00	Add multi_kv_config block to overrides configmap when multi kv is enabled (#6323) ... Signed-off-by: JordanRushing <rushing.jordan@gmail.com>	3 years ago
Owen Diehl	5a6157ecf3	Tsdb/index sampling (#6329) ... * groundwork for index sampling * go mod * bloom filter utils * removes unnecessary atomics * Stats() impl for tsdb index * use passed var * lint	3 years ago
Sandeep Sukhani	086dbf7270	always retry syncing index files from indexshipper when the index list cache is stale (#6327)	3 years ago
Danny Kopping	36e0979cf5	Add cache usage statistics (#6317) ... * Adding cache statistics Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding metrics to metrics.go Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Creating new stats context for use in metric queries middleware Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Clean up unnecessary log fields Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Fixing tests Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding stats tests Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * CHANGELOG entry Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Documenting function Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Moving CHANGELOG entry to appropriate section Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Implementing a stats collector cache wrapper to simplify stats collection If we keep the stats collection in pkg/storage/chunk/cache/instrumented.go, then any implementation that wraps it will cause the stats collected to be incomplete. For example: NewBackground(cacheName, cfg.Background, Instrument(cacheName, cache, reg), reg)) - the background cache requests are not collected Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Fixing tests Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Michel Hollands	65e3148bc9	Update delete integration test (#6192) ... * Add wait until processed Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add query lines Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove Cortex reference Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add deleted lines metric and check in test Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Set negative cancel period so default 1 minute delay is compensated for Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Reduce timeout Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add helper function Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Comment out assertions that only work with flush Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove unused metric type param Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Check counter in unit test Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rename ClientOption to Option as per the linter Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove redundant check Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * fill in MsgAndArgs field of test assertion Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Evangelos Foutras	a877febf75	Use fake credentials in storage/chunk/storage tests (#6187) ... Enable insecure mode for the GCS client so fake credentials are used when running the storage tests (see commit c0cc004333 ("gcs client: use fake credentials in unit test"). Fixes: https://github.com/grafana/loki/issues/6185	3 years ago
Richard Hartmann	c1be35eb31	Add licensing boiler plate in case we ever need it (#5251) ... * Add licensing boiler plate in case we ever need it Signed-off-by: Richard Hartmann <richih@richih.org> * Update LICENSING.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Sandeep Sukhani	82da01ad43	make index shipper read path handle range of tables by type of index (#6304)	3 years ago
Sandeep Sukhani	9a2df5a06e	copy boltdb-shipper cache changes from PR #6054 to generic index shipper (#6316)	3 years ago
Mathew Heard	de418bf6ac	Reduce to a single code path through sendBatches regardless of limit (#6216) ... * Reduce to a single code path through sendBatches regardless of limit specified * simplify sendBatches by using -1 to specify no limit * test fix	3 years ago
Shane St Savage	135f672c91	fix: allow promtail docker_sd_config to handle long log lines (#6256) ... In promtail's docker_sd_config, parsing of a container's logs would fail if any log line was over 64k bytes in length. This is because bufio.Scanner uses a 64k buffer by default. Since there doesn't appear to be a way to elegantly catch `bufio.ErrTooLong` and carry on, the parsing approach was changed to bufio.Reader which can handle lines of arbitrary length.	3 years ago
Travis Patterson	69eabfcefd	Fix delete cancellation timeout (#6285)	3 years ago
Vladyslav Diachenko	b757753e3b	fixed type of the property in memberlist config (#6307)	3 years ago
Jan-Otto Kröpke	a1e0298a57	Support tenant id from value (#6290) ... Signed-off-by: Jan-Otto Kröpke <mail@jkroepke.de>	3 years ago
Vladyslav Diachenko	7df7169ccd	We shouldn't modify the loki config at all if the memberlist ring is not (#6299) (#6308) ... enabled. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Owen Diehl	4903df6ae5	Tsdb/inverted index wiring (#6252) ... * multi inverted index * delete in inverted index signature * multi inverted index * inverted index testing + skip nil indices * wires up period config aware multi-inverted-idx through ingesters * better inverted index validation * apply shipper defaults to last relevant period config, not current one. * more verbose error	3 years ago
Travis Patterson	ea0a5246cc	Only consider an interval to have possible expired chunks if it overlaps a delete. (#6297)	3 years ago
Owen Diehl	cd7ebf2ae0	exposes line length hist on distributors (#6309) ... * exposes line length hist on distributors + fixes some metric instantiation * adjusts buckets	3 years ago
Sandeep Sukhani	1ad75d0b63	do not initialize tsdb index store when using index gateway client for queries (#6305) ... * do not initialize tsdb index store when using index gateway client for queries * fix test * lint	3 years ago
Sandeep Sukhani	7158785a89	update loki-mixin json dashboards with latest jsonnet changes (#6306)	3 years ago
Christian Haudum	9a82f5c04a	Look up config file in default locations (#6160) ... * Look for config.yaml file in ./ and ./config directories This change makes Loki look for a config file in the current directory or in the config/ sub-directory. This is a pre-requisite for making an easy-to-use tarball distribution that also ships a config.yaml Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Rename YAMLFlag to ConfigFileLoader The `YAMLFlag` function is solely used for loading config files. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Look for config.yaml file in ./ and ./config directories * fixup! fixup! Look for config.yaml file in ./ and ./config directories Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fixup! fixup! Look for config.yaml file in ./ and ./config directories Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Cyril Tovena	7e53381eee	Avoid line copy during LogQL line_format (#6104)	3 years ago
Cyril Tovena	d9cc6a87c2	Improve write dashboard by removing unrelated route (#5853) ... * Improve write dashboard by removing unrelated route Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update production/loki-mixin/dashboards/loki-writes.libsonnet Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com>	3 years ago
Sandeep Sukhani	fefc33debc	make tsdb store instance a singleton (#6273) ... * make tsdb store instance a singleton * make it mandatory to have 24h index period config for tsdb * avoid initializing head and tsdb manager when running tsdb store in read only mode	3 years ago
Callum Styan	3c1accccb1	Import memberlist.libsonnet in loki.libsonnet. (#6294) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Trevor Wood	0470e4e7d3	feat(fluentd): allow fluentd_thread label to be configurable (#6240) ... Signed-off-by: Trevor Wood <Trevor.G.Wood@gmail.com>	3 years ago
Travis Patterson	1c5e094e16	Only delete data when WholeStreamDeletion or FilterAndDelete (#6286) ... * Only delete data when WholeStreamDeletion or FilterAndDelete * remove broken snyn workflow	3 years ago
Karsten Jeschkies	ff5ce4e129	Document multi-tenant queries. (#5994) ... * Document multi-tenant queries. * Update docs/sources/operations/multi-tenancy.md Co-authored-by: Aleksey <a.alexey.lazarev@gmail.com> * Update docs/sources/operations/multi-tenancy.md Co-authored-by: JordanRushing <rushing.jordan@gmail.com> * Update docs/sources/operations/multi-tenancy.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/multi-tenancy.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Aleksey <a.alexey.lazarev@gmail.com> Co-authored-by: JordanRushing <rushing.jordan@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Periklis Tsirakidis	4c3e276679	operator: Add ruler config support (#6195)	3 years ago
Ed Welch	f52fc9d907	Loki: add a run-once flag to the compactor (#6281) ... * add a run once flag to the compactor to allow it to cleanup index files with a single manual invocation. Useful when using migrate tool. Signed-off-by: Edward Welch <edward.welch@grafana.com> * fix lint Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Ed Welch	b5f0557e79	fix boltdb shipper local query in logcli and support `fake` tenant (#6282) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Periklis Tsirakidis	d91a64f910	operator: Add support for custom S3 CA (#6198)	3 years ago
Christian Simon	7f50a26656	Move ingester metrics around (#6275)	3 years ago
Ethan	f58a14fab1	Snyk SBOM workflow add (#6274) ... * Snyk SBOM workflow add * Update snyk.yml	3 years ago
Sandeep Sukhani	2d4ff73cc2	add metrics for tracking index shipper operations (#6278)	3 years ago
Sandeep Sukhani	8f4381a5b6	update drone signature (#6277)	3 years ago
Christian Haudum	b2b4fdec71	Update docs for xk6-loki log formats (#6134) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Bayan Taani	50ef4f2ebd	Add duration filter unit test (#6271)	3 years ago
Sandeep Sukhani	7369b3785c	use tsdb config for initializing index gateway client (#6267) ... * use tsdb config for initializing index gateway client * review feedback Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com>	3 years ago
Nicklas	6922190cde	Documentation: Explain --config.expand-env=true double slash with slash substitution (#6139) ... * docs: Promtail configuration explain expand-env slash pitfall * docs: link to correct envsubst go package Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com>	3 years ago
Bryan Boreham	dc185f6ac2	Fix wording about pattern parser (#6264) ... The last sentence was saying the opposite of what it meant. Also fix 'start' to match singluar 'expression'.	3 years ago
Anatoly Laskaris	9c49a0222d	docs: Add Nomad deployment examples (#6258) ... * Add Loki monolith example * Commentout traefik in monolithic setup * Typos * Add ruler configuration * Add loki-simple * Fix consul prefix * Add loki-distributed example * Add missing README * Add explanation why use Consul Connect and Vault PKI at the same time * Simplify distributed setup * Readme small fixes * Update production/nomad/README.md * Add Nomad mention * Commit suggestions * Add ability to specify Loki version from command line * Wording fix	3 years ago
Robert Jacob	e61f8dccdd	operator: Document how to connect Grafana to gateway (#6250)	3 years ago
Travis Patterson	9b2786bde3	Fix delete updates (#6194) ... * Fix delete updates * Update pkg/storage/stores/shipper/compactor/deletion/delete_requests_client.go Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com> * Add compactor address to the storage config * review comments * Review feedback Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com>	3 years ago
Sandeep Sukhani	3b3fcf6c87	update drone branch match for 3 digit k release (#6263)	3 years ago
Steve Hipwell	7cc6aa4021	feat: Add support for Azure user assigned identity (#5891) ... Signed-off-by: Steve Hipwell <steve.hipwell@gmail.com>	3 years ago