apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
W.T. Chang	46e835fb3c	Docs: Replace mimir example config path with a loki one (#9125 ) What this PR does / why we need it: The example config path on Loki's query scheduler is using `-config.file=/mimir/config/mimir.yaml`, which looks a little bit confusing on Loki's document, even though there are multiple references to Mimir. `7bec727c6d/docs/sources/operations/scalability.md`?plain=1#L23 This PR replaces the Mimir config path with the one found in query-frontend's document. `7bec727c6d/docs/sources/configuration/query-frontend.md`?plain=1#L115 Which issue(s) this PR fixes: N/A Special notes for your reviewer: I noticed this when checking configuration of 2.6, but this is still the case in the [latest version](https://grafana.com/docs/loki/v2.8.x/operations/scalability/). Checklist - [X] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Jack Baldry	df1b34898b	Use centralized make-docs script from Writers' Toolkit (#9126 ) - Adds ability to build multiple projects simultaneously using, for example, `make docs PROJECTS='grafana grafana-cloud'`. - Adds `make doc-validator` which runs [`doc-validator`](https://github.com/grafana/technical-documentation/tree/main/tools/cmd/doc-validator) on all documentation. Using a centralized script will help ensure consistency in workflow across all projects. Signed-off-by: Jack Baldry <jack.baldry@grafana.com> Signed-off-by: Jack Baldry <jack.baldry@grafana.com>	2 years ago
melGL	d107fbe538	Removed deprecated navigation names (#9133 ) Changed "integrations and connections" to "connections" and removed the lightning bolt icon reference. --------- Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
Abdelkrim	f4db6a76b8	Update _index.md (#9138 ) Removed the single binary from the scalability section as this is confusing. This should be called monolithic also. What this PR does / why we need it: Which issue(s) this PR fixes: Fixes #<issue number> Special notes for your reviewer: Checklist - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Salva Corts	5697bec427	Move misplaced recent changes in changelog to Loki Enhancements (#9137 ) What this PR does / why we need it: Some changelog entries were misplaced into _Promtail Enhancements_ instead of _Loki Enhancements_. This PR fixes this by moving the items to the correct section. Which issue(s) this PR fixes: Fixes https://github.com/grafana/loki/pull/9042 Special notes for your reviewer: Checklist - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
René Scheibe	e050d5c494	Docs: Update Loki GitHub URLs (#9080 ) * use `main` instead of `master` branch * fix outdated URLs	2 years ago
Salva Corts	8cf921a145	Pass engine opts down to middlewares (#9130 ) What this PR does / why we need it: The following middlewares in the query frontend uses a downstream engine: - `NewQuerySizeLimiterMiddleware` and `NewQuerierSizeLimiterMiddleware` - `NewQueryShardMiddleware` - `NewSplitByRangeMiddleware` These were all creating the downstream engine as follows: ```go logql.NewDownstreamEngine(logql.EngineOpts{LogExecutingQuery: false}, DownstreamHandler{next: next, limits: limits}, limits, logger), ``` As can be seen, the [engine options configured in Loki][1] were not being used at all. In the case of `NewQuerySizeLimiterMiddleware`, `NewQuerierSizeLimiterMiddleware` and `NewQueryShardMiddleware`, the downstream engine was created to get the `MaxLookBackPeriod`. When creating a new Downstream Engine as above, the `MaxLookBackPeriod` [would always be the default][2] (30 seconds). This PR fixes this by passing down the engine config to these middlewares, so this config is used to create the new downstream engines. Which issue(s) this PR fixes: Adresses some pending tasks from https://github.com/grafana/loki/pull/8670#issuecomment-1507031976. Special notes for your reviewer: Checklist - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` [1]: `1bcf683513/pkg/querier/querier.go (L52)` [2]: `edc6b0bff7/pkg/logql/engine.go (L136-L140)`	2 years ago
Ashwanth	5cef03d0ea	index-shipper: add support for multiple stores (#7754 ) Signed-off-by: Ashwanth Goli <iamashwanth@gmail.com> What this PR does / why we need it: Currently loki initializes a single instance of index-shipper to [handle all the table ranges](`ff7b462973/pkg/storage/factory.go (L188)`) (from across periods) for a given index type `boltdb-shipper, tsdb`. Since index-shipper only has the object client handle to the store defined by `shared_store_type`, it limits the index uploads to a single store. Setting `shared_store_type` to a different store at a later point in time would mean losing access to the indexes stored in the previously configured store. With this PR, we initialize a separate index-shipper & table manager for each period if `shared_store_type` is not explicity configured. This offers the flexibility to store index in multiple stores (across providers). Note: - usage of `shared_store_type` in this commit text refers to one of these config options depending on the index in use: `-boltdb.shipper.shared-store`, `-tsdb.shipper.shared-store` - `shared_store_type` used to default to the `object_store` from the latest `period_config` if not explicitly configured. This PR removes these defaults in favor of supporting index uploads to multiple stores. Which issue(s) this PR fixes: Fixes #7276 Special notes for your reviewer: All the instances of downloads table manager operate on the same cacheDir. But it shouldn't be a problem as the tableRanges do not overlap across periods. Checklist - [X] Reviewed the `CONTRIBUTING.md` guide - [ ] Documentation added - [X] Tests updated - [x] `CHANGELOG.md` updated - [x] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Signed-off-by: Ashwanth Goli <iamashwanth@gmail.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
Travis Patterson	c4261b19fd	Fix parsing of long queries (#9134 ) Loki uses a `scanner.Scanner` to consume the characters in a query. `lex.go` relies heavily on the assumption a scanner can be copied to perform speculative parsing. The problem is that sometimes speculative parsing overruns the scanners internal buffer of `1024` bytes and incurs an additional read to the underlying reader. At that point, all subsequent scanners are out of sync with their underlying readers and the query may fail to be parsed. In the case of #9132, there is a function call at line `1024`. `lex.go` tries to understand this is a function call by speculatively parsing and incurs an underlying read which consumers the rest of the reader. When the lexer tries to scan the next character with the original scanner, the reader is already consumed even though only 1024 bytes have been scanned The scanner has an internal buffer size of `1024 bytes`. This PR copies `scanner.Scanner` from the `text/scanner` package and increases the internal buffer to `maxInputSize` which guarantees that no calls to `Scan` will incur reads beyond the first one. Ideally we wouldn't pass Scanners around in such a way but the cost of that is to rethink much of Loki's lexing logic. Given we know a max input size and we already have that in memory, this solution should suffice. Fixes https://github.com/grafana/loki/issues/9132	2 years ago
Alan Conway	ac1c1fdf03	operator: Revert 1x.extra-small changes, add 1x.tiny-test (#9049 )	2 years ago
Peter Feigl	b744678c67	Feature/helm single binary extra containers (#8956 ) What this PR does / why we need it: Add a new helm value `singleBinary.extraContainers` to allow running sidecar containers in a singleBinary loki deployment. Useful for a container that keeps the data PV from filling up. Checklist - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Salva Corts	f9d9b471f8	Fix comment in `buildChunkMetas ` test function (#9124 ) wrt https://github.com/grafana/loki/pull/9096#discussion_r1164555980	2 years ago
Travis Patterson	7735b1e98e	Sanitize label keys in the unpack parser (#9121 ) This PR makes the `unpack` parser sanitize label keys like all the other parsers. When invalid label names are included, it causes the user to get `could not write JSON response` errors when the response is serialized to send back to the user.	2 years ago
Robert Fratto	7bec727c6d	promtail: support configurable polling interval (#8874 ) Currently, Promtail always polls files every 250ms. This PR allows the polling period to be customized, starting at a minimum polling period and exponentially increasing the polling frequency to a bounded maximum if the file has no changes. When file changes are detected, the polling frequency resets to the minimum. The default behavior is the existing behavior; both the minimum and maximum polling intervals are set to 250ms. I'm opening this in draft to get early feedback. There's a few open questions: * Where can I add validations to ensure that the min/max polling intervals are configured properly? * Is this the right approach for implementation? Do I need to make any changes? * Does this need tests? I'll update the CHANGELOG and Documentation after we're agreed on an approach.	2 years ago
Trevor Whitney	38c9c6c460	Bump go from 1.20.1 -> 1.20.3 (#9106 ) What this PR does / why we need it: Bumps our go dependency from 1.20.1 to 1.20.3 to address [security fixes](https://groups.google.com/g/golang-announce/c/Xdv6JL9ENs8) Checklist - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Salva Corts	9783757932	Proportional TSDB index stats for chunks partially fitting in queried time range. (#9096 ) What this PR does / why we need it: When computing index stats for a query, we sum up the stats from all the chunks the query would read, even if some chunks will only be read partially. Moreover, if the query spans across two different TSDB tables, and there are chunks duplicated on both tables (at the end of the first one and at the beginning of the next one), the chunks' stats will be counted twice. This PR improves how we compute stats by taking care of partially matching chunks. Assuming entries and bytes are evenly distributed in the chunk, we will take the proportional number of entries and the number of bytes that fit on the span. For example, a chunk spans from t1 to t10 and has 10 entries and 10 KBs. A query from t3 through t7 would hit 50% of the chunk time span. Therefore, we estimate that the query would load 5 KBs and 5 entries from the chunk. Special notes for your reviewer: Checklist - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Karsten Jeschkies	ff36227d87	Ignore broken query limits header. (#9103 )	2 years ago
JordanRushing	7edda371ea	Add journald support to Promtail amd64 binary builds (#9095 ) What this PR does / why we need it: Previously, in https://github.com/grafana/loki/pull/8131, we enabled journald support for Promtail arm/arm64 binary builds but not amd64. Which issue(s) this PR fixes: - https://github.com/grafana/loki/issues/9060 Special notes for your reviewer: N/A Checklist - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Signed-off-by: JordanRushing <rushing.jordan@gmail.com> Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	2 years ago
3deep5me	c5453f156c	Helm: Removed support for PodDisruptionBudget in policy/v1alpha1 and upgraded it to policy/v1 (#8894 ) This PR removes the old policy/v1beta1 from pdb objects and removes with it the not needed helper function. This simplifies the helmchart and makes it more compatible with argocd and newer kubernetes versions. Which issue(s) this PR fixes: Fixes #8887 Special notes for your reviewer: First PR 😅	2 years ago
dependabot[bot]	e9bc461c63	Bump github.com/docker/docker from 20.10.23+incompatible to 23.0.3+incompatible (#9035 ) Bumps [github.com/docker/docker](https://github.com/docker/docker) from 20.10.23+incompatible to 23.0.3+incompatible. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/docker/docker/releases">github.com/docker/docker's releases</a>.</em></p> <blockquote> <h2>v23.0.3</h2> <h2>23.0.3</h2> <blockquote> <p><strong>Note</strong></p> <p>Due to an issue with CentOS 9 Stream's package repositories, packages for CentOS 9 are currently unavailable. Packages for CentOS 9 may be added later, or as part of the next (23.0.4) patch release.</p> </blockquote> <h3>Bug fixes and enhancements</h3> <ul> <li>Fixed a number of issues that can cause Swarm encrypted overlay networks to fail to uphold their guarantees, addressing <a href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2023-28841">CVE-2023-28841</a>, <a href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2023-28840">CVE-2023-28840</a>, and <a href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2023-28842">CVE-2023-28842</a>. <ul> <li>A lack of kernel support for encrypted overlay networks now reports as an error.</li> <li>Encrypted overlay networks are eagerly set up, rather than waiting for multiple nodes to attach.</li> <li>Encrypted overlay networks are now usable on Red Hat Enterprise Linux 9 through the use of the <code>xt_bpf</code> kernel module.</li> <li>Users of Swarm overlay networks should review <a href="https://github.com/moby/moby/security/advisories/GHSA-vwm3-crmr-xfxw">GHSA-vwm3-crmr-xfxw</a> to ensure that unintentional exposure has not occurred.</li> </ul> </li> </ul> <h3>Packaging Updates</h3> <ul> <li>Update containerd to <a href="https://github.com/containerd/containerd/releases/tag/v1.6.20">v1.6.20</a>.</li> <li>Update runc to <a href="https://github.com/opencontainers/runc/releases/tag/v1.1.5">v1.1.5</a>.</li> </ul> <h2>v23.0.2</h2> <h2>23.0.2</h2> <p>For a full list of pull requests and changes in this release, refer to the relevant GitHub milestones:</p> <ul> <li><a href="https://github.com/docker/cli/milestone/75?closed=1">docker/cli, 23.0.2 milestone</a></li> <li><a href="https://github.com/moby/moby/milestone/114?closed=1">moby/moby, 23.0.2 milestone</a></li> </ul> <h3>Bug fixes and enhancements</h3> <ul> <li>Fully resolve missing checks for <code>apparmor_parser</code> when an AppArmor enabled kernel is detected. <a href="https://redirect.github.com/containerd/containerd/pull/8087">containerd/containerd#8087</a>, <a href="https://redirect.github.com/moby/moby/pull/45043">moby/moby#45043</a></li> <li>Ensure that credentials are redacted from Git URLs when generating BuildKit buildinfo. Fixes <a href="https://github.com/moby/buildkit/security/advisories/GHSA-gc89-7gcr-jxqc">CVE-2023-26054</a>. <a href="https://redirect.github.com/moby/moby/pull/45110">moby/moby#45110</a></li> <li>Fix anonymous volumes created by a <code>VOLUME</code> line in a Dockerfile being excluded from volume prune. <a href="https://redirect.github.com/moby/moby/pull/45159">moby/moby#45159</a></li> <li>Fix a failure to properly propagate errors during removal of volumes on a Swarm node. <a href="https://redirect.github.com/moby/moby/pull/45155">moby/moby#45155</a></li> <li>Temporarily work around a bug in BuildKit <code>COPY --link</code> by disabling mergeop/diffop optimization. <a href="https://redirect.github.com/moby/moby/pull/45112">moby/moby#45112</a></li> <li>Properly clean up child tasks when a parent Swarm job is removed. <a href="https://redirect.github.com/moby/swarmkit/pull/3112">moby/swarmkit#3112</a>, <a href="https://redirect.github.com/moby/moby/pull/45107">moby/moby#45107</a></li> <li>Fix Swarm service creation logic so that both a GenericResource and a non-default network can be used together. <a href="https://redirect.github.com/moby/swarmkit/pull/3082">moby/swarmkit#3082</a>, <a href="https://redirect.github.com/moby/moby/pull/45107">moby/moby#45107</a></li> <li>Fix Swarm CSI support requiring the CSI plugin to offer staging endpoints in order to publish a volume. <a href="https://redirect.github.com/moby/swarmkit/pull/3116">moby/swarmkit#3116</a>, <a href="https://redirect.github.com/moby/moby/pull/45107">moby/moby#45107</a></li> <li>Fix a panic caused by log buffering in some configurations. <a href="https://redirect.github.com/containerd/fifo/pull/47">containerd/fifo#47</a>, <a href="https://redirect.github.com/moby/moby/pull/45051">moby/moby#45051</a></li> <li>Log errors in the REST to Swarm gRPC API translation layer at the debug level to reduce redundancy and noise. <a href="https://redirect.github.com/moby/moby/pull/45016">moby/moby#45016</a></li> <li>Fix a DNS resolution issue affecting containers created with <code>--dns-opt</code> or <code>--dns-search</code> when <code>systemd-resolved</code> is used outside the container. <a href="https://redirect.github.com/moby/moby/pull/45000">moby/moby#45000</a></li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="`59118bff50`"><code>59118bf</code></a> Merge pull request from GHSA-232p-vwff-86mp</li> <li><a href="`219f21bf07`"><code>219f21b</code></a> Merge pull request <a href="https://redirect.github.com/docker/docker/issues/45196">#45196</a> from vvoland/integration-restart-race-23</li> <li><a href="`b87f7f18b8`"><code>b87f7f1</code></a> libnet/d/overlay: insert the input-drop rule</li> <li><a href="`c6bf3071fe`"><code>c6bf307</code></a> StartWithLogFile: Fix d.cmd race</li> <li><a href="`7f49ca259b`"><code>7f49ca2</code></a> TestDaemonRestartKillContainers: Fix loop capture</li> <li><a href="`98cbcb8003`"><code>98cbcb8</code></a> libnet/d/overlay: add BPF-powered VNI matcher</li> <li><a href="`5c5fac2374`"><code>5c5fac2</code></a> libnet/d/overlay: extract VNI match rule builder</li> <li><a href="`c492a22287`"><code>c492a22</code></a> libn/d/overlay: enforce encryption on sandbox init</li> <li><a href="`018edb0284`"><code>018edb0</code></a> libnet/d/overlay: document some encryption code</li> <li><a href="`a1fd2f22f6`"><code>a1fd2f2</code></a> Merge pull request <a href="https://redirect.github.com/docker/docker/issues/45157">#45157</a> from thaJeztah/23.0_backport_update_shfmt</li> <li>Additional commits viewable in <a href="https://github.com/docker/docker/compare/v20.10.23...v23.0.3">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=github.com/docker/docker&package-manager=go_modules&previous-version=20.10.23+incompatible&new-version=23.0.3+incompatible)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com>	2 years ago
Salva Corts	fd5d78784f	Estimate chunk size on compaction looking at data uncompressed size (#9099 ) What this PR does / why we need it: At `compactedIndex.ToIndexFile` we were not computing the size of the chunk correctly. We were looking at the size of the chunk ref. Since the size of the chunk ref is always a bunk of bytes, the chunk meta KB field would always be 0. `4e893a0a88/pkg/storage/stores/tsdb/compactor.go (L367)` Instead, we should get the approx KBs by looking at the chunks data uncompressed size. As we do at `store.IndexChunk`: `d405162516/pkg/storage/stores/tsdb/store.go (L189)`	2 years ago
Dylan Guedes	b82ad11f92	Loki: Fix span event logging on rate store (#9086 ) What this PR does / why we need it: Fix an event logging on rate store that is missing the `event` key. `LogKV` expects a key-value pair always.	2 years ago
Ed Welch	67c0b3ed2c	Loki: log all trace ID's but include `sampled=true` when the trace is logged (#9039 ) What this PR does / why we need it: Currently when we log "with context" we will only add the traceID if the particular trace is being sampled. This is nice because it makes it obvious that if you go search for a trace you'll find it. However, traceID is also useful for selecting all the log lines from a single query within Loki itself and if the trace wasn't sampled we remove this useful piece of context for querying the log lines. In this PR, instead of dropping the traceID from the logs, we instead prefix it with `NS-` Where NS is short for Not Sampled Example: ``` level=debug ts=2023-04-05T15:06:24.377067817Z caller=fetcher.go:292 org_id=145265 traceID=NS-13ed6c30228e221d chunks=1 decodeRequests=1 missing=0 ``` Questions: * should we bikeshed a little on this prefix? (I wanted something concise but if it's concise it's probably confusing to folks who've never seen it before) * Instead of a prefix, we could change the logfmt key? `ID=13ed6c30228e221d` (this is less confusing in some ways but maybe more difficult/confusing in others?) Which issue(s) this PR fixes: Fixes #<issue number> Special notes for your reviewer: Checklist - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Signed-off-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Owen Diehl	363a85226e	makes test pass for 0 sharding factor (equivalent to no sharding) (#9065 ) Saw validation tests failing due to this on `main`; not sure how this hasn't borked our builds but this ensures we don't error on shard-factors of zero (equivalent to not sharding). This doesn't actually hit our code paths because we explicitly shortcut factor=0 in the shardmapper.	2 years ago
宣云辉	b915652498	operator: Add a new Object Storage Type for AlibabaCloud OSS (#8661 ) Co-authored-by: Periklis Tsirakidis <periklis@nefeli.eu>	2 years ago
Trevor Whitney	ea14d1348e	Fix CHANGELOG to accurately reflect what's in 2.8 (#9042 ) What this PR does / why we need it: A few items were incorrectly listed under 2.8 on `main` that are not in 2.8. This PR brings the `CHANGELOG` on `main` in line with the one already on `release-2.8.x` and therefore doesn't need to be backported.	2 years ago
Trevor Whitney	c587b538ed	Fail through to next middleware when querySizeLimit cannot be applied (#9050 ) What this PR does / why we need it: When the query size limiter can't limit the query, fail through to the next middleware instead of erroring. This can happen, for example, when a query spans schemas, which is still a valid query case, so we want to make sure to fall back to existing behavior. --------- Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	2 years ago
Danny Kopping	e001086ac0	Fix CHANGELOG link (#9048 ) Previous was pointing to "main" which will cause confusion Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	2 years ago
Trevor Whitney	fa56f00517	These features did not make the release (#9025 ) What this PR does / why we need it: These features did not actually make it into this release.	2 years ago
Gerard Vanloo	5f50e0f04c	operator: Update Loki dependency to v2.8.0 (#9040 )	2 years ago
Periklis Tsirakidis	5eef13449b	operator: Update Loki operand to v2.8.0 (#9036 )	2 years ago
Mohamed-Amine Bouqsimi	c7584bea37	operator: Add watch for the object storage secret (#8978 )	2 years ago
Ethan	09ecc843f5	sbom action namechange (#9038 ) What this PR does / why we need it: Realized the SBOM action was not running due to the lack of a file extenstion on the workflow file. Quick add	2 years ago
Periklis Tsirakidis	68fa134c3b	operator: Align common instance addr with memberlist advertise addr (#8958 )	2 years ago
Karsten Jeschkies	ea8376d0cd	Check that code has been formatted. (#9012 )	2 years ago
Karsten Jeschkies	de2b0c6e9d	Rename per-request query limits. (#9011 ) What this PR does / why we need it: `maxQueryTime` is more in line with the other per-request limits we have. Checklist - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [x] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Karsten Jeschkies	4fc51ccdd7	Remove unnecessary build image step. (#9019 ) What this PR does / why we need it: > Repeat step 1.3, which will use the new image is the same as calling `make drone`. So it is not required. Checklist - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (required) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Kaviraj Kanagaraj	cce3d3bed9	chore(format_query): Change response type to `application/json` (#9016 )	2 years ago
Karsten Jeschkies	b49663c287	Add goimports to Loki build image. (#9013 )	2 years ago
Trevor Whitney	3f5c73747b	add 2.8 release date (#9015 ) What this PR does / why we need it: Fills out the date for the 2.8 release	2 years ago
Owen Diehl	acb40ed40e	Eager stream merge (#8968 ) This PR introduces a specialized heap based datastructure to merge incoming log results in the frontend. Recently we've experienced an increase in OOMs on frontends due to logs queries which match lots of data. Sharded requests in loki split based on the amount of data we expect and some queries see thousands of sub requests. For log queries, we'll fetch up the `limit` from each shard, return them to the frontend, and merge. High shard counts * limit log lines, especially combined with large log lines (in byte terms) are accumulated on the frontend. Once they all are received, the frontend merges them. This creates opportunity for OOMs as it can hold up a lot of memory. This PR addresses one of these problems by eagerly accumulating responses as they're received and only retaining a total `limit` number of entries. There's still OOM potential due to race conditions between sub requests returning to the query-frontend and the query-frontend merging other sub requests, but this definitely improves the situation. I've been able to consistently run large limited queries that touch TBs of data (i.e. `{cluster=~".+"} \|= "a"`) that previously OOMed frontends. --------- Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	2 years ago
Trevor Whitney	ec4b88955f	Add 2.8 release notes (#9004 ) Adds 2.8 release notes.	2 years ago
Periklis Tsirakidis	c1ca782dbd	operator: Remove static placeholder suffix for openshift bundle (#8998 )	2 years ago
Dylan Guedes	6dfcd59c1b	Promtail: Add `decompression` configuration (#8994 ) What this PR does / why we need it: Adds a new `compression` configuration to Promtail to customize decompression behavior. As of now, two options are supported: `enabled`: false by default but if truthy, Promtail will infer a compression algorithm to use based on the file extension `initialDelay`: 0 by default but if higher, Decompressor will sleep for the given duration before trying to decompress. This is to avoid scenarios where the Decompressor starts to work on a file that is still being compressed/generated. Which issue(s) this PR fixes: Fixes https://github.com/grafana/loki/issues/8784	2 years ago
Danny Kopping	6442ec1bdd	Mixins: check that `memcached_index_writes` exists before using it in `boltdb_shipper` (#8995 ) What this PR does / why we need it: This key is missing when not using boltdb_shipper, but this lib is included by default	2 years ago
kernc	e773c004f5	Docs: Mention python-logging-loki as an unofficial client (#8983 ) What this PR does / why we need it: Mention python-logging-loki as an unofficial client, since it looks a reasonably well done client. This PR is a continuation from https://github.com/grafana/loki/pull/8636. 😅 CLA has been signed!	2 years ago
Christian Haudum	35c79e4a09	Trigger `deploy` CI step only on push to main or tag of new release (#8991 ) What this PR does / why we need it: Right now, backporting to a kXXX branch causes a trigger of the `deploy` pipeline, which overrides already deployed newer releases. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Trevor Whitney	bf2e712b32	I do not think we have circleci jobs anymore (#9002 )	2 years ago
Alan Conway	6532f5d668	operator: Restore minimum PVC sizes for 1x.extra-small (#9005 )	2 years ago
Periklis Tsirakidis	2ae80d7166	Align common instance_addr with memberlist advertise_addr (#8959 )	2 years ago

1 2 3 4 5 ...

4908 Commits (46e835fb3cd3e6252322fc8e5deee9ba65c4b496) All Branches Search

4908 Commits (46e835fb3cd3e6252322fc8e5deee9ba65c4b496)

All Branches