9611 Commits (646ebe81d809f2aba6d91bf914235fbd5706d2bd)

 

All Branches   

Search

Author	SHA1	Message	Date
Ashwanth	646ebe81d8	chore(engine): adds AST conversion and result builders for metric queries (#18166)	11 months ago
Christian Haudum	b1fc685397	chore: Extend instrumentation of dataobject uploader (#18292) ... These changes provide better visibility into the dataobj uploader. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	11 months ago
renovate[bot]	c84ef0a036	fix(deps): update module github.com/shirou/gopsutil/v4 to v4.25.6 (main) (#18290) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	b7403287a8	fix(deps): update module github.com/alecthomas/chroma/v2 to v2.19.0 (main) (#18289) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	146d53fb12	chore(deps): update dependency @typescript-eslint/eslint-plugin to v8.35.1 (main) (#18287) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Ader Fu	01065da58f	docs: Update `operator/docs/operator/storage_size_calculator.md` (#18275) ... Signed-off-by: Ader Fu <ader.ydfu@gmail.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	11 months ago
Adi Harush	f042d53b3c	docs: Fix typo (#18277)	11 months ago
renovate[bot]	4c31e7e3d1	fix(deps): update module go.opentelemetry.io/collector/pdata to v1.35.0 (main) (#18284) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Ashwanth	fc69dec062	chore(tailer): fix a flaky tests in tail/querier_test.go (#18282)	11 months ago
Christian Haudum	0ee8e76ba2	feat: Mark truncated log lines with identifier (#18262) ... While truncated JSON log lines are usually easy to identify (because the JSON becomes invalid), it is not always the case with other plain text log lines. This PR adds the possibility to add an identifier as suffix for truncated log lines, such as `[...]` so that truncated log lines are easier to spot and identify when querying them. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	11 months ago
renovate[bot]	2adce4f58c	chore(deps): update dependency @types/node to v22.15.34 (main) (#18274) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	d60b07c4f6	fix(deps): update dependency react-hook-form to v7.59.0 (main) (#18273) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	abc4a3eb24	chore(deps): update dependency eslint to v9.30.0 (main) (#18272) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	4b460dc717	fix(deps): update dependency @tanstack/react-query-devtools to v5.81.5 (main) (#18271) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	313f94bb54	fix(deps): update dependency @tanstack/react-query to v5.81.5 (main) (#18270) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	8868a561a6	fix(deps): update dependency react-router-dom to v7.6.3 (main) (#18268) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	a404e09f13	fix(deps): update dependency lucide-react to ^0.525.0 (main) (#18267) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	3011a6c7d6	fix(deps): update module github.com/oklog/run to v1.2.0 (main) (#18263) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	52ad9172d5	fix(deps): update dependency @tanstack/react-query to v5.81.4 (main) (#18258) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	1a2e9f804e	fix(deps): update dependency @tanstack/react-query-devtools to v5.81.4 (main) (#18259) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Robert Fratto	30ccf5172c	chore(util/arrowtest): export arrowtest package (#18255)	11 months ago
Ashwanth	8481b34dd5	fix(frontend): allow resolution of v6 addresses. (#18251)	11 months ago
renovate[bot]	73a7c4f417	fix(deps): update module go.etcd.io/bbolt to v1.4.2 (main) (#18253) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Ashwanth	8594d1ca28	fix(memberlist): allow resolution of advertise address from v6 interf… (#18250)	11 months ago
benclive	9642af3ac6	chore: Add new pointers section type for dataobj (#18243)	11 months ago
renovate[bot]	5ee4ed637f	fix(deps): update dependency lucide-react to ^0.524.0 (main) (#18249) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Ader Fu	c30b2247a9	docs(operator): Fix the error 404 URL on `operator/docs/prologue/quickstart.md` (#18142) ... Signed-off-by: Ader Fu <ader.ydfu@gmail.com>	11 months ago
bozerkins	82263d383a	fix: detect "Information" log level as "info" (#18195) ... Support for parsing "Information" log level from .NET libraries	11 months ago
renovate[bot]	b2e1d7f267	fix(deps): update module github.com/prometheus/prometheus to v0.304.2 (main) (#18248) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	1fa706905a	chore(deps): update prom/prometheus docker tag to v3.4.2 (main) (#18247) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Ashwanth	5f3300a084	chore(bench_test): correctly integrate new query engine + misc changes (#18172)	11 months ago
renovate[bot]	1f5a6e20cf	chore(deps): update terraform aws to ~> 6.1.0 (main) (#18245) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	ae93021c1e	chore(deps): update dependency vite to v7 (main) (#18211) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	b3acd31cb4	chore(deps): update terraform aws to v6 (main) (#18146) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	9108f85cd4	fix(deps): update module github.com/baidubce/bce-sdk-go to v0.9.233 (main) (#18244) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Christian Haudum	66c483981b	chore(blooms): Reduce memory footprint of download queue (#18242) ... The download queue has a fixed size of 100k elements and is implemented using a channel. Since the channel has a fixed size, this will allocate `capacity * object size`, where the object is `downloadRequest[BlockRef, BlockDirectory]`. This PR changes the channel from a channel of objects (`chan downloadRequest[T, R]`) to a channel of pointers (`chan *downloadRequest[T, R]`) which should significantly reduce the permanently allocated memory for the queue. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	11 months ago
renovate[bot]	ab41c00b40	fix(deps): update dependency @types/lodash to v4.17.19 (main) (#18241) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	6325af5a1b	fix(deps): update module github.com/aws/aws-sdk-go-v2/service/s3 to v1.82.0 (main) (#18237) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	241e721e30	fix(deps): update module google.golang.org/api to v0.239.0 (main) (#18236) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	e6115ca290	fix(deps): update module github.com/docker/docker to v28.3.0+incompatible (main) (#18226) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	8b7e82ec6f	fix(deps): update module github.com/baidubce/bce-sdk-go to v0.9.232 (main) (#18230) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Sandeep Sukhani	8007e22db5	feat(compactor HS): store index updates per processed segment in the manifest to the object storage (#18212)	11 months ago
Christian Haudum	c167800b3f	fix(pattern): Fix feature flag for enabling pattern persistence (#18216) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	12 months ago
renovate[bot]	462fa142be	chore(deps): update terraform google to v6.41.0 (main) (#18222) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	12 months ago
J Stickler	3c080dc516	docs: Add link to Grafana OTEL docs (#18182)	12 months ago
renovate[bot]	2ad1c4d972	chore(deps): update dependency @types/node to v22.15.33 (main) (#18219) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	12 months ago
Poil	0d232c8be3	docs: fix object_store should be s3 not aws (#18203) ... Signed-off-by: Poil <poil@quake.fr> Co-authored-by: J Stickler <julie.stickler@grafana.com>	12 months ago
renovate[bot]	7c72965c0d	fix(deps): update dependency lucide-react to ^0.523.0 (main) (#18217) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	12 months ago
Christian Haudum	b316d52612	chore(engine): Use shard information from query frontend in the new query engine (#17792) ... **What this PR does / why we need it**: This PR introduces the sharding to the new query engine to be able to test the engine using the exsiting Loki architecture with query frontend, query scheduler, and queriers. **Note, this is only an interim solution used for validating and testing.** By design, the first phase of the query engine implementation does only local execution of queries without sharding or time-based splitting. However, for testing the results of this first phase, we can utilise dual-ingestion (writing both chunks/tsdb and data objects in a way that sharding and splitting is performed in the query frontend using the existing middlewares. On the queriers themselves, the sub-queries are parsed and planned using the new logical and physical planner. If the query can successfully be planned, it will be executed by the new engine, otherwise it falls back to the old engine. **Shard size considerations** While performing time-splitting in the frontend works for data objects as well, sharding by information from TSDB is not directly mappable to data objects. The default target shard size in TSDB is 600MB (decompressed), whereas target size of data objects is 1GB compressed or roughly 10-15GB uncompressed. However, individual logs sections of a data object have a target size of 128MB, which is roughly 0.9-1.2GB. That is 1.5-2x larger than the TSDB target shard size. So when using the sharding calculation from TSDB, it would over-shard for data object sections, which is likely acceptable for testing and good enough for proving that local execution with the new engine works. **How does sharding with data objects in this PR work?** The query frontend passes down the calculated shards as part of the query parameters of the serialised sub-request. The logical planner on the querier stores the Shard annotation on the `MAKETABLE` alongside the stream selector. This is then used by the physical planner to filter out only the relevant sections of the resolved data objects from the metastore lookup. During exeuction, only readers for the relevant sections are initialised when performing the `DataObjScan`. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Ashwanth <iamashwanth@gmail.com>	12 months ago
renovate[bot]	5cf7cd7486	chore(deps): update dependency @typescript-eslint/parser to v8.35.0 (main) (#18206) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	12 months ago