158 Commits (shantanu/dataobj-compactor)

Author	SHA1	Message	Date
Sandeep Sukhani	a935a63abb	chore: add support for fetching chunks with sizing info from the index to optimize GetShards calls (#19221) ... Signed-off-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	4 months ago
dannyc-grafana	ecdd613a0c	chore: Autofix to make nosec comments also readable by semgrep (#18664)	6 months ago
Robert Fratto	86c57c8616	chore: consistently use new labels.Labels API (#18490)	7 months ago
Trevor Whitney	fdcc12da4d	feat: query persisted patterns (#17980) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>	8 months ago
Trevor Whitney	fd7321c88b	feat: persist patterns as aggregated metrics (#17737) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>	8 months ago
Charles Korn	545fb1597c	refactor(stringlabels): Support stringlabels in `logql/log` package (#17838) ... This is another step towards supporting Prometheus' stringlabels implementation in Loki. It adds support in the `logql/log` package. Part of https://github.com/grafana/loki/issues/17122 The tests should now compile and pass with `-tags stringlabels`. --- Co-authored-by: Karsten Jeschkies <karsten.jeschkies@grafana.com>	8 months ago
Oleg Zaytsev	c8a15f451c	refactor: Use OTel tracing library (#17859) ... Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>	8 months ago
George Robinson	e2aa96ba61	chore: move protos related to limits to limits package (#17592)	9 months ago
George Robinson	640eff5c25	chore: remove deprecated GetStreamUsage RPC (#17591)	9 months ago
George Robinson	1ea5c7f1cc	chore: remove tenant from ExceedsLimitsResponse (#17585)	9 months ago
Periklis Tsirakidis	c55f038bba	feat(ingest-limits): Enforce synchronously max stream limit per partition (#17527)	9 months ago
George Robinson	cd5e7df2a2	feat: add exceeds limits RPC with no-op implementation (#17546)	9 months ago
George Robinson	e90e0c41fb	chore: rename RejectedStreams to ExceedsLimitsResult (#17041)	10 months ago
George Robinson	38c40170fc	chore(ingest-limits): rate should be a uint64 as it cannot be negative (#17040)	10 months ago
Periklis Tsirakidis	5229a2ab65	fix(ingest-limits): Get usage from owing instances only (#16937)	10 months ago
Trevor Whitney	507d269832	feat: return the jsonpath of json detected fields (#16861)	11 months ago
Periklis Tsirakidis	3a3df62c59	feat(ingest-limits): Implement global tenant rate limiting (#16727)	11 months ago
George Robinson	0cbaa46325	feat: add limits/frontend pkg (#16658)	11 months ago
George Robinson	127b6092af	feat: add limits package (#16489)	11 months ago
Paul Rogers	f2c2a22bdc	chore: Preparation for incoming static code analysis CI check (#15164) ... Co-authored-by: Danny Cooper <danny.cooper@grafana.com>	1 year ago
renovate[bot]	3f1666c53d	fix(deps): update module github.com/stretchr/testify to v1.10.0 (#15090) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Paul Rogers <paul.rogers@grafana.com>	1 year ago
Salva Corts	b4060154d1	feat(blooms): Prefetch bloom blocks as soon as they are built (#15050) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Karsten Jeschkies	7b53f20f70	feat: Introduce shardable probabilistic topk for instant queries. (#14243) ... Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Callum Styan <callumstyan@gmail.com>	1 year ago
Salva Corts	d1668f6a11	fix(blooms): Exclude label filters where label name is part of the series labels. (#14661)	1 year ago
Christian Haudum	baaaa83c78	chore: Add chunk count from `GetChunkRef` call to stats context (#14636) ... This PR improves the observability of the GetChunkRef call, especially for when bloom filters are enabled. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Trevor Whitney	7983f94b15	feat: detected field values (#14350)	1 year ago
Sven Grossmann	aa1ac99f4d	fix(`detected_fields`): return parsed labels when parsers are passed (#14047) ... Co-authored-by: Galen Kistler <109082771+gtk-grafana@users.noreply.github.com> Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	1 year ago
Trevor Whitney	b1dc0763d6	feat: ability to ignore cache for volume queries (#13945)	1 year ago
Trevor Whitney	c6ab6b31e8	chore: remove initial metric aggregation experiment (#13729)	2 years ago
George Robinson	7f35179cd3	feat: Ingester RF-1 (#13365)	2 years ago
Trevor Whitney	467eb1bb1b	feat: collect and serve pre-aggregated bytes and counts (#13020) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	2 years ago
benclive	740551bb31	fix: Correctly encode step when translating proto to http internally (#13171)	2 years ago
Yuri Kotov	808425953f	feat: API: Expose optional label matcher for label names API (#11982) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	2 years ago
Shantanu Alshi	e7fdeb974a	perf: Improve Detected labels API (#12816)	2 years ago
Sven Grossmann	19fef9355f	feat(detectedFields): Support multiple parsers to be returned for a single field (#12899)	2 years ago
Sven Grossmann	2b3ae48d9b	feat(detectedFields): add parser to response (#12872)	2 years ago
Christian Haudum	a0f358fcc8	fix(blooms): Fully deduplicate chunks from FilterChunkRef responses (#12807) ... This PR aims for full de-duplication of chunks and series from filter requests from the index gateway to the bloom gateway. Whenever we merge/de-duplicate slices, the inputs need to be sorted. It appears that the Removals (chunks) from the v1.Output are not guaranteed to be sorted. When comparing ShortRefs, both From, Through, and Checksum need to be used. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Owen Diehl	bc78d13d9b	feat(blooms): compute chunks once (#12664) ... Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	2 years ago
benclive	7b8533e435	feat: Add step param to Patterns Query API (#12703)	2 years ago
Christian Haudum	5540c92d50	perf(blooms): Resolve bloom blocks on index gateway and shard by block address (#12720) ... This pull request changes how data is sharded across bloom gateways. Currently, chunks are grouped by series and shared by the fingerprint of the series across the available bloom gateways using jumphash algorithm. This however, leads to over-querying bloom blocks, because bloom blocks have consecutive fingerprint ranges, whereas sharding keys are evenly distributed across keyspace. This PR changes the sharding in the way that bloom blocks for series are already resolved on the index gateways and that their address is used for sharding data. This has the advantage that the grouped series can be mapped to the correct bloom blocks on the client side. Sending the block ref along with the grouped series to the bloom gateway allows for efficient querying of the data because each bloom gateway therefore owns exactly 1/nth of the blocks. --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Trevor Whitney	f68d1f7faf	fix: make detected fields work for both json and proto (#12682)	2 years ago
Trevor Whitney	6c33809015	feat: split detected fields queries (#12491)	2 years ago
Cyril Tovena	491d2513e7	feat: add log patterns ingestion and query API. (#12403) ... Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: Anton Kolesnikov <anton.e.kolesnikov@gmail.com> Co-authored-by: Sven Grossmann <svennergr@gmail.com> Co-authored-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Travis Patterson	cf04ec1320	feat: Enable warnings in Loki query responses (#12425)	2 years ago
Shantanu Alshi	643f353cef	feat: Detected labels - get and filter labels from ingesters (#12432)	2 years ago
Ed Welch	824f5aa20a	chore: fix submodule for v3 (#12438) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Trevor Whitney	a53a0cc792	feat: return real data in detected fields endpoint (#12421) ... parse log lines in the querier to return data about detected fields. this is not sustainable long term, but a short term solution to validate the data we want for the frontend.	2 years ago
Ed Welch	4c88be0ef2	chore: update loki modules for 3.0 release (#12433) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Callum Styan	018856c1c1	fix: fix span logging based on changes to request types timestamps (#12393) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	2 years ago
Shantanu Alshi	5190dda64b	feat(detected_labels): Initial skeleton for the API (#12390) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	2 years ago