Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Ivan Kalita 3f62bb7207 chore(compactor): Allow overflowed logsobj builders (#22148) ... I'm changing the behavior of logsobj builders to allow appends to overflowed builders. Before this PR: (1) Processor tries to append a record to a builder (2) If a builder is full it doesn't append and returns an error ErrBuilderFull (3) Processor checks the error and flushes the builder (4) Processor tries to append the same record as in the step (1) to the now empty builder This approach works fine but becomes problematic once we introduce multiple TOC windows builders. The issue is that with a single builder we have atomic "try append - flush if error" behavior guarantee. With multiple builders this becomes a problem as a single kafka record might contain entries that belong to different builders. Example: - we have a record R that has a log entry L0 for TOC window W0 AND a log entry L1 for TOC window W1 - we attempt to append L0 to the first builder B0 (for TOC W0) -> success - we attempt to append L1 to the second builder B1 (for TOC W1) -> not appended, err builder full - we flush all the builders (have to flush all of them because otherwise we can lose data as Kafka offset is committed after flushing) - we attempt to append R again -> builder B0 will receive a duplicate of log L0 To simplify the processing we can allow appends to full builders ("one last time"). For the example above we'd allow the append of L1 to B1 even though B1 is already full. This way the dataobjects might become slightly bigger than the target size but this could already be the case given that the existing size estimates are estimates.		7 days ago
..
bench	chore(compactor): Allow overflowed logsobj builders (#22148)	7 days ago
log	fix(logql): Decode unpadded base64 template values (#21828)	4 weeks ago
sketch	chore: Remove unused/dead code (#21723)	1 month ago
syntax	chore: Enable the unused linter (#22078)	1 week ago
vector	…
accumulator.go	chore: Revert "chore: enforce max-query-series when returning shard results" (#18156)	12 months ago
accumulator_test.go	refactor(stringlabels): Support stringlabels in util, engine and logql. (#17998)	1 year ago
blocker.go	fix(logql): Fix nil pointer dereference caused by data race during query blocking (#21726)	1 month ago
blocker_test.go	fix(logql): Fix nil pointer dereference caused by data race during query blocking (#21726)	1 month ago
count_min_sketch.go	chore: consistently use new labels.Labels API (#18490)	11 months ago
count_min_sketch_test.go	refactor(stringlabels): Support stringlabels in util, engine and logql. (#17998)	1 year ago
downstream.go	chore(linter): Fix issues flagged by updated golangci-lint version (#19206)	9 months ago
downstream_test.go	…
engine.go	chore: track time spent waiting for data from ingesters (#19648)	7 months ago
engine_test.go	chore: Remove unused/dead code (#21723)	1 month ago
evaluator.go	chore: Remove unused/dead code (#21723)	1 month ago
evaluator_test.go	…
explain.go	…
explain_test.go	…
first_last_over_time.go	…
limits.go	feat: Batch records before writing to sinks (#20821)	3 months ago
mapper_metrics.go	…
mapper_stats.go	…
matchers.go	…
matchers_test.go	…
matrix.go	…
matrix_test.go	…
metrics.go	feat(logql): Report estimated_query_bytes from index-stats lookups (#21796)	1 month ago
metrics_test.go	chore(queries): Log User-Agent on query metrics and finished lines (#21663)	2 months ago
optimize.go	fix: Implement approx-topk function on querier (#17816)	1 year ago
optimize_test.go	fix: Implement approx-topk function on querier (#17816)	1 year ago
quantile_over_time_sketch.go	chore: consistently use new labels.Labels API (#18490)	11 months ago
quantile_over_time_sketch_test.go	refactor(stringlabels): Support stringlabels in util, engine and logql. (#17998)	1 year ago
range_vector.go	chore: Remove unused/dead code (#21723)	1 month ago
range_vector_test.go	chore: Remove unused/dead code (#21723)	1 month ago
rangemapper.go	…
rangemapper_test.go	…
shardmapper.go	…
shardmapper_test.go	…
shards.go	…
shards_test.go	…
step_evaluator.go	…
test_utils.go	chore: upgrade to prometheus@main (#20876)	4 months ago
tree_printer.go	…
vector.go	…