Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Ned Andreev 40479029d7 feat: Generic logline placeholder replacement and tokenization (#12799) ... This code allows us to preprocess generic logs and replace highly variable dynamic data (timestamps, IPs, numbers, UUIDs, hex values, bytesizes and durations) with static placeholders for easier pattern extraction and more efficient and user-friendly matching by the Drain algorithm. Additionally, there is logic that splits generic log lines into discrete tokens that can be used with Drain for better results than just naively splitting the logs on every whitespace. The tokenization here handles quote counting and emits quoted strings as a part of the same token. On the other side, it also handles likely JSON logs without any white spaces in them better, by trying to split `{"key":value}` pairs (without actually parsing the JSON). All of this is done without using regular expressions and without actually parsing the log lines in any specific format. That's why it works very efficiently in terms of CPU usage and allocations, and should handle all log formats and unformatted logs equally well.		1 year ago
..
clientpool	feat: add log patterns ingestion and query API. (#12403)	1 year ago
drain	feat: Add step param to Patterns Query API (#12703)	1 year ago
iter	feat: add log patterns ingestion and query API. (#12403)	1 year ago
testdata	feat: add log patterns ingestion and query API. (#12403)	1 year ago
tokenization	feat: Generic logline placeholder replacement and tokenization (#12799)	1 year ago
flush.go	feat: add log patterns ingestion and query API. (#12403)	1 year ago
flush_test.go	feat: add log patterns ingestion and query API. (#12403)	1 year ago
ingester.go	feat: add log patterns ingestion and query API. (#12403)	1 year ago
ingester_querier.go	test: Add new tests for Drain pattern matching (#12655)	1 year ago
ingester_querier_test.go	feat: add log patterns ingestion and query API. (#12403)	1 year ago
ingester_test.go	feat: add log patterns ingestion and query API. (#12403)	1 year ago
instance.go	feat: Add step param to Patterns Query API (#12703)	1 year ago
metrics.go	feat: add log patterns ingestion and query API. (#12403)	1 year ago
ring_client.go	feat: add log patterns ingestion and query API. (#12403)	1 year ago
stream.go	feat: Add step param to Patterns Query API (#12703)	1 year ago
stream_test.go	feat: Add step param to Patterns Query API (#12703)	1 year ago
streams_map.go	feat: add log patterns ingestion and query API. (#12403)	1 year ago
tee.go	feat: add log patterns ingestion and query API. (#12403)	1 year ago