apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Jeroen Op 't Eynde	96515e3116	refactor: moved jaeger-agent-mixin (#2377 ) * refactor: use jaeger-agent-mixin lib got moved: https://github.com/grafana/jsonnet-libs/pull/291 used jb-0.4.0 which updates the jsonnetfile.json format * refactor: use jb-0.4.0 jsonnetfile.json format	5 years ago
Cyril Tovena	81c7bd33f5	Fixes the fluentbit batchwait backward compatiblity. (#2375 ) We move from second `1` to duration `1s`, but we can keep that compatible. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Ed Welch	8de21671e4	add a Pod Disruption Budget for Loki ingesters to limit only 1 unavailable at a time (#2373 )	5 years ago
Ed Welch	76ceec45d9	If an entry is missing on the websocket, start checking after `wait` but continue checking until `max-wait` (#2369 ) Refactored out a useful pruneList function	5 years ago
Cyril Tovena	afc8b4d998	Fixes helm publish that needs now to add repo. (#2371 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Aditya C S	4c6090756f	Loki Logstash Plugin (#1822 ) * Logstash plugin * include_labels * include_labels * Removes binary. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve documentation and remove the push path. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move to cmd. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more precision for jruby. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/logstash/README.md * p Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * ignore Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove ignore file/ Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * More precision for installing jruby Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Rename without Grafana Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * A lot of refactoring and testing. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * change delay logic * Fully tested version. Now testing/writing docs and charts. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Forgot to save merge. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * working version. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Makefile + easier docker build. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * adds ci to build logstash image. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix build for logstash. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds example with helm charts. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix target to send 10 logs with logstash. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improved documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add missing helm add repo for external repo Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review comment. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes loki service in Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update loki-stack version Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Rickard Robin	99604a556d	Documentation: Add example for having separate pvc for loki, using helm (#2358 ) * Add example for having separate pvc for loki * Documentation: Deploy loki stack with pvc	5 years ago
Martin Dojcak	ca94b2cc91	Fix fluent-bit exit callback deadlock when buffering for loki is enabled (#2365 )	5 years ago
Steven Reitsma	05b45259e8	Add projected and downwardAPI volume types to PodSecurityPolicy (#2355 ) (#2366 )	5 years ago
Martin Dojcak	eb39e8283f	fluent-bit: Add more loki client configuration options (#2367 ) * Add more loki client configuration options to flb output plugin * Fix/Add config option tests	5 years ago
Owen Diehl	72880d17a1	Storage backend examples (#2357 ) * [wip] adds storage docs * storage docs * small doc fixes * addresses PR comments	5 years ago
Owen Diehl	35b61e661c	Makes timestamp parsing docs clearer (#2360 )	5 years ago
Ed Welch	2b145da7d7	Canary tweaks (#2350 ) * tweak the canary a bit, add a metric for websocket pings, fix some logging, improve the mutex locking a bit, add a read timeout on the websocket, add a lastmessage time checker to restart websocket * fix constructor * fix counter name change metric count reporting to two separate metrics, expected vs actual * add note to upgrade guide for metric name changes * fixed tests.... * Update docs/operations/upgrade.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	5 years ago
Aditya C S	8809de6087	refactor promtail target manager code (#2345 )	5 years ago
Aditya C S	0885a49370	configuration doc improvements (#2318 )	5 years ago
Ed Welch	81b9decfb5	Loki-Canary: Add query spot checking and metric count checking (#2344 ) * Add spot check capability to canary to query certain values over time to make sure they are still in Loki. Add a context timeout to Loki queries * Updating canary to use /loki/api/v1 endpoints adding a metric test query * fixing metric names to have _total for counters * fix parsing of timestamp from log line and don't use entry timestamp * Tweak the metric test query to adjust the range to the time the canary has been running to get accurate results until the requested range has been reached. Add a total spot check entry counter to get a ratio of success * Add some debugging logs to troubleshoot missing entries * add more tests, fix some log lines * update docs, make the spot-check timer separate from prune entries * just how many paramaters can I add to the constructor.... * run prune entries on a separate thread, only run one at a time.	5 years ago
Cyril Tovena	36594e21ae	Add a complete tutorial on how to ship logs from AWS EKS. (#2338 ) * Add a complete tutorial on how to ship logs from AWS EKS. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/aws/eks/promtail-eks.md * Update docs/clients/aws/eks/promtail-eks.md * Final touches. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	ce76ad099a	Fixes LogQL grouping (#2346 ) * Work in progress ! debugging this. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * It was indeed the missing sort before processing aggregation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	2cd3633b23	Add a tutorial to forward AWS ECS logs to Loki. (#2331 ) * Add a tutorial to forward AWS ECS logs to Loki. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove GrafanaCloud api key, it has been also completely nuke just in case. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	c9f89df930	Improve object key parsing for boltdb shipper. (#2323 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	2548d6986d	Remove mount in the docker driver. (#2295 ) * Remove mount in the docker driver. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint json Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Johnathan Falk	0ace187e17	Change ignoring empty line to debug logging. (#2343 ) Signed-off-by: Johnathan Falk <johnathan.falk@gmail.com>	5 years ago
Cyril Tovena	2561605ae9	Tutorial to run Promtail on AWS EC2 (#2321 ) * Starting the work with spining out an ec2 instance. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a tutorial on how to run Promtail on AWS EC2. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve gist link. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * More adjustements. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/aws/ec2/ec2.md * Update docs/clients/aws/ec2/ec2.md Co-authored-by: Ed Welch <ed@oqqer.com> * Move off curl gist to grafana/loki repo. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add systemd as most user will need it. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * yupo Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Ed Welch <ed@oqqer.com>	5 years ago
Cyril Tovena	0be64fcb34	Improve metric queries by computing samples at the edges. (#2293 ) * First pass breaking the code appart. Wondering how we're going to achieve fast mutation of labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Work in progress. I realize I need hash for deduping lines. going to benchmark somes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Tested some hash and decided which one to use. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Starting working on ingester. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Trying to find a better hash function. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * More hash testing we have a winner. xxhash it is. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Settle on xxhash Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Better params interfacing. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add interface for queryparams for things that exist in both type of params. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add storage sample iterator implementations. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixing tests and verifying we don't get collions for the hashing method. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixing ingesters tests and refactoring utility function/tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixing and testing that stats are still well computed. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixing more tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * More engine tests finished. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes sharding evaluator. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes more engine tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix error tests in the engine. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finish fixing all tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes a bug where extractor was not passed in correctly. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add notes about upgrade. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Renamed and fix a bug. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add memchunk tests and starting test for sampleIterator. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Test heap sample iterator. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * working on test. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finishing testing all new iterators. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Making sure all store functions are tested. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Benchmark and verify everything is working well. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Make the linter happy. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * use xxhash v2. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix a flaky test because of map. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * go.mod. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Ed Welch	0b5996021f	Loki: add -print-config-stderr flag to dump loki's runtime config to stderr (#2336 ) * Loki: add -print-config-stderr flag to dump loki's runtime config to stderr * add ability to print inline config for better readability in grafana * add an option to log the config in reverse order to make viewing in Grafana easier. Also added this capability to Promtail	5 years ago
Ed Welch	7889e01cd0	looks like yamale 3.0.0 was released with a breaking change in a method parameter, pinning to 2.2.0 (#2341 )	5 years ago
Cyril Tovena	ed64054d0e	Improve documentation of the metric stage. (#2335 ) Specially w/r/t `max_idle_duration`	5 years ago
Aditya C S	b82d2e89d2	fix bug in ingester series query (#2264 )	5 years ago
Aditya C S	01040c1a4d	Fix data race in ingester (#2327 )	5 years ago
Ed Welch	635e469e9a	Loki: Use a new context to update the ring state after a failed chunk transfer (#2330 ) * Loki: Use a new context to update the ring state after a failed chunk transfer * Update pkg/ingester/transfer.go Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/ingester/transfer.go Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Ed Welch	edaf0ed422	transfers one chunk at a time per series instead of all (#2328 )	5 years ago
Owen Diehl	e22f365025	remove DynamoDB chunk store doc (#2317 ) Removes DynamoDB as a supported chunk store in our docs. It's a very poor fit for loki.	5 years ago
Ed Welch	b24a143043	Promtail: Loki Push API (#2296 ) * refactor to put targets in separate packages * rename scrape package to scrapeconfig * Push implementation, working with logging * adding new vendored library * adding tests * adding documentation and an additional config option. * fixing journal test * rename scrape config entry * Update docs/clients/promtail/configuration.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * PR feedback Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	5 years ago
Cyril Tovena	cd74043db9	Improve entry deduplication. (#2302 ) * Improve entry deduplication. This PR removes mostcommon and sort insert function in the heap iterator. I discovered while working on #2293 that those are actually not helping since we're deduping those lines anyways. There were no tests checking if deduping was correctly working so I did added those. Bonus point this means deduping will run faster and the code is less complex. The only side effect is that the order of entries that are at the same timestamp, before the most common entry would appear first, now we keep the same order as we stored them, which I think is better. I also change the label ordering, I think whether we are forward or backward we should keep the same aphabetical labels ordering not sure why direction was altering this before. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve heap iterator backward test. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	c149099955	Fixes buffered iterator skipping very long lines. (#2306 ) Funny enough this was triggered only with gzip and only with a certain size. But thanks for investigation here #2272 I was able to reproduce this with a test and indeed this was incorrect. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Ward Bekker	0ab9a6383d	Added a link to the replace parsing stage (#2308 )	5 years ago
Cyril Tovena	bc3cba4112	Test again arm32 on internal ci. (#2309 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	68ac695fd8	Removes arm32 for now as we're migrating the CI. (#2307 ) * Removes arm32 for now as we're migrating the CI. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes flaky test, its being rewritten anyway. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Rafael Pissolatto Nunes	4309a68050	Fix schema_config store value (#2305 ) The value of store in the schema_config was incorrect (store: boltdb_shipper), fixed to the right value (store: boltdb-shipper)	5 years ago
Felix Ruess	616771aeff	Promtail: support unix timestamps with fractional seconds (#2301 ) * support unix timestamps with fractional seconds see #2193 * add test for parsing unix timestamp with fractions * mention Unix timestamp with fractions in docs * return error if timestamp is not split into two parts * don't capitalize error Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	3defe3a5bd	Default to 3100 port for Loki without requiring NET_BIND_SERVICE capability. (#2294 ) Mistakes were made. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Roman Grebennikov	de644b52c3	promtail: fix high CPU usage on large kubernetes clusters. (#1118 ) * promtail: add api-level node filter for kubernetes discovery * promtail: fix hardcoded host value in k8s node filter	5 years ago
Cyril Tovena	19be2c4732	Fixes the lint issue merge to master. (#2290 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Periklis Tsirakidis	bc4f1f5833	Add support for memberlist dns-based discovery (#2288 ) * Bump cortex to 0ea5a8b5 to enable memberlist dns-based discovery * Update docs for memberlist config DNS-based discovery support * Fix mock chunk store client DeleteChunk signature	5 years ago
Aditya C S	384520436d	Fix fluent-bit \n and \t characters (#2286 )	5 years ago
Ward Bekker	c54be421ca	Change the Grafana image to latest (#2287 ) For a better first use experience, I would recommend changing the grafana image to latest. Grafana master is not guaranteed to be in a stable state.	5 years ago
Aditya C S	7399beff4a	Fix local.md doc (#2285 )	5 years ago
Owen Diehl	4ef52f29c1	Update local.md (#2284 ) Fixes image referenced in docs. Closes https://github.com/grafana/loki/issues/2276	5 years ago
Frank	4ce385f0c2	Documentation: Refine LogQL documentation (#2279 ) * Fix broken list syntax in LogQL documentation * Reformat LogQL docuto one sentence per line * Use proper code blocks in LogQL docu * Give LogQL operator order to dedicated docu section Co-authored-by: Frank Fischer <frank.fischer@jda.com>	5 years ago
Mathieu Gaubert	afd3daf960	helm: add annotations to service monitor (#2258 )	5 years ago

1 2 3 4 5 ...

1581 Commits (96515e31166f79cf552dd9d5ef226ccedebfa562) All Branches Search

1581 Commits (96515e31166f79cf552dd9d5ef226ccedebfa562)

All Branches