669 Commits (65b539c2ab1c64f9507657cfd434bee13ee39245)

Author	SHA1	Message	Date
Lars Lehtonen	334cc1e59a	pkg/storage/stores/shipper/uploads: fix test error (#2620) ... Signed-off-by: Lars Lehtonen <lars.lehtonen@gmail.com>	5 years ago
Roger Steneteg	edb5fc5176	Promtail: adding pipeline stage for dropping labels (#2571) ... * adding pipeline stage for dropping labels, our use case for this is to move unbound labels into the log line and dropping the label, fixes #2421 Signed-off-by: Roger Steneteg <rsteneteg@ea.com> * Update docs/sources/clients/promtail/stages/labeldrop.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/_index.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * fixed inconsistent naming, removed unused logger in the labeldrop stage Signed-off-by: Roger Steneteg <rsteneteg@ea.com> Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>	5 years ago
Sandeep Sukhani	e53d2032fe	fix a panic when trying to stop boltdb-shipper multiple times using sync.once (#2613)	5 years ago
Ed Welch	2015763327	Loki: Fix query-frontend ready handler (#2610) ... * query frontend should not have a default route as it usurps the ready handler, the ready handler was also not implemented completely for the query frontend. * enable ready check for query-frontend in ksonnet	5 years ago
Robert Fratto	ee67b9c707	Expose UserAgent and fix User-Agent version source (#2603) ... * Use prometheus/common/version for reporting build version in User Agent header Promtail wasn't using github.com/prometheus/common/version for the User-Agent header when obtaining the build version. Instead, it imported github.com/grafana/loki/pkg/build which modifies the Prometheus version package on init. This causes problems for importers that also import and modify github.com/prometheus/common/version with their own build information (i.e., grafana/agent). This PR changes Promtail to obtain the build info from the common dependency to obtain the correct build information regardless of how Promtail is being run. * expose UserAgent to allow it to be modifiable by importers	5 years ago
Sandeep Sukhani	6dd2e9ef34	Read, Write and operational dashboard improvements (#2584) ... 1. Add bigtable, boltdb-shipper to read/write dashboards. 2. Add boltdb-shipper to operational dashboard. 3. Record latency for write operation in boltdb-shipper.	5 years ago
Calle Pettersson	82a8cf425f	Add a counter for empty syslog messages (#2565)	5 years ago
Ben Ye	900f714e9d	add _total suffix to ruler counter metrics (#2582) ... Signed-off-by: Ben Ye <yb532204897@gmail.com>	5 years ago
Owen Diehl	164f5cd0ae	Ruler/loki rule validator (#2589) ... * revendors cortex * loki multitenantmanager * vendoring compat * go mod	5 years ago
Sandeep Sukhani	7566aa4950	fix closing of compressed file from boltdb-shipper compactor (#2574)	5 years ago
Aditya C S	c1f07f08a7	Validate max_query_length in Label API (#2572)	5 years ago
Ed Welch	b8b24f3129	clone labels when sending them to Handle function for stdin target (#2570)	5 years ago
Owen Diehl	f905e77259	exports grouploader (#2578)	5 years ago
Owen Diehl	4032c927cb	strict rule unmarshaling (#2580)	5 years ago
Owen Diehl	7b68293e26	logql rule loading (#2576)	5 years ago
Owen Diehl	8627af1199	Error on no schema configs (#2564) ... * ruler jsonnet * jsonnet fixes * errors instead of panics on no schema configs	5 years ago
Sandeep Sukhani	0a0ad68af2	fix dir setup based on which mode it is running (#2559)	5 years ago
Sandeep Sukhani	1bba2a89f8	add some metrics for monitoring compactor (#2548)	5 years ago
Sandeep Sukhani	4f6a4c2a93	cleanup boltdb files in queriers during startup/shutdown (#2558)	5 years ago
Sandeep Sukhani	2bb2eebace	register boltdb shipper compactor cli flags (#2546)	5 years ago
Owen Diehl	aea6c3a36d	Feature/ruler (take 2) (#2458) ... * begins speccing out ruler ruler memhistory encapsulates metricsHistory removes mutex from memhistory ruler module * upstream conflicts * implicit ast impls, parser for ruler * /api/prom ruler routes, ruler enabled in single binary * registers ruler flags, doesnt double instantiate metrics * cleanup for old samples in ruler * begins ruler tests * ForStateAppenderQuerier tests * memhistory stop * RestoreForState test * upstream querier ifc * introducing loki ruler metrics * removes rule granularity metric -- to be discussed in pr * validates ruler cfg * renames gauge metrics to not use total * removes unnecessary logs * logs synthetic restoreforstate * logs tenant in ruler * sets cortex to owen's unmerged fork * begins porting rules pkg * memstore work * work on queryable based in memory series store * removes unused pkgs, adds memstore test * MemStore must be started after construction * MemstoreTenantManager * ruler loading * ruler instantiation * better metrics & logging in ruler * grpc cortex compatibility in go.mod * cortex vendoring compat * increments memory cache hits only if cached * loki in memory metrics use prometheus default registerer * ruler only depends on ring * managerfactory rename * revendors cortex * ignore emacs stashing * adds comments * ruler /loki/api/v1 prefix * revendoring compat * comment	5 years ago
Sandeep Sukhani	dab393a62d	fix a flaky test in boltdb shipper (#2550)	5 years ago
Owen Diehl	750ab36bc1	fixes batch metrics help text & corrects bucketing (#2552)	5 years ago
Ed Welch	ee28dbff2d	implement shutdown for the no-op server (#2542) ... (cherry picked from commit b4c6065b97)	5 years ago
Ed Welch	62da8bb858	restart the tailer if we fail to read and upate current position (#2532) ... (cherry picked from commit b6d9fd5a00)	5 years ago
Sandeep Sukhani	b489130828	compactor for compacting boltdb files uploaded by shipper (#2526)	5 years ago
Sandeep Sukhani	97dfb297a0	compress boltdb files to gzip while uploading from shipper (#2507)	5 years ago
Sandeep Sukhani	501f93fa92	revendor cortex to latest master (#2543)	5 years ago
Sandeep Sukhani	9b0740c0ed	upload boltdb files from shipper only when they are not expected to be modified or during shutdown (#2487) ... * upload boltdb files from shipper only when they are not expected to be modified or during shutdown * updated comment * add one more test condition to make sure files are not re-uploaded Co-authored-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Ed Welch	b4c6065b97	implement shutdown for the no-op server (#2542)	5 years ago
Sandeep Sukhani	048e8bdb9c	minor fixes and improvements for boltdb shipper (#2530) ... 1. Continue uploading of other tables during failures. 2. Remove .temp files while loading dbs during startup. 3. Remove empty table folders while loading tables during startup.	5 years ago
Owen Diehl	6fe414eb25	consistent chunk metrics (#2534)	5 years ago
Ed Welch	b6d9fd5a00	restart the tailer if we fail to read and upate current position (#2532)	5 years ago
Owen Diehl	6b6b33f9eb	adds batch based metrics (#2510) ... * adds batch based metrics * changing metric names a bit Co-authored-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Ed Welch	82845e4f78	Adds --analyize-labels to logcli series command. (#2497) ... Changes the series command to use the common matcher input found in the query and instant-query commands, instead of `logcli series --matcher='{foo="bar"}'` it's now `logcli series '{foo="bar"}'`	5 years ago
Ed Welch	e69b64f6bf	Promtail: Drop stage (#2496) ... * Adding a drop stage, it's very broken but want feedback on the design in the docs. * documentation fixes * documentation fixes * implemented and added tests * add a metric to track dropped logs with a configurable reason label.	5 years ago
Ward Bekker	8ff8b42899	Added Sha3 as alternative (#2480) ... * Added Sha3 as alternative * Added crypto x dependency to modules.txt * CI not picking up explicit module def * CI not picking up explicit module def * CI not picking up explicit module def * add x/crypto/sha3/ to vendor dir * Implemented review feedback * doc fix * Update docs/sources/clients/promtail/stages/replace.md Co-authored-by: Ed Welch <ed@oqqer.com> * Update docs/sources/clients/promtail/stages/template.md Co-authored-by: Ed Welch <ed@oqqer.com> Co-authored-by: Ed Welch <ed@oqqer.com>	5 years ago
Sandeep Sukhani	cf64b70db3	add some spans for boltdb shipper index queries (#2495)	5 years ago
Sandeep Sukhani	f1d00807eb	fix a bug in ingester doing store queries when using boltdb shipper (#2493)	5 years ago
Ed Welch	44f8dc3e46	enable the MustExist flag when starting a tailer on a fail, this will cause the tail to fail fast and allow promtail to attempt to re-open the file. (#2491)	5 years ago
Ed Welch	80693cae6f	Logcli: automatically batch requests (#2482) ... * first stab at batching logcli requests * fix other calls to printResult * working batching code * refactor the logcli Client into an interface so that it can be mocked for testing. * fixing some bugs * refactoring the output interface to make testing easier * starting to add tests * adding a bunch of tests fixing up how the MockQuerier works. * updating docs * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>	5 years ago
Ed Welch	7418d42141	Promtail: force the log level on any Loki Push API target servers to match Promtail's log level. (#2475) ... * force the log level on any Loki Push API target servers to match Promtail's log level. * also include logformat	5 years ago
Ed Welch	b8a61357bb	Loki: fix batch iterator error when all chunks overlap and chunk time ranges are greater than query time range (#2484) ... * Fixes a bug where if all chunks are fetched before finding a non-overlapping chunk, and the chunk from/through times are outside of the query request times, we would incorrectly set the iterator from/to bounds leading to missing logs in the query. * uncomment `includesOverlap` which was commented during testing and not fixed by mistake.	5 years ago
Sandeep Sukhani	c5bc41628a	download boltdb files parallelly during reads (#2483) ... * download boltdb files parallelly during reads * changes suggested from PR review	5 years ago
Aditya C S	68568f141e	colored labels output for logcli (#2470) ... * colored labels output for logcli * add period to all cli description	5 years ago
Ed Welch	36164bbe1a	Promtail: use --client.external-labels for all clients (#2474) ... * --client.external-labels command line argument will now apply the labels to all clients configured in the clients config section of the config file. * do better Ed	5 years ago
Owen Diehl	f8ee408180	series endpoint uses normal splits (#2472)	5 years ago
Owen Diehl	05e0e91d6e	Fix/promtail yaml config (#2471) ... * promtail config cloneable * config parsing compile time checks against cloneable	5 years ago
Owen Diehl	7530bf6def	avoid mutating config while parsing -config.file (#2392) ... * avoid mutating config while parsing -config.file * minimal config mutation test case * logcli local query config file compat	5 years ago
Owen Diehl	cb20afaa26	BatchIter edge cases (#2466) ... * sampleIter uses correct cache * minimal lazy chunk iterator test * memchunk Blocks() inclusivity * fixes a few edge cases in the batchiterator batching * fixes bad metric name in test * due to later chunks len check, resetting nextChunk is unnecessary * lazychunks pop test * safe starting of batchChunkIterator * batchiter rudimentary safe start test	5 years ago