756 Commits (a62f81f1cf15d49e02958ae9a6097e84986ea336)

Author	SHA1	Message	Date
Owen Diehl	4032c927cb	strict rule unmarshaling (#2580)	5 years ago
Owen Diehl	7b68293e26	logql rule loading (#2576)	5 years ago
Owen Diehl	8627af1199	Error on no schema configs (#2564) ... * ruler jsonnet * jsonnet fixes * errors instead of panics on no schema configs	5 years ago
Sandeep Sukhani	0a0ad68af2	fix dir setup based on which mode it is running (#2559)	5 years ago
Sandeep Sukhani	1bba2a89f8	add some metrics for monitoring compactor (#2548)	5 years ago
Sandeep Sukhani	4f6a4c2a93	cleanup boltdb files in queriers during startup/shutdown (#2558)	5 years ago
Sandeep Sukhani	2bb2eebace	register boltdb shipper compactor cli flags (#2546)	5 years ago
Owen Diehl	aea6c3a36d	Feature/ruler (take 2) (#2458) ... * begins speccing out ruler ruler memhistory encapsulates metricsHistory removes mutex from memhistory ruler module * upstream conflicts * implicit ast impls, parser for ruler * /api/prom ruler routes, ruler enabled in single binary * registers ruler flags, doesnt double instantiate metrics * cleanup for old samples in ruler * begins ruler tests * ForStateAppenderQuerier tests * memhistory stop * RestoreForState test * upstream querier ifc * introducing loki ruler metrics * removes rule granularity metric -- to be discussed in pr * validates ruler cfg * renames gauge metrics to not use total * removes unnecessary logs * logs synthetic restoreforstate * logs tenant in ruler * sets cortex to owen's unmerged fork * begins porting rules pkg * memstore work * work on queryable based in memory series store * removes unused pkgs, adds memstore test * MemStore must be started after construction * MemstoreTenantManager * ruler loading * ruler instantiation * better metrics & logging in ruler * grpc cortex compatibility in go.mod * cortex vendoring compat * increments memory cache hits only if cached * loki in memory metrics use prometheus default registerer * ruler only depends on ring * managerfactory rename * revendors cortex * ignore emacs stashing * adds comments * ruler /loki/api/v1 prefix * revendoring compat * comment	5 years ago
Sandeep Sukhani	dab393a62d	fix a flaky test in boltdb shipper (#2550)	5 years ago
Owen Diehl	750ab36bc1	fixes batch metrics help text & corrects bucketing (#2552)	5 years ago
Ed Welch	ee28dbff2d	implement shutdown for the no-op server (#2542) ... (cherry picked from commit b4c6065b97)	5 years ago
Ed Welch	62da8bb858	restart the tailer if we fail to read and upate current position (#2532) ... (cherry picked from commit b6d9fd5a00)	5 years ago
Sandeep Sukhani	b489130828	compactor for compacting boltdb files uploaded by shipper (#2526)	5 years ago
Sandeep Sukhani	97dfb297a0	compress boltdb files to gzip while uploading from shipper (#2507)	5 years ago
Sandeep Sukhani	501f93fa92	revendor cortex to latest master (#2543)	5 years ago
Sandeep Sukhani	9b0740c0ed	upload boltdb files from shipper only when they are not expected to be modified or during shutdown (#2487) ... * upload boltdb files from shipper only when they are not expected to be modified or during shutdown * updated comment * add one more test condition to make sure files are not re-uploaded Co-authored-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Ed Welch	b4c6065b97	implement shutdown for the no-op server (#2542)	5 years ago
Sandeep Sukhani	048e8bdb9c	minor fixes and improvements for boltdb shipper (#2530) ... 1. Continue uploading of other tables during failures. 2. Remove .temp files while loading dbs during startup. 3. Remove empty table folders while loading tables during startup.	5 years ago
Owen Diehl	6fe414eb25	consistent chunk metrics (#2534)	5 years ago
Ed Welch	b6d9fd5a00	restart the tailer if we fail to read and upate current position (#2532)	5 years ago
Owen Diehl	6b6b33f9eb	adds batch based metrics (#2510) ... * adds batch based metrics * changing metric names a bit Co-authored-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Ed Welch	82845e4f78	Adds --analyize-labels to logcli series command. (#2497) ... Changes the series command to use the common matcher input found in the query and instant-query commands, instead of `logcli series --matcher='{foo="bar"}'` it's now `logcli series '{foo="bar"}'`	5 years ago
Ed Welch	e69b64f6bf	Promtail: Drop stage (#2496) ... * Adding a drop stage, it's very broken but want feedback on the design in the docs. * documentation fixes * documentation fixes * implemented and added tests * add a metric to track dropped logs with a configurable reason label.	5 years ago
Ward Bekker	8ff8b42899	Added Sha3 as alternative (#2480) ... * Added Sha3 as alternative * Added crypto x dependency to modules.txt * CI not picking up explicit module def * CI not picking up explicit module def * CI not picking up explicit module def * add x/crypto/sha3/ to vendor dir * Implemented review feedback * doc fix * Update docs/sources/clients/promtail/stages/replace.md Co-authored-by: Ed Welch <ed@oqqer.com> * Update docs/sources/clients/promtail/stages/template.md Co-authored-by: Ed Welch <ed@oqqer.com> Co-authored-by: Ed Welch <ed@oqqer.com>	5 years ago
Sandeep Sukhani	cf64b70db3	add some spans for boltdb shipper index queries (#2495)	5 years ago
Sandeep Sukhani	f1d00807eb	fix a bug in ingester doing store queries when using boltdb shipper (#2493)	5 years ago
Ed Welch	44f8dc3e46	enable the MustExist flag when starting a tailer on a fail, this will cause the tail to fail fast and allow promtail to attempt to re-open the file. (#2491)	5 years ago
Ed Welch	80693cae6f	Logcli: automatically batch requests (#2482) ... * first stab at batching logcli requests * fix other calls to printResult * working batching code * refactor the logcli Client into an interface so that it can be mocked for testing. * fixing some bugs * refactoring the output interface to make testing easier * starting to add tests * adding a bunch of tests fixing up how the MockQuerier works. * updating docs * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>	5 years ago
Ed Welch	7418d42141	Promtail: force the log level on any Loki Push API target servers to match Promtail's log level. (#2475) ... * force the log level on any Loki Push API target servers to match Promtail's log level. * also include logformat	5 years ago
Ed Welch	b8a61357bb	Loki: fix batch iterator error when all chunks overlap and chunk time ranges are greater than query time range (#2484) ... * Fixes a bug where if all chunks are fetched before finding a non-overlapping chunk, and the chunk from/through times are outside of the query request times, we would incorrectly set the iterator from/to bounds leading to missing logs in the query. * uncomment `includesOverlap` which was commented during testing and not fixed by mistake.	5 years ago
Sandeep Sukhani	c5bc41628a	download boltdb files parallelly during reads (#2483) ... * download boltdb files parallelly during reads * changes suggested from PR review	5 years ago
Aditya C S	68568f141e	colored labels output for logcli (#2470) ... * colored labels output for logcli * add period to all cli description	5 years ago
Ed Welch	36164bbe1a	Promtail: use --client.external-labels for all clients (#2474) ... * --client.external-labels command line argument will now apply the labels to all clients configured in the clients config section of the config file. * do better Ed	5 years ago
Owen Diehl	f8ee408180	series endpoint uses normal splits (#2472)	5 years ago
Owen Diehl	05e0e91d6e	Fix/promtail yaml config (#2471) ... * promtail config cloneable * config parsing compile time checks against cloneable	5 years ago
Owen Diehl	7530bf6def	avoid mutating config while parsing -config.file (#2392) ... * avoid mutating config while parsing -config.file * minimal config mutation test case * logcli local query config file compat	5 years ago
Owen Diehl	cb20afaa26	BatchIter edge cases (#2466) ... * sampleIter uses correct cache * minimal lazy chunk iterator test * memchunk Blocks() inclusivity * fixes a few edge cases in the batchiterator batching * fixes bad metric name in test * due to later chunks len check, resetting nextChunk is unnecessary * lazychunks pop test * safe starting of batchChunkIterator * batchiter rudimentary safe start test	5 years ago
Sandeep Sukhani	4a358bc9ea	revendor cortex to latest master (#2463)	5 years ago
Ed Welch	096976511f	Make a clone of the LabelSet before handling, the handler contains a full pipeline and can modify the labels uniquely per each line which will lead to some concurrent map access panics if you don't pass a copy of the labels to each Handle invocation. (#2464)	5 years ago
Aditya C S	0c4f704deb	fix panic in cassandra storage while registering metrics (#2457)	5 years ago
Ed Welch	03e9059ecb	Loki: Improve error messages on query timeout or cancel (#2453) ... * Instead of returning "context deadline exceeded" on timeout and "context cancelled" when the query is cancelled, return a more descriptive error message. * fixing tests	5 years ago
Javier Palomo Almena	6852b1cdcc	Replace usage of sync/atomic with uber-go/atomic (#2449) ... * distributor: Replace usage of sync/atomic with uber-go/atomic Signed-off-by: Javier Palomo <javier.palomo.almena@gmail.com> * ingester: Replace usage of sync/atomic with uber-go/atomic Signed-off-by: Javier Palomo <javier.palomo.almena@gmail.com> * Vendor go.uber.org/atomic Signed-off-by: Javier Palomo <javier.palomo.almena@gmail.com> * Install faillint in the 'loki-build-image' Docker image Signed-off-by: Javier Palomo <javier.palomo.almena@gmail.com> * faillint: Ensure we are not using sync/atomic Signed-off-by: Javier Palomo <javier.palomo.almena@gmail.com>	5 years ago
Aditya C S	7eaaab608a	fix runtime_config panic (#2450)	5 years ago
Sandeep Sukhani	d5c840bd66	enforce requirment for periodic config for index tables to be 24h when using boltdb shipper (#2166)	5 years ago
Cyril Tovena	9ad98dfa7c	Split label names queries in the frontend. (#2441) ... * Split the Series API by 24h. We currently split too much by using the same split duration for query range. Let's start with 24h, just tested in ops-tools and it works better. We could later introduce a config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Split label name queries in the frontend. Build on top of #2436 and adds the ability to split label names queries. Those queries are heavy to run for long period and so splitting by day should improve query performance. The frontend also support the old legacy label names API which has a different response. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Robert Rimoczi	830174554c	allow empty replace values for replace stage (#2432)	5 years ago
Robert Fratto	b5f0c75c03	pkg/promtail: propagate a logger rather than using util.Logger globally (#2438) ... * pkg/promtail: propagate a logger rather than using util.Logger globally This commit allows for creating promtail with a custom log.Logger instance which will be propagated and used consistently throughout the Promtail package. This allows for clients to provide a Promtail-specific logger. Address a portion of #2405. * remove applyOptions function	5 years ago
Ward Bekker	0fa98d81ca	Template: Added a sha256 template function for obfuscating / anonymize PII data in e.g. the replace stage (#2422) ... * Added sha256 template method * updated hash result * Add replace with hashing example * use static hash function	5 years ago
Owen Diehl	4a45ca5e3a	Revendor cortex (#2427) ... * vendoring bump * vendoring compat	5 years ago
Sandeep Sukhani	e59adccfa0	create smaller unique files from boltdb shipper and other code refactorings (#2261) ... * rename package local to shipper * reorganized files to separate out uploads and downloads * create smaller unique files from boltdb shipper and other improvements * cancellation of downloading of initial files when service is being stopped * migration of existing files to dedicated folders and cleanup of index from ingesters * some more improvements to uploads and downloads code * tests for uploads and downloads package in shipper Signed-off-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * test cleanup fix and some other minor changes * refactor getting uploader from object key * better naming * changes suggested from PR review * Fixes goroutine loop. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Simplify getoradd table. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes loop in upload manager. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * some more tests, logs and changes suggested from PR review * move ready state check for downloaded table inside query function * add info log for successfully finishing uploading of a table * fix merge conflict * fix ingester name and mode config Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago