305 Commits (f6d0857ddf1e058a85946e77f80df346c353b614)

 

All Branches   

Search

Author	SHA1	Message	Date
Ed	f6d0857ddf	Adding a sync() function to filetarget (#293) ... * Adding a sync() function to filetarget which runs on a timer to catch any events missed by fsnotify * moving where we mark the final position to avoid a race condition exposed in testing, we want to stop the tailer before shutting down our tailer loop * Fix changes from PR and refactor to remove circular imports and make config consistent * Adding an "integration" type unit test which tests promtail as a whole * fixing a bunch of imports I munged moved tailer to its own file refactoring filetarget to make synclogic easier to follow and reused as much as possible	6 years ago
Justin Thomas	e1bc7ea6bb	typo in EntryParser comment	6 years ago
Xiang Dai	889a729f4d	Fix helm install error (#305) ... * update helm values yaml - set persistence.enabled as 'false' as default since there is no pv as default - set persistence.storageClassName as 'default' since even if pv exists, pvc still need storageClassName: ``` Normal FailedBinding 8s (x4 over 35s) persistentvolume-controller no persistent volumes available for this claim and no storage class is set ``` Signed-off-by: Xiang Dai <764524258@qq.com> * helm: delete duplicate empty blank Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Trent White	95c407ec55	Update README.md (#316) ... Added info about GrafanaCon at the top	6 years ago
Anthony Woods	5d971cd874	Merge pull request #314 from grafana/20190212-fixPromtailKsonnet ... dont add pods twice if they have app and name labels	6 years ago
woodsaj	182e265440	dont add pods twice if they have app and name labels ... issue #313	6 years ago
David	6362534da6	Merge pull request #278 from daixiang0/update-doc ... Add k8s part in docs	6 years ago
Tom Wilkie	40ae03b48a	Include the stream's labels in OOO error responses. (#304) ... * Include the stream's labels in OOO error responses. Also, read the body of error responses and log them. And retries 500s and connection errors. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Log close errors. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Update pkg/promtail/client/client.go Co-Authored-By: tomwilkie <tomwilkie@users.noreply.github.com> * Log retries at warn, final errors at error. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Anthony Woods	61fc02a002	set currLabels when currEntry is set. (#308) ... * set currLabels when creating new heapIterator fixes #307 * update unit tests to ensure labels are set correctly	6 years ago
Tom Wilkie	e1c5c4be4a	Basic distributor & ingester tests. ... Proves that they can accept multiple samples with the same timestamp. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	58d2d217f5	Tweaks	6 years ago
yubozhao	e0db03cf9f	delete s3 storage doc	6 years ago
yubozhao	d155276cd1	Roll s3/dynamo storage config doc into operation doc	6 years ago
yubozhao	7d8fd39d94	update aws doc base on Tom's suggestion	6 years ago
Julien Garcia Gonzalez	721bfd0b88	Update docs/aws_storage.md ... Co-Authored-By: yubozhao <yubz86@gmail.com>	6 years ago
yubozhao	4834fdef16	Add aws based storage configuration documentation	6 years ago
Julien Garcia Gonzalez	cca4f7ad3d	Add fluent-plugin-kubernetes_metadata_filter in fluentd plugin ... Signed-off-by: Julien Garcia Gonzalez <julien@giantswarm.io>	6 years ago
Richard Towers	b17757a25d	Fix broken link to client.go in API docs	6 years ago
Tom Wilkie	7527487f31	Track the right number of streams, and cancel the push when the request is cancelled. ... This was broken in a422f394bb. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Odin Ugedal	a59c86c68f	Switch docker base image to alpine 3.9 ... alpine:3.4 only contains a docker image for arm64, so building for other architectures doesn't work. The newest alpine relases, 3.9, is therefore better.	6 years ago
Tom Wilkie	961dd3513f	Typo. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	db26fd3691	Update comment. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	44814cc274	Compare lines directly. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	42df286b7e	Factor out mostCommon function, test it, fix it. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	db36b3c74e	Update heap iterator to allow for entries with duplicate timestamps. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	26f3b52096	Relax restriction on timestamp reuse in chunks, add test. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Anthony Woods	5cb9e239a6	Merge pull request #294 from grafana/fixPromtailReqDurMetric ... fix promtail_request_duration metric	6 years ago
woodsaj	93fbd40e2f	fix promtail_request_duration metric	6 years ago
Tom Wilkie	2365004683	Explicty encode the chunk. ... I broke this when I updated the vendored Cortex, which includes ac65306519 (diff-42196489d8c6339357699ab3656cb2e1R315). Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	b2d8d15202	Put chunk_idle_period in the right place in the ksonnet. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	10d49e798b	Remove stream from index when its remove from memory. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
woodsaj	4582c4303b	more nits	6 years ago
woodsaj	ceb9205ad2	address review feedback	6 years ago
woodsaj	329ed9a123	start and stop modules in correct order ... When starting up, start all dependencies first then start the target module. When stopping, reverse the order to ensure we dont try and stop a module while there is still something running that needs it. fixes #105	6 years ago
Tom Wilkie	899faf1e6c	Don't commit jsonnet lock file. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	e7931a50d0	Fix promtail active targets & files dashboard. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	776c37e93f	Add FOSDEM video. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	f6acb87d1f	Correctly propagate errors in the distributor; should now return 4xx on OOO entries. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	68e1a049a0	lint ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	9d7691a52e	Move stuff from file -> targets to prevent the stutter; move tests about; update broken rebase. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Christian Simon	31789eafc4	Refactor structure of promtail ... This allows easier integration of other targets than files for promtail. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Anthony Woods	4c985efade	Merge pull request #281 from grafana/issue276 ... tail all container log files	6 years ago
woodsaj	37feebfa2e	tail all container log files ... kubelet creates a new log file when a container is restarted. So we need to catpure all log files in the `/var/logs/pods/<uid>/<container_name>/` dir.	6 years ago
Mike Splain	9d01cf9a81	Add pvc and move data to data (#156)	6 years ago
Xiang Dai	c6d0dc0af5	Add k8s part in docs ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Anthony Woods	df84364788	handle symbolic links correctly (#275) ... * handle symbolic links correctly When tailing a file that is rotated we expect that a fsnotify.Rename event will be sent when the old file is renamed and a fsnotif.Create event will be sent when the replacement file is created. This allows us to close and re-open the file. However if the file we are tailing is a symbolic link (and the target is in another directory) we wont get these events. To address this we need to tail the target file directly. fixes #274 * handle symlinks being re-linked When a symbolic link is re-linked we will only get a fsnotify.Create event. No rename or delete event will have been sent to trigger the tailer to be stoped. When this happens we should stop the current tailer for the path and start a new one. This will allow us to perform a new Readink on the path to get the updated target filename.	6 years ago
Goutham Veeramachaneni	7763e8f3dd	Flush idle chunks properly (#209) ... * Flush idle chunks properly Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Review feedback Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Review feedback. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Check the correct chunk is full before appending a new chunk. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Add the config to helm and ksonnet too. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
David	55daa5e1c7	Expand documentation (#261) ... * Clarify links to other sections * Expanded setup sections * Clarified usage docs * Extracted contributing.md * Extracted provisioning.md * Operations docs * Troubleshooting docs started * Review feedback. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	fad57e299e	Fix validation; allow 'metrics' without a metric name. (#268) ... * Update cortex to include optionally-enforce-metric-name Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Configure validation to allow 'metrics' without metric names. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	a422f394bb	Wait for the right number of streams. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago