434 Commits (20d6c196b5826269f2a0196295d64063a28af498)

 

All Branches   

Search

Author	SHA1	Message	Date
Tom Wilkie	db26fd3691	Update comment. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	44814cc274	Compare lines directly. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	42df286b7e	Factor out mostCommon function, test it, fix it. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	db36b3c74e	Update heap iterator to allow for entries with duplicate timestamps. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	26f3b52096	Relax restriction on timestamp reuse in chunks, add test. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Anthony Woods	5cb9e239a6	Merge pull request #294 from grafana/fixPromtailReqDurMetric ... fix promtail_request_duration metric	6 years ago
woodsaj	93fbd40e2f	fix promtail_request_duration metric	6 years ago
Tom Wilkie	2365004683	Explicty encode the chunk. ... I broke this when I updated the vendored Cortex, which includes ac65306519 (diff-42196489d8c6339357699ab3656cb2e1R315). Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	b2d8d15202	Put chunk_idle_period in the right place in the ksonnet. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	10d49e798b	Remove stream from index when its remove from memory. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
woodsaj	4582c4303b	more nits	6 years ago
woodsaj	ceb9205ad2	address review feedback	6 years ago
woodsaj	329ed9a123	start and stop modules in correct order ... When starting up, start all dependencies first then start the target module. When stopping, reverse the order to ensure we dont try and stop a module while there is still something running that needs it. fixes #105	6 years ago
Tom Wilkie	899faf1e6c	Don't commit jsonnet lock file. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	e7931a50d0	Fix promtail active targets & files dashboard. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	776c37e93f	Add FOSDEM video. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	f6acb87d1f	Correctly propagate errors in the distributor; should now return 4xx on OOO entries. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	68e1a049a0	lint ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	9d7691a52e	Move stuff from file -> targets to prevent the stutter; move tests about; update broken rebase. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Christian Simon	31789eafc4	Refactor structure of promtail ... This allows easier integration of other targets than files for promtail. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Anthony Woods	4c985efade	Merge pull request #281 from grafana/issue276 ... tail all container log files	6 years ago
woodsaj	37feebfa2e	tail all container log files ... kubelet creates a new log file when a container is restarted. So we need to catpure all log files in the `/var/logs/pods/<uid>/<container_name>/` dir.	6 years ago
Mike Splain	9d01cf9a81	Add pvc and move data to data (#156)	6 years ago
Xiang Dai	c6d0dc0af5	Add k8s part in docs ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Anthony Woods	df84364788	handle symbolic links correctly (#275) ... * handle symbolic links correctly When tailing a file that is rotated we expect that a fsnotify.Rename event will be sent when the old file is renamed and a fsnotif.Create event will be sent when the replacement file is created. This allows us to close and re-open the file. However if the file we are tailing is a symbolic link (and the target is in another directory) we wont get these events. To address this we need to tail the target file directly. fixes #274 * handle symlinks being re-linked When a symbolic link is re-linked we will only get a fsnotify.Create event. No rename or delete event will have been sent to trigger the tailer to be stoped. When this happens we should stop the current tailer for the path and start a new one. This will allow us to perform a new Readink on the path to get the updated target filename.	6 years ago
Goutham Veeramachaneni	7763e8f3dd	Flush idle chunks properly (#209) ... * Flush idle chunks properly Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Review feedback Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Review feedback. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Check the correct chunk is full before appending a new chunk. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Add the config to helm and ksonnet too. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
David	55daa5e1c7	Expand documentation (#261) ... * Clarify links to other sections * Expanded setup sections * Clarified usage docs * Extracted contributing.md * Extracted provisioning.md * Operations docs * Troubleshooting docs started * Review feedback. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	fad57e299e	Fix validation; allow 'metrics' without a metric name. (#268) ... * Update cortex to include optionally-enforce-metric-name Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Configure validation to allow 'metrics' without metric names. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	a422f394bb	Wait for the right number of streams. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	6d19632215	add active files and targets to promtail dashboard. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	29c2213d1a	Add more metrics to promtail. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	1dd6ca07c7	Prevent ks diffs. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	60ea486a31	Add lines & bytes read to promtail dashboard. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	eeac68f183	Log filename with parsing errors. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	928acc17a2	Look for promtail image in promtail dashboards. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	f6d547d32d	Don't log request body. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	ab4c5bebab	Validate labels in the distributor. (#251) ... Also, make ErrOutOfOrder a HTTP 4xx error and continue to append even when we encourter an out of order entry. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Andrew Fake	071ea04240	Fixed inline YAML indentation for promtail (#255)	6 years ago
Ed	3e6a75e182	removing incorrect calling of positions.Stop from within a target as it runs single instance within promtail, moved the call to Stop up to promtail.go within the Shutdown() method. Should Fix #249 (#252)	6 years ago
Tom Wilkie	ffe109384b	Tweak Loki Writes dashboards, add resource request and limits to distributor and ingester ksonnet. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	97a87f5af0	Fixup Loki monitoring mixin (#248) ... * Fix the mixin to reference the mixin-utils pkg. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * s/g.selector/utils.selector/ Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Actually import utils. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Don't cut corners with replacing. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	9d2c6cf2d3	s/__meta_kubernetes_container_name/__meta_kubernetes_pod_container_name/ for the helm chart too. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Anthony Woods	5c006783e9	set __path__ correctly in promtail config (#245) ... __path__ is now expected to be a `glob` match, not a directory. In k8s the "glob" expression needed is just the exact file path of the container log, which is `/var/log/pods/<podUID>/<container_name>/0.log`	6 years ago
Ed	07f20b0db3	Unit tests for Promtail (#244) ... * Adding a test for target.go Fixing some shutdown issues where tailers were stopped but didn't properly wait for the current position to be saved to file Fixed an issue where an empty directory would lead to nothing being tailed * adding more tests for target.go * renaming quitComplete -> done per feedback making PositionsFile private again, no reason for it to be public removed unnecessary save of empty file on creation of positions file * fixing lint errors * cleaning up some comments removing TODO around directories, added a test to verify behavior some more cleanup per review * fixing imports	6 years ago
Anthony Woods	a196c27354	Merge pull request #234 from grafana/2019-01-22-fix-ksonnet-container-label ... fix container_name label	6 years ago
woodsaj	317b696a87	fix container_name label	6 years ago
Anthony Woods	9d0b584c5b	Merge pull request #233 from grafana/2019-01-21-promtail-ksonnet ... add external_labels support to promtail ksonnet	6 years ago
woodsaj	e044711b08	add external_labels support to promtail ksonnet	6 years ago
Anthony Woods	a13dec4d39	Merge pull request #229 from grafana/issue190 ... add container_name label to logs	6 years ago
Anthony Woods	b7a4035ba6	add container_name label to logs ... fixes #190 Pods can have multiple containers. This fix ensures that we collect logs for all containers.	6 years ago