268 Commits (776c37e93f5626d14cbc244d2394d1d0f2c63dca)

 

All Branches   

Search

Author	SHA1	Message	Date
Tom Wilkie	776c37e93f	Add FOSDEM video. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	f6acb87d1f	Correctly propagate errors in the distributor; should now return 4xx on OOO entries. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	68e1a049a0	lint ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	9d7691a52e	Move stuff from file -> targets to prevent the stutter; move tests about; update broken rebase. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Christian Simon	31789eafc4	Refactor structure of promtail ... This allows easier integration of other targets than files for promtail. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Anthony Woods	4c985efade	Merge pull request #281 from grafana/issue276 ... tail all container log files	6 years ago
woodsaj	37feebfa2e	tail all container log files ... kubelet creates a new log file when a container is restarted. So we need to catpure all log files in the `/var/logs/pods/<uid>/<container_name>/` dir.	6 years ago
Mike Splain	9d01cf9a81	Add pvc and move data to data (#156)	6 years ago
Anthony Woods	df84364788	handle symbolic links correctly (#275) ... * handle symbolic links correctly When tailing a file that is rotated we expect that a fsnotify.Rename event will be sent when the old file is renamed and a fsnotif.Create event will be sent when the replacement file is created. This allows us to close and re-open the file. However if the file we are tailing is a symbolic link (and the target is in another directory) we wont get these events. To address this we need to tail the target file directly. fixes #274 * handle symlinks being re-linked When a symbolic link is re-linked we will only get a fsnotify.Create event. No rename or delete event will have been sent to trigger the tailer to be stoped. When this happens we should stop the current tailer for the path and start a new one. This will allow us to perform a new Readink on the path to get the updated target filename.	6 years ago
Goutham Veeramachaneni	7763e8f3dd	Flush idle chunks properly (#209) ... * Flush idle chunks properly Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Review feedback Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Review feedback. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Check the correct chunk is full before appending a new chunk. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Add the config to helm and ksonnet too. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
David	55daa5e1c7	Expand documentation (#261) ... * Clarify links to other sections * Expanded setup sections * Clarified usage docs * Extracted contributing.md * Extracted provisioning.md * Operations docs * Troubleshooting docs started * Review feedback. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	fad57e299e	Fix validation; allow 'metrics' without a metric name. (#268) ... * Update cortex to include optionally-enforce-metric-name Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Configure validation to allow 'metrics' without metric names. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	a422f394bb	Wait for the right number of streams. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	6d19632215	add active files and targets to promtail dashboard. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	29c2213d1a	Add more metrics to promtail. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	1dd6ca07c7	Prevent ks diffs. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	60ea486a31	Add lines & bytes read to promtail dashboard. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	eeac68f183	Log filename with parsing errors. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	928acc17a2	Look for promtail image in promtail dashboards. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	f6d547d32d	Don't log request body. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	ab4c5bebab	Validate labels in the distributor. (#251) ... Also, make ErrOutOfOrder a HTTP 4xx error and continue to append even when we encourter an out of order entry. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Andrew Fake	071ea04240	Fixed inline YAML indentation for promtail (#255)	6 years ago
Ed	3e6a75e182	removing incorrect calling of positions.Stop from within a target as it runs single instance within promtail, moved the call to Stop up to promtail.go within the Shutdown() method. Should Fix #249 (#252)	6 years ago
Tom Wilkie	ffe109384b	Tweak Loki Writes dashboards, add resource request and limits to distributor and ingester ksonnet. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	97a87f5af0	Fixup Loki monitoring mixin (#248) ... * Fix the mixin to reference the mixin-utils pkg. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * s/g.selector/utils.selector/ Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Actually import utils. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Don't cut corners with replacing. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	9d2c6cf2d3	s/__meta_kubernetes_container_name/__meta_kubernetes_pod_container_name/ for the helm chart too. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Anthony Woods	5c006783e9	set __path__ correctly in promtail config (#245) ... __path__ is now expected to be a `glob` match, not a directory. In k8s the "glob" expression needed is just the exact file path of the container log, which is `/var/log/pods/<podUID>/<container_name>/0.log`	6 years ago
Ed	07f20b0db3	Unit tests for Promtail (#244) ... * Adding a test for target.go Fixing some shutdown issues where tailers were stopped but didn't properly wait for the current position to be saved to file Fixed an issue where an empty directory would lead to nothing being tailed * adding more tests for target.go * renaming quitComplete -> done per feedback making PositionsFile private again, no reason for it to be public removed unnecessary save of empty file on creation of positions file * fixing lint errors * cleaning up some comments removing TODO around directories, added a test to verify behavior some more cleanup per review * fixing imports	6 years ago
Anthony Woods	a196c27354	Merge pull request #234 from grafana/2019-01-22-fix-ksonnet-container-label ... fix container_name label	6 years ago
woodsaj	317b696a87	fix container_name label	6 years ago
Anthony Woods	9d0b584c5b	Merge pull request #233 from grafana/2019-01-21-promtail-ksonnet ... add external_labels support to promtail ksonnet	6 years ago
woodsaj	e044711b08	add external_labels support to promtail ksonnet	6 years ago
Anthony Woods	a13dec4d39	Merge pull request #229 from grafana/issue190 ... add container_name label to logs	6 years ago
Anthony Woods	b7a4035ba6	add container_name label to logs ... fixes #190 Pods can have multiple containers. This fix ensures that we collect logs for all containers.	6 years ago
Anthony Woods	fed3943596	allow promtail path to be a glob match (#206) ... * allow promtail target path to be a glob match Promtail now expects __path__ to be a glob. All files that match the glob expression will be tailed. If new files are created that match the glob, they will immediately be tailed. * remove entry from positions file when file is deleted * fix syncing the current positions to positions file * handle file renames When a file is renamed a "rename" and a "create" event are sent. We need to treat the rename as a remove. If the new filename matches the path glob, then we will start tailing it when the "create" event is reveived. * lint	6 years ago
Xiang Dai	a7f16a5bbd	helm: remove promtail sa setting (#160) ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Anthony Woods	880725f268	Fluentd plugin (#210) ... * add beginnings of fluentd plugin * working fluentd output plugin for loki * refactor fluentd plugin - update the plugin to support extra_labels, label_keys, line_format and drop_single_key options - update rspec tests - update readme - build custom docker image for docker-compose - default to systemd input by default. * update readme todo section * remove extra license file	6 years ago
Xiang Dai	cd270dc477	logcli: remove default url (#194) ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Tom Wilkie	e3e4a2d9ae	Update vendored Cortex. (#213) ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Jack Baldry	c5ce98586d	Fix typos in API documentation (#226)	6 years ago
Ken Haines	99d0f97a5c	Added call to StrorageConfig.RegisterFlags, in main.go for loki. (#216)	6 years ago
Ye Ben	904c190364	add readLines metric (#214)	6 years ago
Dan Cech	ee8c0a804e	Add missing backslash	6 years ago
Adam Shannon	eb390523e3	all: update dependencies (#211) ... * all: update dependencies * Update some more dependancies and pin the right versions for Prometheus deps. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Xiang Dai	8fa33d7496	deploy promtail on master node as default (#184) ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Xiang Dai	ffa07c0cca	tools/promtail.sh: add DATAROOT option (#98) ... * tools/promatail.sh: add DATAROOT option Signed-off-by: Xiang Dai <764524258@qq.com> * ksonnet: support custom data root Signed-off-by: Xiang Dai <764524258@qq.com> * Move dataroot setting to $._config.promtail_config.dataroot * whitespace fix * Update promtail.libsonnet	6 years ago
Tom Wilkie	a2e4f7c2f4	Changes from #85. (#205) ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Xiang Dai	38f52e4160	add comment for go get (#189) ... Signed-off-by: Xiang Dai <764524258@qq.com>	7 years ago
Joseph Salisbury	197f1adcde	Fixes protobuffer definition link text (#198)	7 years ago
Marcos Faria Arruda	29cbd06f8e	adding #contributions header to global README.md (#188)	7 years ago