45 Commits (ca6fce19cc071b6a93597d90953f947f1214dd1d)

Author	SHA1	Message	Date
Sandeep Sukhani	3e0621ebf6	verify backups to work on latest list of backups ... when tables rotate, it creates a final backup of last active table. verify backups was not having that last backup in the list so this change makes sure it has latest list of backups	6 years ago
Hiroshi Hatake	0cfa33d90d	fluent-bit shared object go plugin (#847) ... * Import fluent-bit-go-loki plugin sources * Add fluent-bit-go package constraint * Ensure dependencies with dep ``` $ dep ensure ``` * Update .gitignore * Move fluent-bit-go-loki to fluent-bit/fluent-bit-go-loki directory * Add documentation for fluent-bit-go-loki * Fix for lint * Fix for goimports errors * Display fluent-bit-go-loki plugin version * Use more descriptive description for fluent-bit Loki plugin * Remove needless newlines * Rectify fluent-bit-go-loki makefile Remove needless parts and rename meaningless target * Use more descriptive description in README * refactor(fluent-bit): move make targets into root Makefile * Organize imports * Reorder imports with goimports $ goimports -w out_loki.go * Remove needless LICENSE file Because it is the same for Loki repository. * Rely on Loki client retry mechanism * Make descriptions more clearly * Change default unit * BatchWait: msec -> sec * BatchSize: KiB -> Byte * Use logql to parse Loki native labels format * Use logger instead of fmt.Printf * Update documentation to reflect recent changes * Use prometheus version module to print version * Dump error message with logger * Use DYN_GO_FLAGS instead of custom FLAGS for fluent-bit-plugin * Support RemoveKeys parameter * use logql.ParseMatchers() * refactor fluent-bit go plugin * add ci step for docker image * fix lint issues * fix a failing url test * fix a failing url test * add build images for drone ci * Adding labelmap file to complex record to labels Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add helm chart and fix a bug with labelmap * New push path * dep sync * Move fluent-bit folder and use jsonnet for drone * fix build * Adds more documentation and include a basic config in the container Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove binaries * Some readme grammar fixes * docs: really nitpicky grammar change in clients README * Add helm documentation * fixes bad config * bump chart * fixes .gitignore	6 years ago
Joe Elliott	778c0b6857	Update loki push path (#1049) ... This commit adds a /loki/api/v1/push endpoint to mirror the new v1 API, and updates all references to the old push endpoint to new the one.	6 years ago
Sandeep Sukhani	158ca9d3dc	use latest bigtable backup docker image with fix for list backups (#1043)	6 years ago
Edward Welch	a399cc1f4f	updating the image version for loki-canary and adding the version increment to the release_prepare script	6 years ago
Sandeep Sukhani	70ed5feb9d	Change unit of duration params to hours to align it with duration config at other places in Loki (#998) ... * Change unit of duration params to hours to align it with duration config at other places in Loki other configurations like periodic table duration, retention are set in hours so this change makes duration config for backup tool consistent and easy to manage configurations * update parent docker image for bigtable backup tool	6 years ago
Sandeep Sukhani	481906c425	fix incrementing of bigtable_backup_job_backups_created metric (#930)	6 years ago
Xiang Dai	777fcfc04e	optimize image tag script (#911) ... * add quota for sed Signed-off-by: Xiang Dai <764524258@qq.com> * add comment for head Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Edward Welch	52efdfdf40	adding the beginnings of the release doc with steps, fixing a bug in the release_prepare.sh script and tweaking the output based on the current process.	6 years ago
Sandeep Sukhani	ce945b42a4	fix data type passed to a function call and usage of oldest table number in bigtable backup	6 years ago
Sandeep Sukhani	e65fd2e798	bigtable-backup-tool: Improvements (#895) ... * improvements in bigtable backup tool Added some metrics for monitoring of backup jobs Added a command to delete out of range backups, otherwise, there would be more backups than expected and alerts would start firing for unexpected backups	6 years ago
Konstantin Misyutin	9bb6bc2f26	set helm chart appVersion while release	6 years ago
sh0rez	205b43305e	chore(packaging): set tag length to 7 (#901) ... * chore(packaging): set tag length to 7 relied on git approximation before, which causes problems with other parts of the automation. Because we do not need the tag to be strictly unique, but just to identify the latest version, limiting to 7 is fine. If this ever causes problems, raise the limit but make sure to update all other places as well. * chore(packaging): request at least 7 characters Co-Authored-By: Dan Cech <dan@aussiedan.com>	6 years ago
sh0rez	45bdebf8b2	chore(ci/cd): build containers using drone.io (#891) ... Because drone.io provides us with native ARM runners, we evaluate the platform to figure out if it is a suitable replacement for CircleCI and qemu. Configuration is done using .drone/drone.jsonnet, the .drone/drone.yml is generated from that. Images are built on amd64, arm64 and arm, natively and without emulation. This allows to get rid of cross-compilation, which in turn allows more advanced builds (CGO, etc.) Hopefully this will make the CI faster and more reliable in the future. Let's see!	6 years ago
Sandeep Sukhani	bd4a76c23b	update docker image for bigtable-backup tool	6 years ago
Sandeep Sukhani	b36f680f58	Added namespace to label value of job exported from bigtable backup cronjob	6 years ago
sh0rez	f504de8013	chore(packaging): Release pipeline (#840) ... This PR sets up an automated release pipeline to cross compile build artifacts and publish them to github. mitchellh/gox is used for building, ghr for publishing	6 years ago
Sandeep Sukhani	9930f70446	bigtable-backup: Tool for creating and managing periodic tables stored in Bigtable (#729) ... * Tool for creating and managing periodic tables stored in Bigtable It has 2 commands: 1. backup-active-periodic-table: For backing up active periodic table 2. ensure-backups: It helps ensure right tables are backed up and retain only single backup for non active periodic tables	6 years ago
sh0rez	ace5993202	chore: deploy (#836) ... - bump build image to 0.4.0 - re-gen protos - re-add deploy task	6 years ago
sh0rez	b887602e36	chore(packaging/docker): Support multiple architectures (#762) ... This finally adds support for multiple architectures! 🎉 Images are now built using BuildKit (actually img), Dockerfiles were parameterized to allow this. Containers are still built on alpine, using QEMU and binfmt as a kernel compatibility layer to allow RUN steps in these. CircleCI has been fully revamped, to speed up builds and de-duplicate the configuration. Makefile has been extended with additional logic to shadow the multi-arch to non-CI users. Happy hacking on Raspberry Pi and friends :)	6 years ago
Edward Welch	cd5368a44d	preparing for move into loki repo	6 years ago
Gene Liverman	e156d3ba0c	Add selector as required by k8s 1.8 and higher. (#716) ... Fixes #715	6 years ago
Edward Welch	c326d6b08b	adding a release process	6 years ago
Edward Welch	04facc4d00	updating docs for new pipeline config. ... removed helm entry in scrape_config.sh because there doesn't seem to be anyway to make it work with new pipeline config	6 years ago
Cyril Tovena	4733221fe3	This add make target to deploy a dev version using helm (#586) ... * add a dev target to deploy the current image in k8s * impr/clients: Handle TLS config and MTLS for logcli and promtail (#540) * impr/clients: Handle TLS config and MTLS for logcli and promtail * fix/tls: Please gofmt... * impr/clients: use prometheus HTTPClientConfig for logcli and promtail * fix/promtail: Set proper Client config name * impr/promtail: Use prometheus HTTPClientConfig configuration * adapt with master * address review * fix conflicts * address requested changes * remove file * add helm dev targets * adding back assets * fix review comments * Review feedback	6 years ago
Edward Welch	34bb9db758	using an environment variable passed into an arg instead of reading the pod name from a file and the downardApi ... added a makefile	6 years ago
Steven Sheehy	ceffcb74ac	Support CRI 1.14+ directory change ... Signed-off-by: Steven Sheehy <ssheehy@firescope.com>	6 years ago
Steven Sheehy	e79414726e	Add scrape config for control plane static pods ... Signed-off-by: Steven Sheehy <ssheehy@firescope.com>	6 years ago
Steven Sheehy	201f738bda	Remove liveness probes from promtail ... Signed-off-by: Steven Sheehy <ssheehy@firescope.com>	6 years ago
Steven Sheehy	8c0b3d8099	Add a /ready endpoint to promtail ... Signed-off-by: Steven Sheehy <ssheehy@firescope.com>	6 years ago
Steven Sheehy	20d6c196b5	Separate loki & promtail charts ... Signed-off-by: Steven Sheehy <ssheehy@firescope.com>	6 years ago
Edward Welch	5b7057dbdf	Fixing promtail.sh to include the parser value in the generated yaml, defaults to docker	6 years ago
Steven Sheehy	d0f73000a8	Helm: Allow custom promtail configuration ... Signed-off-by: Steven Sheehy <ssheehy@firescope.com>	6 years ago
Tom Wilkie	55bad57ed9	Use __meta_kubernetes_pod_controller_name to ensure we scrape all pods. (#154) ... * Add a scrape config for pods without name or app labels. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * rebase with master and update to prefer name label but fallback to controller name * Update scrape_config to use pod controller_name in the job If a pod has a "name" label we use that in the job name. Otherwise, - If the pod was created directly by a controller (statefulset, daemonset, job) then we use that controller_name. - if the pod was created by controller created by a controller (deployment, cronJob) then we use the parent controller name. - add a scrape_config.sh tool that generates the scrap_configs for promtail.sh and helm chart from the ksonnet lib. * Reduce duplication in jsonnet. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Fix rebase Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Tidy up promtail config imports. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Xiang Dai	adc42ccfad	Tag with lastest (#236) ... * Tag with latest Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Nicholas Nezis	f3d37e339c	More updates to make `dataRoot` more generic	6 years ago
woodsaj	182e265440	dont add pods twice if they have app and name labels ... issue #313	6 years ago
woodsaj	37feebfa2e	tail all container log files ... kubelet creates a new log file when a container is restarted. So we need to catpure all log files in the `/var/logs/pods/<uid>/<container_name>/` dir.	6 years ago
Andrew Fake	071ea04240	Fixed inline YAML indentation for promtail (#255)	6 years ago
Anthony Woods	5c006783e9	set __path__ correctly in promtail config (#245) ... __path__ is now expected to be a `glob` match, not a directory. In k8s the "glob" expression needed is just the exact file path of the container log, which is `/var/log/pods/<podUID>/<container_name>/0.log`	6 years ago
Anthony Woods	b7a4035ba6	add container_name label to logs ... fixes #190 Pods can have multiple containers. This fix ensures that we collect logs for all containers.	6 years ago
Dan Cech	ee8c0a804e	Add missing backslash	6 years ago
Xiang Dai	ffa07c0cca	tools/promtail.sh: add DATAROOT option (#98) ... * tools/promatail.sh: add DATAROOT option Signed-off-by: Xiang Dai <764524258@qq.com> * ksonnet: support custom data root Signed-off-by: Xiang Dai <764524258@qq.com> * Move dataroot setting to $._config.promtail_config.dataroot * whitespace fix * Update promtail.libsonnet	6 years ago
Goutham Veeramachaneni	6145da1f3c	Add table manager and refer to master (#63) ... Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	7 years ago
Goutham Veeramachaneni	8c236f1c97	Update config for newer kubernetes clusters (#55) ... Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	7 years ago
Dan Cech	0401fda6fa	simple script to generate promtail yaml	7 years ago
Tom Wilkie	ca6dd2c8d5	Add scaffold and distributor implementation.	7 years ago