161 Commits (80a4261b467c6e1feefcd00da7bdd69e56d3a026)

Author	SHA1	Message	Date
Cyril Tovena	80a4261b46	Add fluent-bit missing link in the main documentation page. (#1106)	6 years ago
Marcos Nils	cc45d70477	Deploy prometheys from helm chart (#1104) ... Add chart values to deploy prometheus locally. This disables persistentVolumes as it'd fail if deployed locally	6 years ago
Robert Fratto	57e7a1c386	docs: update stages README with the docker and cri stages (#1094)	6 years ago
Xiang Dai	ca6fce19cc	docs(stage): add docker and cri (#1091) ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Hiroshi Hatake	0cfa33d90d	fluent-bit shared object go plugin (#847) ... * Import fluent-bit-go-loki plugin sources * Add fluent-bit-go package constraint * Ensure dependencies with dep ``` $ dep ensure ``` * Update .gitignore * Move fluent-bit-go-loki to fluent-bit/fluent-bit-go-loki directory * Add documentation for fluent-bit-go-loki * Fix for lint * Fix for goimports errors * Display fluent-bit-go-loki plugin version * Use more descriptive description for fluent-bit Loki plugin * Remove needless newlines * Rectify fluent-bit-go-loki makefile Remove needless parts and rename meaningless target * Use more descriptive description in README * refactor(fluent-bit): move make targets into root Makefile * Organize imports * Reorder imports with goimports $ goimports -w out_loki.go * Remove needless LICENSE file Because it is the same for Loki repository. * Rely on Loki client retry mechanism * Make descriptions more clearly * Change default unit * BatchWait: msec -> sec * BatchSize: KiB -> Byte * Use logql to parse Loki native labels format * Use logger instead of fmt.Printf * Update documentation to reflect recent changes * Use prometheus version module to print version * Dump error message with logger * Use DYN_GO_FLAGS instead of custom FLAGS for fluent-bit-plugin * Support RemoveKeys parameter * use logql.ParseMatchers() * refactor fluent-bit go plugin * add ci step for docker image * fix lint issues * fix a failing url test * fix a failing url test * add build images for drone ci * Adding labelmap file to complex record to labels Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add helm chart and fix a bug with labelmap * New push path * dep sync * Move fluent-bit folder and use jsonnet for drone * fix build * Adds more documentation and include a basic config in the container Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove binaries * Some readme grammar fixes * docs: really nitpicky grammar change in clients README * Add helm documentation * fixes bad config * bump chart * fixes .gitignore	6 years ago
flouthoc	1f0b7cc5da	Fix Docs: Change Imagepull policy to IfNotpresent / Add loki-canary base manifests (#1073)	6 years ago
Xiang Dai	d59b6481b2	unify references to GOPATH (#1069) ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Xiang Dai	8c8fc33d7f	doc: skip jb init when using Tanka (#1068) ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Jonas Kello	f34b006538	Fix spelling of HTTP header (#1064)	6 years ago
Robert Fratto	a3fde23651	docs: fix deprecated warning in api.md (#1063)	6 years ago
Robert Fratto	65ba42a6e7	Documentation Rewrite (#982) ... * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)	6 years ago
flouthoc	f755c59011	Fix Docs: Change Imagepull policy to IfNotpresent / Add loki-canary base manifests (#1053)	6 years ago
Edward Welch	50456f928c	Revert "Updated stream json objects to be more parse friendly (#1010)" ... This reverts commit 6185d543	6 years ago
Joe Elliott	6185d54320	Updated stream json objects to be more parse friendly (#1010) ... * Added custom marshaller for Entry Signed-off-by: Joe Elliott <number101010@gmail.com> * Added comment and test Signed-off-by: Joe Elliott <number101010@gmail.com> * Fixed spelling error * Added a custom marshaller to map entries => values * Added support for labels Signed-off-by: Joe Elliott <number101010@gmail.com> * Changed test to only check to the microsecond level Signed-off-by: Joe Elliott <number101010@gmail.com> * Extended Entry tests Signed-off-by: Joe Elliott <number101010@gmail.com> * Swapped to nanosecs encoded as strings * Cleaned up docs with new loki paths. Removed references to deprecated endpoints * Added support for /loki/api/v1/push Signed-off-by: Joe Elliott <number101010@gmail.com> * Removed obsolete comment Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated docs for new push endpoint Signed-off-by: Joe Elliott <number101010@gmail.com> * Ran gofmt on test file Signed-off-by: Joe Elliott <number101010@gmail.com> * Set GOGC=20 on test to avoid out of memory issue in circle ci Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Joe Elliott	47637852fb	Logcli: Add Support for New Query Path (#987) ... Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Cyril Tovena	364b5bc4f6	Make Loki HTTP API more similar to Prometheus	6 years ago
Edward Welch	abe96fc200	fixing lots of broken links and a few typos	6 years ago
Robert Fratto	105dbec480	docs: fix example with pulling systemd logs ... /etc/machine-id must be mounted in the container for promtail to know which systemd journal to read from.	6 years ago
Xiang Dai	3370ccfd7d	fix positions.yaml location reference ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Robert Fratto	b74db24a00	docs: re-add docs from #654	6 years ago
Robert Fratto	7195539a3f	docs: incorporate formatting fixes from #860	6 years ago
Robert Fratto	c20c489cf6	docs: add README.md to every folder	6 years ago
Robert Fratto	d10756220e	docs: restore directory structure for logentry and canary	6 years ago
sh0rez	7ba8bf0710	style: improvements	6 years ago
sh0rez	35a929c239	doc: loki + canary	6 years ago
sh0rez	dedb585bb5	docs: general documentation rework ... - restructures the docs to make them easier to explore - rewrites promtail docs - unifies, shortens and extends docs	6 years ago
Marco Pracucci	62d5122a11	Promtail exports metrics on sent and dropped log entries	6 years ago
Cyril Tovena	8f9cd97880	Improve API compatibility. ... - keep supporting regex for old endpoint. - use reserved keyword for removed property in grpc	6 years ago
Robert Fratto	8272f08621	docs: Clarify examples	6 years ago
Cyril Tovena	7f3db9d7f0	LogQL: Vector and Range Vector Aggregation. ... - adds avg,min,max,top,bottomk,stddev,stdvar,count - updates api documentation - adds tests Improve yacc & go lexer to understand duration Remove support for regexp in all queries Clean up querier and logselector	6 years ago
William Orr	8f04545c1e	Add permissions that IAM roles for Loki need (#961) ... Currently, it's difficult to determine what permissions Loki needs to operate against S3 and DynamoDB from the provided documentation. This commit adds the permissions necessary to operator Loki, to provide admins guidance on how they can run Loki with the least possible privilege.	6 years ago
Marco Pracucci	cae0491e40	Moved promtail doc into dedicated subfolder (#933)	6 years ago
Robert Fratto	4c418430be	promtail: add "max_age" field to configure cutoff for journal reading (#921) ... The journal scrape config in promtail has been updated to support a "max_age" field. max_age determines the oldest journal entry promtail will read when starting the journal reader. When unspecified, max_age defaults to 7h. Even if a position in the journal is saved in the promtail positions file, that position may be ignored if the entry corresponding to that position is older than the max_age cutoff time. Example promtail config for getting up to the last 12h of journal entries: server: http_listen_port: 9080 grpc_listen_port: 0 positions: filename: /tmp/positions.yaml clients: - url: http://localhost:3100/api/prom/push scrape_configs: - job_name: journal journal: max_age: 12h path: /var/log/journal labels: job: systemd-journal relabel_configs: - source_labels: ['__journal__systemd_unit'] target_label: 'unit'	6 years ago
Marco Pracucci	75a3e61a70	Documented promtail known failure modes	6 years ago
Edward Welch	52efdfdf40	adding the beginnings of the release doc with steps, fixing a bug in the release_prepare.sh script and tweaking the output based on the current process.	6 years ago
dalance	79333add88	Update troubleshooting.md (#896) ... Fix link format	6 years ago
Malte	ec4145297f	Fix old values in operations.md ... `from: 0` throws ``` level=error ts=2019-08-07T12:02:15.385981107Z caller=main.go:48 msg="error loading config" filename=/etc/loki/local-config.yaml err="parsing time \"0\" as \"2006-01-02\": cannot parse \"0\" as \"2006\"" ``` `store: dynamo` throws: ``` level=error ts=2019-08-07T11:59:01.688427565Z caller=main.go:71 msg="error initialising loki" err="error initialising module: table-manager: Unrecognized storage client dynamo, choose one of: aws, cassandra, inmemory, gcp, bigtable, bigtable-hashed" ```	6 years ago
asmito	f5820d4c17	update Docs: update Retention section on Operations doc file (#876) ... update retention section in docs to recommend retention to be twice the duration of periodic table	6 years ago
Cyril Tovena	8cec7aa914	improve documentation	6 years ago
Cyril Tovena	b0c05ae967	Add governance documentation	6 years ago
Fawad Halim	4d90c7713d	docs: missing escape character on regex in YAML (#811) ... * Use single quote to avoid escaping regex	6 years ago
Aditya C S	9fe1a8f152	docs(logcli): clarify usage of GRAFANA_ADDR (#822) ... Adds an example of how to setup the `GRAFANA_ADDR` environment variable when not using Grafana Cloud but rather a local or otherwise hosted instance of Loki	6 years ago
Sandeep Sukhani	459e4e3f4e	Update logcli usage in docs and improve help text	6 years ago
Edward Welch	7deb02b532	add a Name() method to the stage interface so that debug logging can show you the name of the pipeline stage which just processed the log ... remove some unnecessary logging around fsnotify events we don't care about and saving positions Make the Processing Log Lines doc a first class citizen, I reference this a lot and currently it's hidden behind 3 clicks	6 years ago
Edward Welch	3d5319e72a	adding ability to supply timezone to timestamp pipeline stage	6 years ago
Edward Welch	e6f431ad46	finishing up loki-canary move into loki repo	6 years ago
Edward Welch	cd5368a44d	preparing for move into loki repo	6 years ago
Marco Pracucci	c08ec795a7	Documented timestamp's custom format syntax (#763)	6 years ago
Marco Pracucci	e6f8d6ffad	Added date without year support to timestamp stage (#760)	6 years ago
Robert Fratto	9eb3098dea	promtail: Add systemd journal support (#730) ... Support for reading systemd journal entries has been added. promtail will look for a job in scrape_configs with a journal key to activate the journal target. If GOOS=linux and CGO_ENABLED=1, promtail will now require libsystemd headers to be available for building. If GOOS is not linux or CGO_ENABLED is not 1, journal support will be unavailable and a log message will be printed warning the user that their config file has journal tailing configured without it being built into promtail. See docs/promtail-examples.md for a concrete example of using journal support. Other structural changes made: 1. Ability for checking if scrape.Config.ServiceDiscoveryConfig is non-zero has been added. This was chosen over making ServiceDiscoveryConfig a pointer as yaml.v2 cannot parse an inline struct into a pointer value. 2. Updated pipeline logger component name to journal_pipeline and file_pipeline for JournalTargetManager and FileTargetManager respectively. 3. The positions file will now store positions as strings instead of integers. Existing positions will be read in properly but written out as strings the next time the positions file is saved. This is done to be able to store the journal cursor, which is a string. The positions API has been updated to support reading in the old integer values and the new string values.	6 years ago