apitech
/
loki
mirror of https://github.com/grafana/loki
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Like Prometheus, but for logs.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
4516 Commits
1062 Branches
354 Tags
713 MiB
Tag: Branch: Tree: 71846b0430
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '71846b0430'
${ noResults }
loki/docs/sources/configuration/examples.md

340 lines
6.5 KiB
Raw Normal View History Unescape

Sync docs to website (#2378) * update docs location * add workflow * update docs content * update content * cleanup
5 years ago
---
title: Examples
---
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
# Loki Configuration Examples
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
## almost-zero-dependency.yaml
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```yaml
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
# This is a configuration to deploy Loki depending only on a storage solution
# for example, an S3-compatible API like MinIO.
# The ring configuration is based on the gossip memberlist and the index is shipped to storage
# via Single Store (boltdb-shipper)
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
auth_enabled: false
server:
http_listen_port: 3100
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
distributor:
ring:
kvstore:
store: memberlist
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
ingester:
lifecycler:
ring:
kvstore:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
store: memberlist
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
replication_factor: 1
final_sleep: 0s
chunk_idle_period: 5m
chunk_retain_period: 30s
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
memberlist:
abort_if_cluster_join_fails: false
# Expose this port on all distributor, ingester
# and querier replicas.
bind_port: 7946
# You can use a headless k8s service for all distributor,
# ingester and querier components.
join_members:
- loki-gossip-ring.loki.svc.cluster.local:7946
max_join_backoff: 1m
max_join_retries: 10
min_join_backoff: 1s
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
schema_config:
configs:
updates loki config examples (#2097)
6 years ago
- from: 2020-05-15
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
store: boltdb-shipper
object_store: s3
Recommend using the latest schema version (v11) (#1608)
6 years ago
schema: v11
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
index:
prefix: index_
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
period: 24h
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
storage_config:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
boltdb_shipper:
active_index_directory: /loki/index
cache_location: /loki/index_cache
shared_store: s3
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
aws:
s3: s3://access_key:secret_access_key@custom_endpoint/bucket_name
s3forcepathstyle: true
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
limits_config:
enforce_metric_name: false
reject_old_samples: true
reject_old_samples_max_age: 168h
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
compactor:
working_directory: /data/compactor
shared_store: s3
compaction_interval: 5m
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
## aws-basic-config-no-creds.yaml
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```yaml
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
# If you don't wish to hard-code S3 credentials you can also configure an EC2
# instance role by changing the `storage_config` section
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
schema_config:
configs:
updates loki config examples (#2097)
6 years ago
- from: 2020-05-15
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
store: aws
object_store: s3
Recommend using the latest schema version (v11) (#1608)
6 years ago
schema: v11
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
index:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
prefix: loki_
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
storage_config:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
aws:
s3: s3://region/bucket_name
dynamodb:
dynamodb_url: dynamodb://region
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
## aws-basic-config.yaml
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```yaml
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
# This partial configuration uses S3 for chunk storage and uses DynamoDB for index storage
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
schema_config:
configs:
updates loki config examples (#2097)
6 years ago
- from: 2020-05-15
store: aws
object_store: s3
schema: v11
index:
prefix: loki_
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
storage_config:
aws:
s3: s3://access_key:secret_access_key@region/bucket_name
Update Cortex to latest master (#1869) * Update Cortex to master Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix compilation errors after Cortex update. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Update to Cortex v1.0.0-rc.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added missing vendored file. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Vendor Cortex 1.0.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Configuration changes. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Mention Cortex 1.0 changes and link to docs. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix jsonnet files, and mention fields that were removed. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>
6 years ago
dynamodb:
dynamodb_url: dynamodb://access_key:secret_access_key@region
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```
Feat: add Baidu Cloud BOS as storage backends for Loki #4788 (#5848) * feat: add baidu bce bos storage support Signed-off-by: arcosx <arcosx@outlook.com> * add baidu bce bos as chunk storage backend Signed-off-by: arcosx <arcosx@outlook.com> * fix: some doc error && rewrite bad code Signed-off-by: arcosx <arcosx@outlook.com> * fix: add the `BceServiceError` source link Signed-off-by: arcosx <arcosx@outlook.com> * Update CHANGELOG.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Signed-off-by: arcosx <arcosx@outlook.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
## bos-config.yaml
```yaml
schema_config:
configs:
- from: 2020-05-15
store: boltdb-shipper
object_store: bos
schema: v11
index:
prefix: index_
period: 24h
storage_config:
boltdb_shipper:
active_index_directory: /loki/index
cache_location: /loki/index_cache
shared_store: bos
bos:
bucket_name: bucket_name_1
endpoint: bj.bcebos.com
access_key_id: access_key_id
secret_access_key: secret_access_key
compactor:
working_directory: /tmp/loki/compactor
shared_store: bos
```
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
## cassandra-index.yaml
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```yaml
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
# This is a partial config that uses the local filesystem for chunk storage and Cassandra for index storage
configuration doc improvements (#2318)
6 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
schema_config:
configs:
- from: 2020-05-15
store: cassandra
object_store: filesystem
schema: v11
index:
prefix: cassandra_table
period: 168h
configuration doc improvements (#2318)
6 years ago
storage_config:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
cassandra:
username: cassandra
password: cassandra
addresses: 127.0.0.1
auth: true
keyspace: lokiindex
filesystem:
directory: /tmp/loki/chunks
configuration doc improvements (#2318)
6 years ago
```
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
## complete-local-config.yaml
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
```yaml
auth_enabled: false
server:
http_listen_port: 3100
ingester:
lifecycler:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
address: 127.0.0.1
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
ring:
kvstore:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
store: inmemory
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
replication_factor: 1
final_sleep: 0s
chunk_idle_period: 5m
chunk_retain_period: 30s
schema_config:
configs:
- from: 2020-05-15
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
store: boltdb
object_store: filesystem
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
schema: v11
index:
prefix: index_
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
period: 168h
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
storage_config:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
boltdb:
directory: /tmp/loki/index
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
filesystem:
directory: /tmp/loki/chunks
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
limits_config:
enforce_metric_name: false
reject_old_samples: true
reject_old_samples_max_age: 168h
```
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
## example-schema-config.yaml
configuration doc improvements (#2318)
6 years ago
```yaml
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
# Additional example schema configuration for Cassandra
schema_config:
configs:
# Starting from 2018-04-15 Loki should store indexes on Cassandra
# using weekly periodic tables and chunks on filesystem.
# The index tables will be prefixed with "index_".
configuration doc improvements (#2318)
6 years ago
- from: "2018-04-15"
store: cassandra
object_store: filesystem
schema: v11
index:
period: 168h
prefix: index_
# Starting from 2020-6-15 we moved from filesystem to AWS S3 for storing the chunks.
- from: "2020-06-15"
store: cassandra
object_store: s3
schema: v11
index:
period: 168h
prefix: index_
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
configuration doc improvements (#2318)
6 years ago
```
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
## google-cloud-storage-config.yaml
```yaml
# This partial configuration uses GCS for chunk storage and uses BigTable for index storage
schema_config:
configs:
- from: 2020-05-15
store: bigtable
object_store: gcs
schema: v11
index:
prefix: loki_index_
period: 168h
storage_config:
bigtable:
instance: BIGTABLE_INSTANCE
project: BIGTABLE_PROJECT
gcs:
bucket_name: GCS_BUCKET_NAME
```
## s3-compatible-apis.yaml
```yaml
# S3-compatible APIs such as Ceph Object Storage with an S3-compatible API, can be used.
# If the API supports path-style URLs rather than virtual hosted bucket addressing,
# configure the URL in `storage_config` with the custom endpoint
schema_config:
configs:
- from: 2020-05-15
store: aws
object_store: s3
schema: v11
index:
prefix: loki_
storage_config:
aws:
s3: s3://access_key:secret_access_key@region/bucket_name
dynamodb:
dynamodb_url: dynamodb://access_key:secret_access_key@region
```
## s3-expanded-config.yaml
```yaml
# S3 configuration supports an expanded configuration.
# Either an `s3` endpoint URL can be used, or an expanded configuration can be used.
schema_config:
configs:
- from: 2020-05-15
store: aws
object_store: s3
schema: v11
index:
prefix: loki_
storage_config:
aws:
bucketnames: bucket_name1, bucket_name2
endpoint: s3.endpoint.com
region: s3_region
access_key_id: s3_access_key_id
secret_access_key: s3_secret_access_key
insecure: false
sse_encryption: false
http_config:
idle_conn_timeout: 90s
response_header_timeout: 0s
insecure_skip_verify: false
s3forcepathstyle: true
```