apitech
/
loki
mirror of https://github.com/grafana/loki
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Like Prometheus, but for logs.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
5278 Commits
1068 Branches
354 Tags
714 MiB
Tag: Branch: Tree: f70f9110aa
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'f70f9110aa'
${ noResults }
loki/docs/sources/configure/examples.md

425 lines
8.7 KiB
Raw Normal View History Unescape

Sync docs to website (#2378) * update docs location * add workflow * update docs content * update content * cleanup
5 years ago
---
title: Examples
fix remaining docs issues (#8263)
3 years ago
description: Loki Configuration Examples
Sync docs to website (#2378) * update docs location * add workflow * update docs content * update content * cleanup
5 years ago
---
fix remaining docs issues (#8263)
3 years ago
# Examples
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
## alibaba-cloud-storage-config.yaml
```yaml
# This partial configuration uses Alibaba for chunk storage
schema_config:
configs:
- from: 2020-05-15
object_store: alibabacloud
schema: v11
index:
prefix: loki_index_
period: 168h
storage_config:
alibabacloud:
bucket: <bucket>
endpoint: <endpoint>
access_key_id: <access_key_id>
secret_access_key: <secret_access_key>
```
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
## 1-Local-Configuration-Example.yaml
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
auth_enabled: false
server:
http_listen_port: 3100
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
common:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
ring:
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
instance_addr: 127.0.0.1
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
kvstore:
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
store: inmemory
replication_factor: 1
path_prefix: /tmp/loki
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
schema_config:
configs:
- from: 2020-05-15
store: boltdb-shipper
object_store: filesystem
schema: v11
index:
prefix: index_
period: 24h
```
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
## 2-S3-Cluster-Example.yaml
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
# This is a complete configuration to deploy Loki backed by a s3-Comaptible API
# like MinIO for storage. Loki components will use memberlist ring to shard and
# the index will be shipped to storage via boltdb-shipper.
auth_enabled: false
server:
http_listen_port: 3100
common:
ring:
instance_addr: 127.0.0.1
kvstore:
store: memberlist
replication_factor: 1
path_prefix: /loki # Update this accordingly, data will be stored here.
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
memberlist:
join_members:
# You can use a headless k8s service for all distributor, ingester and querier components.
- loki-gossip-ring.loki.svc.cluster.local:7946 # :7946 is the default memberlist port.
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
schema_config:
configs:
updates loki config examples (#2097)
6 years ago
- from: 2020-05-15
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
store: boltdb-shipper
object_store: s3
Recommend using the latest schema version (v11) (#1608)
6 years ago
schema: v11
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
index:
prefix: index_
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
period: 24h
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
storage_config:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
boltdb_shipper:
active_index_directory: /loki/index
cache_location: /loki/index_cache
shared_store: s3
aws:
s3: s3://access_key:secret_access_key@custom_endpoint/bucket_name
s3forcepathstyle: true
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
compactor:
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
working_directory: /loki/compactor
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
shared_store: s3
compaction_interval: 5m
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
## 3-S3-Without-Credentials-Snippet.yaml
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
# If you don't wish to hard-code S3 credentials you can also configure an EC2
# instance role by changing the `storage_config` section
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
schema_config:
configs:
updates loki config examples (#2097)
6 years ago
- from: 2020-05-15
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
store: aws
object_store: s3
Recommend using the latest schema version (v11) (#1608)
6 years ago
schema: v11
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
index:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
prefix: loki_
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
storage_config:
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
aws:
s3: s3://region/bucket_name
dynamodb:
dynamodb_url: dynamodb://region
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
## 4-BOS-Example.yaml
Feat: add Baidu Cloud BOS as storage backends for Loki #4788 (#5848) * feat: add baidu bce bos storage support Signed-off-by: arcosx <arcosx@outlook.com> * add baidu bce bos as chunk storage backend Signed-off-by: arcosx <arcosx@outlook.com> * fix: some doc error && rewrite bad code Signed-off-by: arcosx <arcosx@outlook.com> * fix: add the `BceServiceError` source link Signed-off-by: arcosx <arcosx@outlook.com> * Update CHANGELOG.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Signed-off-by: arcosx <arcosx@outlook.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
Feat: add Baidu Cloud BOS as storage backends for Loki #4788 (#5848) * feat: add baidu bce bos storage support Signed-off-by: arcosx <arcosx@outlook.com> * add baidu bce bos as chunk storage backend Signed-off-by: arcosx <arcosx@outlook.com> * fix: some doc error && rewrite bad code Signed-off-by: arcosx <arcosx@outlook.com> * fix: add the `BceServiceError` source link Signed-off-by: arcosx <arcosx@outlook.com> * Update CHANGELOG.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Signed-off-by: arcosx <arcosx@outlook.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
schema_config:
configs:
- from: 2020-05-15
store: boltdb-shipper
object_store: bos
schema: v11
index:
prefix: index_
period: 24h
storage_config:
boltdb_shipper:
active_index_directory: /loki/index
cache_location: /loki/index_cache
shared_store: bos
bos:
bucket_name: bucket_name_1
endpoint: bj.bcebos.com
access_key_id: access_key_id
secret_access_key: secret_access_key
compactor:
working_directory: /tmp/loki/compactor
shared_store: bos
```
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
## 5-S3-And-DynamoDB-Snippet.yaml
Documentation Rewrite (#982) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)
6 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
# This partial configuration uses S3 for chunk storage and uses DynamoDB for index storage
configuration doc improvements (#2318)
6 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
schema_config:
configs:
- from: 2020-05-15
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
store: aws
object_store: s3
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
schema: v11
index:
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
prefix: loki_
configuration doc improvements (#2318)
6 years ago
storage_config:
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
aws:
s3: s3://access_key:secret_access_key@region/bucket_name
dynamodb:
dynamodb_url: dynamodb://access_key:secret_access_key@region
configuration doc improvements (#2318)
6 years ago
```
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
## 6-Cassandra-Snippet.yaml
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
# This is a partial config that uses the local filesystem for chunk storage and Cassandra for index storage
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
schema_config:
configs:
- from: 2020-05-15
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
store: cassandra
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
object_store: filesystem
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
schema: v11
index:
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
prefix: cassandra_table
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
period: 168h
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
storage_config:
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
cassandra:
username: cassandra
password: cassandra
addresses: 127.0.0.1
auth: true
keyspace: lokiindex
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
filesystem:
directory: /tmp/loki/chunks
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
Replace memberlist service in favor of cortex provided service (#2224) * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist
6 years ago
```
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
## 7-Schema-Migration-Snippet.yaml
configuration doc improvements (#2318)
6 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
schema_config:
configs:
# Starting from 2018-04-15 Loki should store indexes on Cassandra
# using weekly periodic tables and chunks on filesystem.
# The index tables will be prefixed with "index_".
configuration doc improvements (#2318)
6 years ago
- from: "2018-04-15"
store: cassandra
object_store: filesystem
schema: v11
index:
period: 168h
prefix: index_
# Starting from 2020-6-15 we moved from filesystem to AWS S3 for storing the chunks.
- from: "2020-06-15"
store: cassandra
object_store: s3
schema: v11
index:
period: 168h
prefix: index_
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
configuration doc improvements (#2318)
6 years ago
```
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
## 8-GCS-Snippet.yaml
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
# This partial configuration uses GCS for chunk storage and uses BigTable for index storage
schema_config:
configs:
- from: 2020-05-15
store: bigtable
object_store: gcs
schema: v11
index:
prefix: loki_index_
period: 168h
storage_config:
bigtable:
instance: BIGTABLE_INSTANCE
project: BIGTABLE_PROJECT
gcs:
bucket_name: GCS_BUCKET_NAME
```
Docs: Improve/update examples page (#8338) What this PR does / why we need it: Update our examples page to reflect recent changes to Loki configuration. Motivated by feedback on #6122
3 years ago
## 9-Expanded-S3-Snippet.yaml
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>
4 years ago
# S3 configuration supports an expanded configuration.
# Either an `s3` endpoint URL can be used, or an expanded configuration can be used.
schema_config:
configs:
- from: 2020-05-15
store: aws
object_store: s3
schema: v11
index:
prefix: loki_
storage_config:
aws:
bucketnames: bucket_name1, bucket_name2
endpoint: s3.endpoint.com
region: s3_region
access_key_id: s3_access_key_id
secret_access_key: s3_secret_access_key
insecure: false
sse_encryption: false
http_config:
idle_conn_timeout: 90s
response_header_timeout: 0s
insecure_skip_verify: false
s3forcepathstyle: true
```
[new] chunk backend: Integrate Alibaba Cloud oss (#8410)
3 years ago
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
## 10-S3-And-DynamoDB-With-KMS-Snippet.yaml
[new] chunk backend: Integrate Alibaba Cloud oss (#8410)
3 years ago
```yaml
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
# This partial configuration uses S3 for chunk storage and uses DynamoDB for index storage and a KMS CMK for encryption
[new] chunk backend: Integrate Alibaba Cloud oss (#8410)
3 years ago
schema_config:
configs:
- from: 2020-05-15
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
store: aws
object_store: s3
[new] chunk backend: Integrate Alibaba Cloud oss (#8410)
3 years ago
schema: v11
index:
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
prefix: loki_
[new] chunk backend: Integrate Alibaba Cloud oss (#8410)
3 years ago
storage_config:
DynamoDB: Accept a KMS key for DynamoDB tables (#8469) Co-authored-by: Travis Patterson <travis.patterson@grafana.com>
3 years ago
aws:
s3: s3://access_key:secret_access_key@region/bucket_name
sse_encryption: true
sse:
type: SSE-KMS
kms_key_id: 1234abcd-12ab-34cd-56ef-1234567890ab
dynamodb:
dynamodb_url: dynamodb://access_key:secret_access_key@region
kms_key_id: 0987dcba-09fe-87dc-65ba-ab0987654321
[new] chunk backend: Integrate Alibaba Cloud oss (#8410)
3 years ago
```
feat(storage): add support for IBM cloud object storage as storage client (#8826) **What this PR does / why we need it**: Add support for IBM cloud object storage as storage client **Which issue(s) this PR fixes**: Fixes NA **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [x] Documentation added - [x] Tests updated - [ ] `CHANGELOG.md` updated --------- Signed-off-by: Shahul <shahulsonhal@gmail.com> Co-authored-by: Aman Kumar Singh <amankrsingh2110@gmail.com> Co-authored-by: Suruthi-G-K <shruthi.suruthi@gmail.com> Co-authored-by: tareqmamari <tariq.mamari@de.ibm.com> Co-authored-by: shahulsonhal <shahulsonhal@gmail.com> Co-authored-by: Aditya C S <aditya.gnu@gmail.com> Co-authored-by: Tareq Al-Maamari <tariq.mamari@gmail.com>
3 years ago
## 11-COS-HMAC-Example.yaml
```yaml
# This partial configuration uses IBM Cloud Object Storage (COS) for chunk storage. HMAC will be used for authenticating with COS.
schema_config:
configs:
- from: 2020-10-01
index:
period: 24h
prefix: loki_index_
object_store: "cos"
schema: v11
store: "boltdb-shipper"
storage_config:
cos:
bucketnames: <bucket1, bucket2>
endpoint: <endpoint>
region: <region>
access_key_id: <access_key_id>
secret_access_key: <secret_access_key>
```
## 12-COS-APIKey-Example.yaml
```yaml
# This partial configuration uses IBM Cloud Object Storage (COS) for chunk storage. APIKey will be used for authenticating with COS.
schema_config:
configs:
- from: 2020-10-01
index:
period: 24h
prefix: loki_index_
object_store: "cos"
schema: v11
store: "boltdb-shipper"
storage_config:
cos:
bucketnames: <bucket1, bucket2>
endpoint: <endpoint>
region: <region>
api_key: <api_key_to_authenticate_with_cos>
service_instance_id: <cos_service_instance_id>
auth_endpoint: <iam_endpoint_for_authentication>
```
feat(cos): Support authentication with trusted profiles (#8939) **What this PR does / why we need it**: Add trusted profile authentication in COS client **Which issue(s) this PR fixes**: Fixes NA **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [x] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Co-authored-by: shahulsonhal <shahulsonhal@gmail.com> Co-authored-by: tareqmamari <tariq.mamari@de.ibm.com>
3 years ago
## 13-COS-Trusted-Profile-Example.yaml
```yaml
# This partial configuration uses IBM Cloud Object Storage (COS) for chunk storage.
# A trusted profile will be used for authenticating with COS. We can either pass
# the trusted profile name or trusted profile ID along with the compute resource token file.
# If we pass both trusted profile name and trusted profile ID it should be of
# the same trusted profile.
# In order to use trusted profile authentication we need to follow an additional step to create a trusted profile.
# For more details about creating a trusted profile, see https://cloud.ibm.com/docs/account?topic=account-create-trusted-profile&interface=ui.
schema_config:
configs:
- from: 2020-10-01
index:
period: 24h
prefix: loki_index_
object_store: "cos"
schema: v11
store: "boltdb-shipper"
storage_config:
cos:
bucketnames: <bucket1, bucket2>
endpoint: <endpoint>
region: <region>
auth_endpoint: <iam_endpoint_for_authentication>
cr_token_file_path: <path_to_compute_resource_token>
trusted_profile_name: <name_of_the_trusted_profile> # You can also use trusted_profile_id instead of trusted_profile_name
```