Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

李国忠 0295fd4698 [new feature] promtail: Add a Promtail stage for probabilistic sampling (#7127) ... <!-- Thanks for sending a pull request! Before submitting: 1. Read our CONTRIBUTING.md guide 2. Name your PR as `<Feature Area>: Describe your change`. a. Do not end the title with punctuation. It will be added in the changelog. b. Start with an imperative verb. Example: Fix the latency between System A and System B. c. Use sentence case, not title case. d. Use a complete phrase or sentence. The PR title will appear in a changelog, so help other people understand what your change will be. 3. Rebase your PR if it gets out of sync with main --> **What this PR does / why we need it**: The sampling stage can be directly sampled. The implementation of sampling is to use the algorithm in jaeger go client ``` pipeline_stages: - sampling: rate: 0.1 ``` or it can be used with match for precise sampling. ``` pipeline_stages: - json: expressions: app: - match: pipeline_name: "app2" selector: "{app=\"poki\"}" stages: - sampling: rate: 0.1 ``` **Which issue(s) this PR fixes**: Fixes #6654 **Special notes for your reviewer**: The promtail 'rate' stage is also used with the 'match' stage for log filtering.This design makes the code very clean. Other log agents vector have log filtering built into the sampling operator, which I think is too complicated https://vector.dev/docs/reference/configuration/transforms/sample/ ``` transforms: my_transform_id: type: sample inputs: - my-source-or-transform-id exclude: null rate: 10 ``` 'rate' stage review suggestions . https://github.com/grafana/loki/pull/5051  <!-- Note about CHANGELOG entries, if a change adds: * an important feature * fixes an issue present in a previous release, * causes a change in operation that would be useful for an operator of Loki to know then please add a CHANGELOG entry. For documentation changes, build changes, simple fixes etc please skip this step. We are attempting to curate a changelog of the most relevant and important changes to be easier to ingest by end users of Loki. Note about the upgrade guide, if this changes: * default configuration values * metric names or label names * changes existing log lines such as the metrics.go query output line * configuration parameters * anything to do with any API * any other change that would require special attention or extra steps to upgrade Please document clearly what changed AND what needs to be done in the upgrade guide. --> **Checklist** - [x] Documentation added - [x] Tests updated - [ ] Is this an important fix or new feature? Add an entry in the `CHANGELOG.md`. - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Co-authored-by: J Stickler <julie.stickler@grafana.com>		3 years ago
..
alert	TOC Sync: Move alerting and recording rules under Alert. (#8805)	3 years ago
api	Loki: Add a `prepare-shutdown` endpoint (#8786)	3 years ago
best-practices	doc(best-practices): Update default value of `max_chunk_age`. (#8685)	3 years ago
clients	[new feature] promtail: Add a Promtail stage for probabilistic sampling (#7127)	3 years ago
community	Fix documentation linter errors (#8229)	3 years ago
configuration	Ruler: remote rule evaluation (#8744)	3 years ago
design-documents	Fix documentation linter errors (#8229)	3 years ago
fundamentals	[Docs] Adding context to Istio installation. (#8248)	3 years ago
getting-started	Loki Getting Started: Fix example query that was not working (#8668)	3 years ago
installation	[CI/CD] Update yaml file `./production/helm/loki/values.yaml` (+1 other) (#8655)	3 years ago
lids	LID: Improve scheduler to control QoS across users within a tenant (#8585)	3 years ago
logql	Loki: Add new logql template functions `bytes`, `duration`, `unixEpochMillis`, `unixEpochNanos`, `toDateInZone`, `b64Enc`, and `b64Dec` (#8774)	3 years ago
maintaining	Fix documentation linter errors (#8229)	3 years ago
operations	TOC Sync: Move grafana file under Visualize. (#8806)	3 years ago
release-notes	TOC Sync: Move alerting and recording rules under Alert. (#8805)	3 years ago
storage	tsdb docs first pass (#8048)	3 years ago
tools	logcli: Add parallel flags (#8518)	3 years ago
upgrading	Loki: remove `subqueries` from metrics.go logging and replace it with separate split and shard counters (#8761)	3 years ago
visualize	TOC Sync: Move grafana file under Visualize. (#8806)	3 years ago
_index.md	Docs: Add doc-validator tool to lint technical documentation (#6569)	3 years ago
logo.png	Sync docs to website (#2378)	6 years ago
logo_and_name.png	Sync docs to website (#2378)	6 years ago