The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.

prometheushacktoberfestmetricsmonitoringalertinggrafanagoinfluxdbmysqlpostgresanalyticsdata-visualizationdashboardbusiness-intelligenceelasticsearch

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

owensmallwood e375a40a0f Unified Storage: Vector storage db setup and migrations (#122751) ... * feat(unified-storage): add vector-storage database config section * feat(unified-storage): add VectorBackend interface and types * feat(unified-storage): add pgvector schema DDL and init * feat(unified-storage): add vector SQL templates and request structs Add 5 SQL template files (upsert, delete, search, get_latest_rv, create_partition) and queries.go with typed request/response structs following the sqltemplate pattern used in unified storage. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * test(unified-storage): add vector SQL template snapshot tests Add snapshot tests for all 5 SQL templates (upsert, delete, search, get_latest_rv, create_partition) using PostgreSQL dialect only via the mocks.CheckQuerySnapshots framework. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(unified-storage): add pgvectorBackend implementation Implements the VectorBackend interface using pgvector-go for half-vector similarity search, the Grafana db.DB/db.Tx abstractions for dbutil compatibility, and a sync.Map partition cache for idempotent DDL. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * test(unified-storage): add pgvectorBackend unit tests Tests cover sanitizePartitionName, Upsert no-op with empty/nil slice, Delete (all and stale), and GetLatestRV (value and no-rows cases) using the existing sqlmock test infrastructure. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * refactor(unified-storage): make vector search metadata filters generic Replace hardcoded datasource_uids/query_languages filters with a generic MetadataFilterEntry that works for any JSONB key. The SQL template now uses {{ range .MetadataFilters }} instead of dashboard-specific conditionals. * refactor(unified-storage): use migrator pattern for vector schema Replace raw schema.sql DDL with Grafana's migrator pattern (same as MigrateResourceStore). Each DDL statement is a tracked migration against the separate vector database, enabling incremental schema evolution. * devenv: add pgvector docker block for vector search integration tests PostgreSQL with pgvector extension on port 5433. Usage: make devenv sources=pgvector * feat(unified-storage): add vector database provider wiring ProvideVectorBackend connects [database_vector] config to a working pgvectorBackend: builds connection string, creates xorm engine, runs migrations, wraps as db.DB. Returns (nil, nil) if not configured. * test(unified-storage): add pgvector integration tests Tests run against real PostgreSQL+pgvector via devenv block: make devenv sources=pgvector PGVECTOR_TEST_DB="..." go test -run TestIntegration ... Covers: upsert, search with filters, GetLatestRV, delete stale, upsert overwrite. Skips when PGVECTOR_TEST_DB is not set. * chore: remove planning docs from repo * chore: remove trivial vector config tests * get tests passing * partition on namespace + model so we dont mix embeddings * wire up VectorBackend and feature flag * fix wiring * gofmt and provider func name change * docs: spec for tenant watcher/deleter tracing Performance-oriented tracing design: spans around labelling and deletion to identify slow tenants/group-resources. * chore: remove superpowers spec accidentally merged from local main The docs/superpowers/specs/2026-04-20-tenant-tracing-design.md was committed to local main and came along during a merge-back into this branch. Per repo convention, superpowers planning docs stay outside the repo. * gofmt * fix codeowners for pgvector docker block * fix CI make gen-apps * make update-workspace * fix bad comment and modowners * fix linter errors * rename ff to vector_backend * shard by table. Create tables on write. Remove rv dep for embeddings and track it globally in one table until we have a persistent queue * use halfvec(1024) for embeddings to match what GA uses. Fix some comments. * add some vector validation * gofmt * update partitioning strategy... again. One table per resource, tenants with many resources get their own dedicated partition created dynamically that has hnsw index, all other tenants share a single partition with no hnsw index * add gin index to metadata when creating new partition * move promoter into vector backend * make gen-jsonnet * use partitioning for resource tables instead. Makes things simpler and makes cross resource search easier * remove top level default partition - not used * add some comments * promoter uses partial index instead of partitions * shortens hnsw index name so theres more room for resource name since theres a 63 char max --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>		2 weeks ago
..
tracing	Chore: Use range where possible (#123281)	3 weeks ago
dependencies.go	Unified Storage: Vector storage db setup and migrations (#122751)	2 weeks ago
listener.go	…
modules.go	…
util.go	…