50 Commits (a5355fd66c96aac330b298186fd91a5d44648327)

Author	SHA1	Message	Date
Ryan McKinley	a5355fd66c	Storage: Add command line tool to migrate legacy dashboards (and folders) to unified storage (#99199)	5 months ago
Stephanie Hingtgen	0cef2b9ae7	Dashboard Versions: Make compatible with app platform (#99327)	6 months ago
Misi	437b7a565d	Auth: Add access token to in-proc communication and ServiceIdentity (#98926) ... Use fake access token for in-proc grpc and add ServiceIdentity --------- Co-authored-by: gamab <gabriel.mabille@grafana.com> Co-authored-by: Karl Persson <23356117+kalleep@users.noreply.github.com>	6 months ago
Ryan McKinley	680e6bc1f8	Authlib: Use types package rather than claims (#99243)	6 months ago
Ryan McKinley	356b32008b	Storage: Show history+trash using the list command (#99009) ... Co-authored-by: Stephanie Hingtgen <stephanie.hingtgen@grafana.com>	6 months ago
Georges Chaudy	98e9f3a534	[unistore] wire authlib compile (#99027) ... * Wire authz client compile method * add verb to metric * remove tipo	6 months ago
Ryan McKinley	cd46f1ddb9	Search: Remove history query (#99026)	6 months ago
Karl Persson	3f71a72c1a	Authz: Remove "wrapper" interface and only check feature toggle for grpc mode (#98933) ... * Remove "wrapper" interface and only check feature toggle for grpc and cloud mode * Only set name for update checks * Set dashboard permissions for admin user	6 months ago
Ryan McKinley	ed39259461	Search: Replace Origin calls with Repository (#98754)	6 months ago
Ryan McKinley	429da7fd68	SQL/Blob: Add support for blob storage to SQL backend (#98192)	6 months ago
Stephanie Hingtgen	8f6e9f8ed0	Restores in app platform (#97582)	7 months ago
Ryan McKinley	ea17b79c09	Search: Return counts for values within an folder/repository (#97534)	7 months ago
owensmallwood	d762a96436	Unified Storage: Init at startup, fix traces, and speed up indexing (#97529) ... * dont lazy init unified storage * Inits index when creating new resource server. Fixes trace propagation by passing span ctx. Update some logging. * Use finer grained cache locking when building indexes to speed things up. Locking the whole function was slowing things down. * formatting * linter fix * go mod * make update-workspace * fix workspaces check error * update dependency owner in mod file * wait 1 second before querying metrics * try with big timeout, see if fixes CI. Wont fail locally. * skips postgres integration test. Only fails in drone. Will fix later. * put delay back to 500 ms	7 months ago
Ryan McKinley	8165258a2d	Storage: Query stats within a namespace (#97403)	8 months ago
Ryan McKinley	9d89d8757f	Search: Build index from resource stats (#97320)	8 months ago
Ryan McKinley	f6ccf976e5	UnifiedSearch: Use ResourceIndex from dashboards apiserver (v0alpha1 only) (#96939)	8 months ago
Ryan McKinley	94262fd095	Search: expose search on dashboard apiserver (v0alpha1) (#96907)	8 months ago
Ryan McKinley	0cb6c3d7bf	UnifiedSearch: Introduce a DocumentBuilder interface (#96738)	8 months ago
Ryan McKinley	cc6d057a18	Provisioning: Rename k8s origin metadata to repo (#96524)	8 months ago
Ryan McKinley	d9b87ef987	Storage: Add authz access client stubs (#95548) ... authz stubs authz stubs lint fix Add folder move check.Name on creat fix watch	8 months ago
Ryan McKinley	e9956f2345	Storage: Always set a UID in the apiserver (#96086)	8 months ago
Georges Chaudy	c3571752b6	Unitstore: Fix the Folder migration (#96078) ... * UniStore: Add folder to the SQL backend This reverts commit aaa4f4a23e. * fix folder migration	8 months ago
Ryan McKinley	c0de407fee	K8s/Dashboards: Delegate large objects to blob store (#94943)	8 months ago
owensmallwood	b6596db75e	Unified Storage Indexer: Build tenant indexes concurrently (#95795) ... * WIP - build tenant indexes concurrently * adds local dev seeders and readme for indexer * update logging and adds locking in getShard() * update logs * Adds Namespaces func. Initializes index after ResourceServer is created. * fixes Count() and updates test lint issues * Initialize index separately. Don't do it when creating the resource server. Makes testing really awkward. * fix lint error * handles error when getting namespaces * updates test and index helper funcs	9 months ago
Leonor Oliveira	aaa4f4a23e	Revert "UniStore: Add folder to the SQL backend" (#95966) ... Revert "UniStore: Add folder to the SQL backend (#95671)" This reverts commit f075662696.	9 months ago
Georges Chaudy	f075662696	UniStore: Add folder to the SQL backend (#95671) ... * Add folder to the SQL backend * remove unused key * fix tests * Return folders from watch	9 months ago
owensmallwood	5e3e7cca0e	Search PoC: Adds traces to indexer (#95372) ... * adds traces to indexer * fix linting errors	9 months ago
Leonor Oliveira	a03652494c	Dual Writer simplification (#93852) ... * All objects should have an UID * Now with a different error message * Simplify create on DW 2: use the same object to write to both storages * Run only one test * Add check for status code * Add name if it's not present in mode2 * Populate UID in legacy * Remove logs and commented code * Change dualwriter1 * Remove commented code * Fix list test * remove get on update from dualwriter 2 * Get object before updating. Better var renaming * Finish rebasing * Comment test * Uncomment tests * Update legacy first. Add preconditions * Remove preconditions * Fix update test * copy RV from unified to legacy objects * revert changes to playlist xorm store * Improve logging. Add go routines for mode3 * Add tests for async funcs in mode3 * Lint * Lint * Lint. Start to fix tests * Fix watcher tests * Fix store tests * Fiinish fixing watcher tests * Fix server tests * add name check * Update pkg/apiserver/rest/dualwriter_mode1.go Co-authored-by: Bruno Abrantes <bruno.abrantes@grafana.com> * All objects should have an UID * Now with a different error message * Simplify create on DW 2: use the same object to write to both storages * Run only one test * Add check for status code * Add name if it's not present in mode2 * Populate UID in legacy * Remove logs and commented code * Change dualwriter1 * Remove commented code * Fix list test * remove get on update from dualwriter 2 * Get object before updating. Better var renaming * Finish rebasing * Comment test * Uncomment tests * Fix update test * revert changes to playlist xorm store * Improve logging. Add go routines for mode3 * Lint * Fix watcher tests * Fiinish fixing watcher tests * Add mode 5 with etcd test case. Add early check to fail on populated RV in payload * we can't set RV to the found object when updating * Lint * Don't fail on update playlists * Name should not be different when updating and it should be not empty on creating * Fix tests * Update pkg/apiserver/rest/dualwriter_mode2.go Co-authored-by: Todd Treece <360020+toddtreece@users.noreply.github.com> * Lint * Fix mode 5 tests * Lint * Add generateName condition on every mode. Fix tests * Lint * Add condition on where name or generate name have to be set * Fix test * Lint * Fix folders test * We dont need to send name for mode1 * Fail if UID is not present * Remove change from not running test * Remove unused line * Lint * Update pkg/storage/unified/apistore/store.go Co-authored-by: Todd Treece <360020+toddtreece@users.noreply.github.com> * Improve error message * Fix broken watcher test * Fail on name mismatch on update * Remove log * Make sure UIDs match on create in both stores * Lint * Write first to unified storage * Remove uid setting * Remove RV only in mode2 * Fix test. Remove log line * test * No need to asser on RV in mode3 * Remove RV check due to race condition * Update dualwriter.go Co-authored-by: Georges Chaudy <chaudyg@gmail.com> * Update pkg/storage/unified/client.go * remove unused parameter * log an error for object is missing UID instead of returning an error * remove obj.SetResourceVersion("") * log an error for object is missing UID instead of returning an error * FInalise merge * Move RV check to where it was * Remove name check * Remove server check for backwards compatibility * Remove unused fn * Move test checks for another PR * Dont commit go work sum changes * Only log error if RV is present for now. --------- Co-authored-by: Todd Treece <todd.treece@grafana.com> Co-authored-by: Bruno Abrantes <bruno.abrantes@grafana.com> Co-authored-by: Todd Treece <360020+toddtreece@users.noreply.github.com> Co-authored-by: Georges Chaudy <chaudyg@gmail.com>	9 months ago
owensmallwood	bda27ec8c6	Unified Storage: Add watch latency metric (#93509) ... * adds metric for watch latency * registers storage metrics when creating a new ResourceServer * defines the latency (in milliseconds) as the diff between now and the RV. Still need to wait until PR for switching RV to millisecond timestamp is rolled out. * should be micro seconds not milli * for watch latency, use diff between now and resource version and convert to seconds * fix typo	9 months ago
Ryan McKinley	3457f219be	Storage: Add blob storage interfaces (#90932) ... Co-authored-by: Jean-Philippe Quémémer <jeanphilippe.quemener@grafana.com>	9 months ago
Scott Lepper	52b70ca976	Grafana indexing poc - load and watch index (#93843) ... * list resources and load into index * watch for changes and update index	10 months ago
Georges Chaudy	03f55e5288	Unistore : Ensure Watch works in HA mode (#94120) ... * Revert "Revert "Unistore : Ensure Watch works in HA mode." (#94097)" This reverts commit 7c3fc2f261. * make previous_resource_version nullable * handle nil case	10 months ago
Georges Chaudy	7c3fc2f261	Revert "Unistore : Ensure Watch works in HA mode." (#94097) ... Revert "Unistore : Ensure Watch works in HA mode. (#93428)" This reverts commit 0a26c9e9ae.	10 months ago
owensmallwood	6a3eb276ef	Grafana Indexing PoC: Adds feature flag and gRPC endpoint (#93356) ... * adds Filter gRPC and make protobuf * adds route for querying the filter gRPC * wires up Filter gRPC call * [WIP] index from start * renames gRPC endpoint to "Search" * adds /apis/search route into k8s routes. Hacky for now. * updates readme - wrong casing * adds feature toggle for unified storage search * hides US search behind feature flag. Clean up print statements. * removes indexer - will be added in another PR * Search: Add API Builder * adds required method * implementing UpdateAPIGroupInfo (WIP) * adds groupversion * commenting out for now * remove unneeded code from experimenting and update register.go to match interface required * namespaces search route --------- Co-authored-by: leonorfmartins <leonorfmartins@gmail.com> Co-authored-by: Todd Treece <todd.treece@grafana.com>	10 months ago
Georges Chaudy	0a26c9e9ae	Unistore : Ensure Watch works in HA mode. (#93428) ... * Replace Watch with WatchNext * remove watchset * fix previous page and closing the channel * Remove the broadcaster cache to prevent dupplicated events * add watch bookmark * add watch bookmark * cleanup comments * disable the tests for bookmarks for now * Ensure we send previosu events * lint * re-introduce the cache * load from cache * disabling legacy test * disabling legacy test * Update pkg/storage/unified/resource/server.go Co-authored-by: Diego Augusto Molina <diegoaugustomolina@gmail.com> * Could not read previous events * add proper migration * Add previous_resource_version to both history and resource * First event should have an RV of 2 and not 1 * Test both storage backends * fix the inital RV for the sql backend * ensure graceful stop of the stream decoder * gocyclo --------- Co-authored-by: Diego Augusto Molina <diegoaugustomolina@gmail.com>	10 months ago
Ryan McKinley	5441e4c752	Storage: create a client with access to all interfaces, not just ResourceStore (#92967)	11 months ago
Ryan McKinley	e106df6d0b	Auth: Update unified storage to depend on AuthInfo rather than Requester (#91783) ... depend on authlib user info	11 months ago
Ryan McKinley	21d4a4f49e	Auth: use IdentityType from authlib (#91763)	11 months ago
Todd Treece	9a2c9647ee	Chore: Add storage submodule to lint & test config (#91529)	12 months ago
Ryan McKinley	391284bb33	Storage: Improve (some) error handling (#91373)	12 months ago
Ryan McKinley	f804b0baa3	Storage: Return an iterator from backend List (#91185)	12 months ago
Ryan McKinley	da65825c5f	Storage: Consolidate error handling (#91167)	12 months ago
Ryan McKinley	728150bdbd	Identity: extend k8s user.Info (#90937)	12 months ago
Ryan McKinley	9db3bc926e	Identity: Rename "namespace" to "type" in the requester interface (#90567)	1 year ago
Diego Augusto Molina	399d77a0fd	Resource server improvements and fixes (#90715) ... * cleanup dependencies and improve list method * Improve Resource Server API, remove unnecessary dependencies * Reduce the API footprint of ResourceDBInterface and its implementation * Improve LifecycleHooks to use context * Improve testing * reduce API size and improve code * sqltemplate: add DialectForDriver func and improve naming * improve lifecycle API * many small fixes after adding more tests	1 year ago
Ryan McKinley	f409f8c169	K8s/Dashboards: Implement dashboards as StorageBackend (#90295)	1 year ago
Ryan McKinley	07c2d886fa	Storage: prepare in resource bytes in storage.Interface, not the backend (#90513) ... * prepare in k8s * prepare in k8s * prepare in k8s * simplify event creation * decode the inputs	1 year ago
Ryan McKinley	030188831d	Storage: Use Error property for error handling rather than Status (#90416) ... replace status with error	1 year ago
Georges Chaudy	ff7c0edd64	ResourceServer: Update twice should return an ErrOptimisticLockingFailed (#90378) ... Update twice should return an ErrOptimisticLockingFailed	1 year ago
Ryan McKinley	079f0715aa	ResourceServer: Add resource server protobuf and wrapper (#90007)	1 year ago