87 Commits (c440bd2bdaec8fed13f47fdfe76dda63e7d0008a)

Author	SHA1	Message	Date
Michael Mandrus	17228e5794	CloudMigrations: Handle cancelation during snapshot building and upload (#90612) ... implement cancelation during upload and building	1 year ago
Michael Mandrus	a43a538976	CloudMigrations: Fix issues discovered during end to end testing (#90562) ... * improve error handling a retries during async operations * fix use of contexts * updates to how we call the folder api * fix urls for gms * more progress on the folder issue * fix folders * refactor for readability	1 year ago
Michael Mandrus	9b7e9d992b	CloudMigrations: Query GMS for a presigned upload url at upload time (#90505) ... query GMS for an upload url at upload time	2 years ago
Michael Mandrus	83b309c724	CloudMigrations: Don't migrate dashboards that are soft-deleted (#90454) ... * skip dashboards that are soft-deleted while building snapshots * add unit test	2 years ago
Michael Mandrus	6585ed16e5	Chore: Fix CloudMigration unit tests (#90489) ... remove parallel tests for things that deal with the database	2 years ago
Michael Mandrus	6ff21726b7	CloudMigrations: Query GMS for snapshot status with a results offset (#90453) ... * query GMS for status with an offset * remove unused state	2 years ago
Michael Mandrus	542a1bf3ac	CloudMigrations: Query Grafana Migration Status for status while the snapshot is in the cloud (#90314) ... * implement querying gms for snapshot status * add some documentation * provide snapshot resources after snapshot is created * add rate limiting to backend * fix compilation error * fix typo * add unit tests * finish merge * lint * swagger gen * more testing * remove duplicate test * address a couple PR comments * update switch statement to a map * add timeouts to gms client through the http client * remove extra whitespace * put method back where it was so the PR is less confusing * fix tests * add todo * fix final unit test	2 years ago
Bruno	420ff1d07b	Cloud migration: upload snapshot files using presigned url (#90273) ... * Cloud migration: upload snapshot files using presigned url * log error if index file cannot be closed * log error if file cannot be closed in uploadUsingPresignedURL	2 years ago
Michael Mandrus	317da43a84	CloudMigration: Provide a stats rollup in the GetSnapshot response (#90252) ... * order session list descending * add snapshot status method to store * query stats while retrieving snapshot * return stats in dto * swagger * fix tests * commit results of bingo get * fix swagger * minor improvement * fix typo * forgot a file	2 years ago
Bruno	d1952bb681	Cloud migrations: create snapshot files (#89693) ... * Cloud migrations: create snapshot and store it on disk * fix merge conflicts * implement StartSnapshot for gms client * pass snapshot directory as argument to snapshot builder * ensure snapshot folder is set * make swagger-gen * remove Test_ExecuteAsyncWorkflow * pass signed in user to buildSnapshot method / use github.com/grafana/grafana-cloud-migration-snapshot to create snapshot files * fix FakeServiceImpl.CreateSnapshot * remove new line	2 years ago
Michael Mandrus	6761ed863f	CloudMigrations: Add ordering to snapshot list query (#89916) ... add ordering to snapshot list	2 years ago
Michael Mandrus	4d69213829	CloudMigrations: Break snapshot resources out into their own table (#89575) ... * create a new table for migration resources * remove raw result bytes from db * more snapshot resource management stuff * integrate new table with snapshots * pass in result limit and offset as params * combine create and update * set up xorm store test * add unit tests * save some cpu * remove unneeded arg * regen swagger * fix bug with result processing * fix update create logic so that uid isn't required for lookup * change offset to page * regen swagger * revert accidental changes to file * curl command page should be 1 indexed	2 years ago
Michael Mandrus	89337ea01f	CloudMigrations: Add unit tests for snapshot management (#89521) ... * add regex support for api tests * revert dumb thing * add api tests * add unit test for core async workflow * add xorm store unit tests * fix typo * remove unnecessary assignment	2 years ago
Michael Mandrus	8a8f97b0e4	CloudMigrations: Implement snapshot management apis (#89296) ... * add new apis * add payloads * create snapshot status type * add some impl * finish implementing update * start implementing build snapshot func * add more fake build logic * add cancel endpoint. do some cleanup * implement GetSnapshot * implement upload snapshot * merge onprem status with gms result * get it working * update comment * rename list endpoint * add query limit and offset * add helper method to snapshot * little bit of cleanup * work on swagger annotations * manual merge * generate swagger specs * clean up curl commands * fix bugs found during final testing * fix linter issue * fix unit test	2 years ago
Dave Henderson	6262c56132	chore(perf): Pre-allocate where possible (enable prealloc linter) (#88952) ... * chore(perf): Pre-allocate where possible (enable prealloc linter) Signed-off-by: Dave Henderson <dave.henderson@grafana.com> * fix TestAlertManagers_buildRedactedAMs Signed-off-by: Dave Henderson <dave.henderson@grafana.com> * prealloc a slice that appeared after rebase Signed-off-by: Dave Henderson <dave.henderson@grafana.com> --------- Signed-off-by: Dave Henderson <dave.henderson@grafana.com>	2 years ago
Michael Mandrus	9d3a4e236d	CloudMigrations: Refactor API for async work (#89084) ... * rename some stuff * more renaming * clean up api * rename more functions * rename cms -> gms * update comment * update swagger gen * update endpoints * overzealous * final touches * dont modify existing migrations * break structs into domain and dtos * add some conversion funcs * fix build * update frontend * try to make swagger happy	2 years ago
lean.dev	330da7916d	Chore: Add unit test for cloudmigration package (#88868)	2 years ago
Bruno	33b9544047	Cloud migrations: create route to delete token (#88297) ... * Cloud migrations: create route to delete token * gcom.DeleteToken returns ErrTokenNotFound instead of a boolean * remove unnecessary comment * make openapi3-gen && yarn run rtk-query-codegen-openapi ./scripts/generate-rtk-apis.ts * gcom stub: implement DeleteToken	2 years ago
Bruno	83543c6b12	Cloud migrations: create route to fetch cloud migration token (#88176) ... * Cloud migration: create route to fetch cloud migration token * implement gcomStub.ListTokens * fix swagger for POST /cloudmigration/migration * fix swagger for POST /cloudmigration/migration * fix swagger for POST /cloudmigration/migration	2 years ago
Bruno	14ccf7f6d1	Cloud migrations: return errutil.Error in http responses (#87448)	2 years ago
Bruno	6a3ab71d77	cms: clean up model file (#87179) ... * move CreateAccessTokenResponseDTO to api.go * remove unused types * run make swagger-clean && make openapi3-gen	2 years ago
lean.dev	0719f73f35	Cloud Migration: Remove ID migration in favor of UID (#86550) ... * - Added migration to add a new collumn UID to both migration and migration_run tables. - Added migration to set UID for records already existent in the database before adding a new column. - Added UID field to CloudMigration and CloudMigrationRun dtos (model.go) * Fix db migration * Updating store and model * Updating API to use UID * fix typo * update openapi specs and generated endpoints * fix spec * update openapi specs and generated endpoints * Fixing db mapping * Fix frontend * fix migration * remove migration uid from run fetch endpoint * Revert "merge" This reverts commit d654e4c530, reversing changes made to 5fe0b483eb. * manual merge * rename some funcs for consistency * make interfaces consistent * validate uids * update generated frontend api * fix enterprise spec * manually resolve api * try again * try yet again * once more --------- Co-authored-by: Josh Hunt <joshhunt@users.noreply.github.com> Co-authored-by: Michael Mandrus <michael.mandrus@grafana.com> Co-authored-by: joshhunt <josh@trtr.co>	2 years ago
bornohin6	7ce1254913	CloudMigration: Remove details from the migration run list (#87104) ... Remove details from the migration run list	2 years ago
Michael Mandrus	45a7f649fe	CMS: Create local implementation of cloud migration for dev use (#86637) ... * add developer mode property to config * create cms stub * cleanup * implement and wire up gcom stub * fix errors * don't document the flag	2 years ago
Michael Mandrus	df4c8c3cbc	CloudMigrations: Move business logic out of api layer (#86406) ... * move run migration to the cloudmigrationimpl layer * add migration run list logic down a layer * remove useless comments * pull cms calls into their own service	2 years ago
lean.dev	c8d185502b	Fixes CMS url for dev environment (#86056)	2 years ago
Bruno	69a92a7a2f	CloudMigrations: include stack id in access policy and token names (#85868) ... * CloudMigrations: include stack id in access policy and token names * CloudMigrations: include slug in the display name * formatting	2 years ago
Leonard Gram	1332d8ba24	Cloudmigration: Sets the runID correctly when saving (#85661) ... Sets the runID correctly instead of setting it to the same as the migration id.	2 years ago
idafurjes	b885da09da	CloudMigrations: Implement migrations API (#85348) ... * Implement run migration endpoint * Refactor RunMigration method into separate methods * Save migration runs fix lint * Minor changes * Refactor how to use cms endpoint * fix interface * complete merge * add individual items * adds tracing to getMigration * linter * updated swagger definition with the latest changes * CloudMigrations: Implement core API handlers for cloud migrations and migration runs (#85407) * implement delete * add auth token encryption * implement token validation * call token validation during migration creation * implement get migration status * implement list migration runs * fix bug * finish parse domain func * fix urls * fix typo * fix encoding and decoding * remove double decryption * add missing slash * fix id returned by create function * inject missing services * finish implementing (as far as I can tell right now) data migration and response handling * comment out broken test, needs a rewrite * add a few final touches * get dashboard migration to work properly * changed runMigration to a POST * swagger * swagger * swagger --------- Co-authored-by: Michael Mandrus <michael.mandrus@grafana.com> Co-authored-by: Leonard Gram <leo@xlson.com> Co-authored-by: Michael Mandrus <41969079+mmandrus@users.noreply.github.com>	2 years ago
Jo	5340a6e548	Auth: Extended JWT client for OBO and Service Authentication (#83814) ... * reenable ext-jwt-client * fixup settings struct * add user and service auth * lint up * add user auth to grafana ext * fixes * Populate token permissions Co-authored-by: jguer <joao.guerreiro@grafana.com> * fix tests * fix lint * small prealloc * small prealloc * use special namespace for access policies * fix access policy auth * fix tests * fix uncalled settings expander * add feature toggle * small feedback fixes * rename entitlements to permissions * add authlibn * allow viewing the signed in user info for non user namespace * fix invalid namespacedID * use authlib as verifier for tokens * Update pkg/services/authn/clients/ext_jwt.go Co-authored-by: Gabriel MABILLE <gamab@users.noreply.github.com> * Update pkg/services/authn/clients/ext_jwt_test.go Co-authored-by: Gabriel MABILLE <gamab@users.noreply.github.com> * fix parameter names * change asserts to normal package * add rule for assert * fix ownerships * Local diff * test and lint * Fix test * Fix ac test * Fix pluginproxy test * Revert testdata changes * Force revert on test data --------- Co-authored-by: gamab <gabriel.mabille@grafana.com> Co-authored-by: Gabriel MABILLE <gamab@users.noreply.github.com>	2 years ago
Andres Martinez Gotor	d2ca95d304	Update plugin SDK to v0.219.0 (#85438)	2 years ago
Leonard Gram	383ebb2bc4	Cloudmigration: create migration (#85386) ... * Cloudmigration: create migration * fix drone build * lint fix * fix unit test --------- Co-authored-by: Michael Mandrus <michael.mandrus@grafana.com>	2 years ago
Michael Mandrus	5a5f76ae0a	CloudMigrations: Add instance metadata to auth token (#85381) ... * update how tokens are passed around * rename structs	2 years ago
lean.dev	5b147d0847	CloudMigration: Add service to list all migrations (#85308)	2 years ago
Bruno	a2e21eac8c	Cloud migrations: create endpoint to create an access token (#84690) ... * fix merge conflicts * make token expiration configurable	2 years ago
idafurjes	e2f155f9f7	Grafana: define the api for the grafana cloudmigration api (not the csm api) (#84430) ... * Add cloud migration endpoints * Built auth into creating a migration. * Added more detail to the migration result model * goimports * Update pkg/services/cloudmigration/api/api.go Co-authored-by: lean.dev <34773040+leandro-deveikis@users.noreply.github.com> * Update pkg/services/cloudmigration/api/api.go Co-authored-by: lean.dev <34773040+leandro-deveikis@users.noreply.github.com> --------- Co-authored-by: Leonard Gram <leo@xlson.com> Co-authored-by: lean.dev <34773040+leandro-deveikis@users.noreply.github.com>	2 years ago
idafurjes	80447dd0cc	Restructure cloudmigration service (#83211) ... * Restructure cloudmigation service * Adjust codewoners and wire * Comment out unused metrics	2 years ago