52 Commits (2e2e89a81663dfdab284e945bc508c33a6eadddb)

Author	SHA1	Message	Date
Michael Mandrus	c9d22f06c3	CloudMigrations: Bulk update local resources (#96002) ... * wip * make tests pass * get all tests passing * fixes * some small cleanup * fix test * convert delimiter keys to struct keys * dont execute empty sql statement * remove printlns * fix unit test * a bit more cleanup * whoops	12 months ago
Matheus Macabu	3958fb9e0a	CloudMigrations: Introduce RBAC role for migration assistant (#98588) ... * CloudMigrations: delete unused code * CloudMigrations: add access control and protect API + navtree with action * CloudMigrations: register access control roles * CloudMigrations: gate frontend based with access control * CloudMigrations: fix api tests * CloudMigrations: add docs on new actions and roles * CloudMigrations: dont interpolate vars to make it more greppable * CloudMigrations: run prettier	12 months ago
Dana Axinte	1699dfa307	CloudMigrations: Add support for migration of plugin resources (#95612) ... * start plugins migration * more plugin work * add warning * fakepluginsettings test * tests get plugins * lint * load logos * go lint * get all plugins once * locales * josh suggestion to inject query in rtk * more plugin filters * remove datasource warning * access control for plugins * remove unused method * lint * use gcom list	12 months ago
lean.dev	e9fae5bd7f	CloudMigration: Create authapi service (#96581)	1 year ago
Dana Axinte	924b0d0863	CloudMigration: Add user uid to on prem event collection (#94804) ... * add useruid to report events * test	1 year ago
lean.dev	750a0bed71	MigrationAssistant: Restrict dashboards, folders and datasources by the org id of the signed in user (#96339) ... apply security patch: main/206-202410241510.patch	1 year ago
Roberto Jiménez Sánchez	477326b9c3	[CloudMigrations] Fetch cloud migration status asynchronously (#96084) ... * Single go-routine without touching too many lines. * Fix unit tests * Use require for Eventually * Use a 10 second internal to poll for new results.	1 year ago
Dana Axinte	98e5048370	CloudMigration - Display different error messages for create migration errors (#94683) ... * start on tokens * more error messages * more handling * rephrased with suggestions from Daniel * separate gms parse method * use translation * refactor initial idea to use error obj * use error dto result * handle gms client * clean logs and comments * fix tests * tests for gms * test and lint * lint * one more handling from gms * typing in fe * use error interface * use validation error * remove unused gms error * use errorlib and helper function in fe * regen api * use same error util * one more error to handle	1 year ago
Dana Axinte	a50507e645	CloudMigration: Interpret error code from migration resource item (#94407) ... * start on loading the error code * error code to message mapping * use resource code type * use defined error code * partial updates from comments * i18nKey gen * fixed t * fixed translations * typing	1 year ago
Matheus Macabu	e89aef57cb	CloudMigrations: wire ngalert to cloud migration service and add slicesext.Map helper (#94254) ... * CloudMigrations: add slicesext.Map function to simplify dto creation * CloudMigrations: wire ngalert to cloud migration service	1 year ago
Roberto Jiménez Sánchez	19c77eaae1	CloudMigrations: Fix traceability & HTTP Client initialisation (#94141) ... * Add traceability to Migration Assistant feature * Fix some compilation errors * Fix lint issues * Use async context * Add trace for LibraryElements	1 year ago
Matheus Macabu	1635a3cd67	CloudMigrations: Add support for migration of Library Elements (Panels) resources (#93898) ... * CloudMigrations: create snapshots of Library Elements * CloudMigrations: render library element resource in resources table * CloudMigrations: create newtype with necessary fields for library element creation	1 year ago
Bruno	6f92fd64ce	Cloud migrations: add more context to errors (#93814) ... * Cloud migrations: add more context to errors * calls to assert.ErrorIs was passing arguments in the wrong order	1 year ago
Matheus Macabu	945484232c	CloudMigrations: remove unused code from sync migration approach (#93430)	1 year ago
Matheus Macabu	4f21ecf982	CloudMigrations: improve nil handling (#93257) ... * CloudMigrations: fail token decryption if session is not found or without a token * CloudMigrations: do not report event if session is nil	1 year ago
Michael Mandrus	eee3a75b8b	CloudMigrations: Misc cleanup before codefreeze (#91725) ... * fix retry logic * slight adjustments * fix disconnect and connect events * Update pkg/services/cloudmigration/cloudmigrationimpl/snapshot_mgmt.go Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com> --------- Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>	1 year ago
lean.dev	e20c7342a9	CloudMigration: Removes snapshot and resources when deleting a session (#91548)	1 year ago
Michael Mandrus	6cd0971dc6	CloudMigration: Show warning message for successfully migrated non-core data sources (#91545) ... * minor performance improvement * apply a warning to any non-core plugins that successfully migrate * commit frontend wip while I refactor some stuff * update api * repurpose error dialog to be a generic details dialog * whitespace * add unit test * fixes from testing * fix migration summary * add comment * fix localization stuff * fix backend test * reduce number of queries to the db * some PR feedback * whitespace	1 year ago
Michael Mandrus	3e138449bb	CloudMigrations: Fix bugs found during local testing (#91163) ... * send dashboard commands instead of dashboards * move status updates before goroutine to ensure frontend polls * fix syncing issues between snapshot state and resources * make sessionUid a requirement for modifying snapshots * move the function I meant to move earlier * remove accidental commit * another accidental commit * verify UpdateSnapshot is called with sessionUid * revert * pass in session uid everywhere * forgot to save * fix unit test * fix typo * tiny tweak	1 year ago
Michael Mandrus	dc355331a6	CloudMigrations: Store encryption key in unified secrets table (#90908) ... * store encryption key in unified secrets table * fix local dev mode * make metadata more realistic * fix tests * fix sql queries against postgres * fix stats endpoint	1 year ago
Bruno	07685646a3	Cloud migrations: include metadata returned by CMS in the index file (#90658)	1 year ago
Michael Mandrus	ee90cd3031	CloudMigrations: Send local events to gms during the migration process (#90637) ... * add gms client function * add timeout config for endpoint * report events to gms * fix lint error * clean up report calls and make sure reports all have local ids * extra validation * improve error logging and fix url	1 year ago
Michael Mandrus	17228e5794	CloudMigrations: Handle cancelation during snapshot building and upload (#90612) ... implement cancelation during upload and building	1 year ago
Michael Mandrus	a43a538976	CloudMigrations: Fix issues discovered during end to end testing (#90562) ... * improve error handling a retries during async operations * fix use of contexts * updates to how we call the folder api * fix urls for gms * more progress on the folder issue * fix folders * refactor for readability	1 year ago
Michael Mandrus	9b7e9d992b	CloudMigrations: Query GMS for a presigned upload url at upload time (#90505) ... query GMS for an upload url at upload time	1 year ago
Michael Mandrus	6ff21726b7	CloudMigrations: Query GMS for snapshot status with a results offset (#90453) ... * query GMS for status with an offset * remove unused state	1 year ago
Michael Mandrus	542a1bf3ac	CloudMigrations: Query Grafana Migration Status for status while the snapshot is in the cloud (#90314) ... * implement querying gms for snapshot status * add some documentation * provide snapshot resources after snapshot is created * add rate limiting to backend * fix compilation error * fix typo * add unit tests * finish merge * lint * swagger gen * more testing * remove duplicate test * address a couple PR comments * update switch statement to a map * add timeouts to gms client through the http client * remove extra whitespace * put method back where it was so the PR is less confusing * fix tests * add todo * fix final unit test	1 year ago
Bruno	420ff1d07b	Cloud migration: upload snapshot files using presigned url (#90273) ... * Cloud migration: upload snapshot files using presigned url * log error if index file cannot be closed * log error if file cannot be closed in uploadUsingPresignedURL	1 year ago
Michael Mandrus	317da43a84	CloudMigration: Provide a stats rollup in the GetSnapshot response (#90252) ... * order session list descending * add snapshot status method to store * query stats while retrieving snapshot * return stats in dto * swagger * fix tests * commit results of bingo get * fix swagger * minor improvement * fix typo * forgot a file	1 year ago
Bruno	d1952bb681	Cloud migrations: create snapshot files (#89693) ... * Cloud migrations: create snapshot and store it on disk * fix merge conflicts * implement StartSnapshot for gms client * pass snapshot directory as argument to snapshot builder * ensure snapshot folder is set * make swagger-gen * remove Test_ExecuteAsyncWorkflow * pass signed in user to buildSnapshot method / use github.com/grafana/grafana-cloud-migration-snapshot to create snapshot files * fix FakeServiceImpl.CreateSnapshot * remove new line	2 years ago
Michael Mandrus	4d69213829	CloudMigrations: Break snapshot resources out into their own table (#89575) ... * create a new table for migration resources * remove raw result bytes from db * more snapshot resource management stuff * integrate new table with snapshots * pass in result limit and offset as params * combine create and update * set up xorm store test * add unit tests * save some cpu * remove unneeded arg * regen swagger * fix bug with result processing * fix update create logic so that uid isn't required for lookup * change offset to page * regen swagger * revert accidental changes to file * curl command page should be 1 indexed	2 years ago
Michael Mandrus	89337ea01f	CloudMigrations: Add unit tests for snapshot management (#89521) ... * add regex support for api tests * revert dumb thing * add api tests * add unit test for core async workflow * add xorm store unit tests * fix typo * remove unnecessary assignment	2 years ago
Michael Mandrus	8a8f97b0e4	CloudMigrations: Implement snapshot management apis (#89296) ... * add new apis * add payloads * create snapshot status type * add some impl * finish implementing update * start implementing build snapshot func * add more fake build logic * add cancel endpoint. do some cleanup * implement GetSnapshot * implement upload snapshot * merge onprem status with gms result * get it working * update comment * rename list endpoint * add query limit and offset * add helper method to snapshot * little bit of cleanup * work on swagger annotations * manual merge * generate swagger specs * clean up curl commands * fix bugs found during final testing * fix linter issue * fix unit test	2 years ago
Dave Henderson	6262c56132	chore(perf): Pre-allocate where possible (enable prealloc linter) (#88952) ... * chore(perf): Pre-allocate where possible (enable prealloc linter) Signed-off-by: Dave Henderson <dave.henderson@grafana.com> * fix TestAlertManagers_buildRedactedAMs Signed-off-by: Dave Henderson <dave.henderson@grafana.com> * prealloc a slice that appeared after rebase Signed-off-by: Dave Henderson <dave.henderson@grafana.com> --------- Signed-off-by: Dave Henderson <dave.henderson@grafana.com>	2 years ago
Michael Mandrus	9d3a4e236d	CloudMigrations: Refactor API for async work (#89084) ... * rename some stuff * more renaming * clean up api * rename more functions * rename cms -> gms * update comment * update swagger gen * update endpoints * overzealous * final touches * dont modify existing migrations * break structs into domain and dtos * add some conversion funcs * fix build * update frontend * try to make swagger happy	2 years ago
lean.dev	330da7916d	Chore: Add unit test for cloudmigration package (#88868)	2 years ago
Bruno	33b9544047	Cloud migrations: create route to delete token (#88297) ... * Cloud migrations: create route to delete token * gcom.DeleteToken returns ErrTokenNotFound instead of a boolean * remove unnecessary comment * make openapi3-gen && yarn run rtk-query-codegen-openapi ./scripts/generate-rtk-apis.ts * gcom stub: implement DeleteToken	2 years ago
Bruno	83543c6b12	Cloud migrations: create route to fetch cloud migration token (#88176) ... * Cloud migration: create route to fetch cloud migration token * implement gcomStub.ListTokens * fix swagger for POST /cloudmigration/migration * fix swagger for POST /cloudmigration/migration * fix swagger for POST /cloudmigration/migration	2 years ago
lean.dev	0719f73f35	Cloud Migration: Remove ID migration in favor of UID (#86550) ... * - Added migration to add a new collumn UID to both migration and migration_run tables. - Added migration to set UID for records already existent in the database before adding a new column. - Added UID field to CloudMigration and CloudMigrationRun dtos (model.go) * Fix db migration * Updating store and model * Updating API to use UID * fix typo * update openapi specs and generated endpoints * fix spec * update openapi specs and generated endpoints * Fixing db mapping * Fix frontend * fix migration * remove migration uid from run fetch endpoint * Revert "merge" This reverts commit d654e4c530, reversing changes made to 5fe0b483eb. * manual merge * rename some funcs for consistency * make interfaces consistent * validate uids * update generated frontend api * fix enterprise spec * manually resolve api * try again * try yet again * once more --------- Co-authored-by: Josh Hunt <joshhunt@users.noreply.github.com> Co-authored-by: Michael Mandrus <michael.mandrus@grafana.com> Co-authored-by: joshhunt <josh@trtr.co>	2 years ago
bornohin6	7ce1254913	CloudMigration: Remove details from the migration run list (#87104) ... Remove details from the migration run list	2 years ago
Michael Mandrus	45a7f649fe	CMS: Create local implementation of cloud migration for dev use (#86637) ... * add developer mode property to config * create cms stub * cleanup * implement and wire up gcom stub * fix errors * don't document the flag	2 years ago
Michael Mandrus	df4c8c3cbc	CloudMigrations: Move business logic out of api layer (#86406) ... * move run migration to the cloudmigrationimpl layer * add migration run list logic down a layer * remove useless comments * pull cms calls into their own service	2 years ago
lean.dev	c8d185502b	Fixes CMS url for dev environment (#86056)	2 years ago
Bruno	69a92a7a2f	CloudMigrations: include stack id in access policy and token names (#85868) ... * CloudMigrations: include stack id in access policy and token names * CloudMigrations: include slug in the display name * formatting	2 years ago
Leonard Gram	1332d8ba24	Cloudmigration: Sets the runID correctly when saving (#85661) ... Sets the runID correctly instead of setting it to the same as the migration id.	2 years ago
idafurjes	b885da09da	CloudMigrations: Implement migrations API (#85348) ... * Implement run migration endpoint * Refactor RunMigration method into separate methods * Save migration runs fix lint * Minor changes * Refactor how to use cms endpoint * fix interface * complete merge * add individual items * adds tracing to getMigration * linter * updated swagger definition with the latest changes * CloudMigrations: Implement core API handlers for cloud migrations and migration runs (#85407) * implement delete * add auth token encryption * implement token validation * call token validation during migration creation * implement get migration status * implement list migration runs * fix bug * finish parse domain func * fix urls * fix typo * fix encoding and decoding * remove double decryption * add missing slash * fix id returned by create function * inject missing services * finish implementing (as far as I can tell right now) data migration and response handling * comment out broken test, needs a rewrite * add a few final touches * get dashboard migration to work properly * changed runMigration to a POST * swagger * swagger * swagger --------- Co-authored-by: Michael Mandrus <michael.mandrus@grafana.com> Co-authored-by: Leonard Gram <leo@xlson.com> Co-authored-by: Michael Mandrus <41969079+mmandrus@users.noreply.github.com>	2 years ago
Leonard Gram	383ebb2bc4	Cloudmigration: create migration (#85386) ... * Cloudmigration: create migration * fix drone build * lint fix * fix unit test --------- Co-authored-by: Michael Mandrus <michael.mandrus@grafana.com>	2 years ago
Michael Mandrus	5a5f76ae0a	CloudMigrations: Add instance metadata to auth token (#85381) ... * update how tokens are passed around * rename structs	2 years ago
lean.dev	5b147d0847	CloudMigration: Add service to list all migrations (#85308)	2 years ago
Bruno	a2e21eac8c	Cloud migrations: create endpoint to create an access token (#84690) ... * fix merge conflicts * make token expiration configurable	2 years ago