2 28 Deployment Test Plan

Component:  UI   ·         Browser support ·         Accessibility check

 

 

Create a backend work service #9

AggregateStatisticsJob.cs	·         Verify successful messages are getting logged from this job. ·         Download a package, verify statistics update shortly thereafter.
BackupPackageBlobsJob.cs	·         Verify successful messages are getting logged from this job. ·         Verify new package blobs are periodically getting backed up to the warehouse container. ·         Error handling: ·         Verify processing of packages that have had their versions normalized programatically. ·         Verify processing of packages that have been edited by their owners. ·         Discovery of error when using a bad/mistyped SQL connection string. ·         Discovery of error when using a bad/mistyped storage connection strings. ·         Interrupted copy
CleanOnlineDatabaseBackupsJob.cs	·         Verify successful messages are getting logged from this job. ·         Verify successful periodic deletion of backup databases. ·         Invoke, verify respect for MaxDailyBackups, MaxRunningBackups settings ·         Error handling: ·         Discovery of error when using a bad/mistyped SQL connection string. ·         Deleting bad database entries ·         Contradictory settings -- MaxDailyBackups spans a shorter time than MaxRunningBackups
CreateOnlineDatabaseBackupJob.cs	·         Verify successful messages are getting logged from this job. ·         Verify new backup databases are getting created periodically. ·         Error handling: ·         Discovery of error when using a bad/mistyped SQL connection string. ·         Recovery from an interrupted backup
CreateWarehouseReportsJob.cs	·         Verify successful messages are getting logged from this job. ·         Verify reports blobs are getting periodically updated. ·         Error handling: ·         How well would we recover from SQL errors during execution of one of the reports?
ExportDatabaseJob.cs	·         Invoke, verify successful messages are getting logged from this job. ·         Verify periodic fresh backups are showing up in the Destination. ·         Restore, verify data integrity in the backup. ·         Invoke with custom TargetDatabase, verify contents of backed-up database after completion ·         Invoke with custom DestinationStorage, verify bacpac post-completion ·         Verify first run scenario without an existing backup ·         Error handling: ·         Discovery of error when using a bad/mistyped storage connection string ·         Interrupted backup ·         Verify experience when bacpac file already exists.
HandlePackageEditsJob.cs	·         Verify successful messages are getting logged from this job. ·         Verify PackageEdits table get cleaned up periodically after edits are completed. ·         Verify backup is created on edited packages. ·         Verify both database fields and updated blob on edited packages. ·         Verify integrity of package edits: ·         Test on every editable field ·         Error handling: ·         Failed edits:  verify message when failed edit count exceeds max tries. ·         Verify FailedCount gets incremented on failed edits.
ImportDatabaseJob.cs	·         Invoke, verify successful messages are getting logged from this job. ·         Invoke with a bacpac file, verify integrity of imported data in destination db ·         Invoke without a bacpac file, verify latest successful backup is restored. ·         Invoke with and without default endpoints specified, confirm behavior and default value of Blue Ridge ·         Error handling: ·         Discovery of error if bad/mistyped primary connection string ·         Importing an already-existing db ·         Interrupted restore
PurgeCompletedInvocationsJob.cs	·         Invoke, verify successful messages get logged from this job. ·         Invoke with a value, verify clean purging of elements in warehouse's Invocations table older than x days.
PurgePackageStatisticsJob.cs	·         Verify successful messages are getting logged from this job. ·         Halt the ReplicatePackageStatisticsJob, verify PurgePackageStatisticsJob stops deleting entries. ·         Verify that the oldest entries in the PackageStatistics table are about 7 days old.
ReplicatePackageStatisticsJob.cs	·         Verify successful messages are getting logged from this job. ·         Verify new records are getting logged in the Warehouse. ·         Check data integrity for newly-put records in the Warehouse. ·         Verify LastOriginalKey is getting incremented.
UpdateLicenseReportsJob.cs	·         Verify successful messages are getting logged from this job. ·         Update licenseservice setting in config, verify changed target for license requests ·         Verify log/error handling when report is unavailable. ·         Verify NextLicenseReport URL in GallerySettings gets periodically updated. ·         Verify new friendly license data in db. ·         Check error handling ·         Wrong content in response ·         Invalid packages ·         Bad License names (null, empty, bizarre)