Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create dummy empty backup to force fast sync during phase EnsureStageBackupReplicated #1068

Open
djwhatle opened this issue Apr 12, 2021 · 0 comments
Open

Create dummy empty backup to force fast sync during phase EnsureStageBackupReplicated #1068

djwhatle opened this issue Apr 12, 2021 · 0 comments
Labels
kind/feature Categorizes issue or PR as related to a new feature.

Comments

@djwhatle
Copy link
Contributor

djwhatle commented Apr 12, 2021 •
edited
Loading

Is your feature request related to a problem? Please describe.
Velero doesn't allow you to sync backups quicker than 1 minute. I just saw this phase take 21 seconds. We may be able to force this to speed up by backing up the contents of the openshift-migration namespace on the target cluster and excluding all resources.

This will only affect indirect migration.

openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252513608,"logger":"migration|gs6gr","msg":"[RUN] (Step 30/48) Waiting for stage backup to complete.","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"StageBackupCreated"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252513790,"logger":"migration|gs6gr","msg":"Velero Backup progress report","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"StageBackupCreated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2","backupProgress":["Backup openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2: 3 out of estimated total of 3 objects backed up (0s)"]}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252513790,"logger":"migration|gs6gr","msg":"Phase completed","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"StageBackupCreated","phaseElapsed":3.790159443}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252514071,"logger":"migration|pfj5k","msg":"[RUN] (Step 31/48) Waiting for stage Velero backup replication to target cluster.","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252514454,"logger":"migration|pfj5k","msg":"Checking if Velero Backup has been replicated to destination cluster","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252514460,"logger":"migration|pfj5k","msg":"Stage Velero Backup has not yet been replicated to target cluster by Velero. Waiting","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252517475,"logger":"migration|4mrnr","msg":"[RUN] (Step 31/48) Waiting for stage Velero backup replication to target cluster.","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252517789,"logger":"migration|4mrnr","msg":"Checking if Velero Backup has been replicated to destination cluster","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252517793,"logger":"migration|4mrnr","msg":"Stage Velero Backup has not yet been replicated to target cluster by Velero. Waiting","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252520812,"logger":"migration|mcpvq","msg":"[RUN] (Step 31/48) Waiting for stage Velero backup replication to target cluster.","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252521138,"logger":"migration|mcpvq","msg":"Checking if Velero Backup has been replicated to destination cluster","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252521144,"logger":"migration|mcpvq","msg":"Stage Velero Backup has not yet been replicated to target cluster by Velero. Waiting","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252524162,"logger":"migration|w9hb8","msg":"[RUN] (Step 31/48) Waiting for stage Velero backup replication to target cluster.","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252524477,"logger":"migration|w9hb8","msg":"Checking if Velero Backup has been replicated to destination cluster","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252524482,"logger":"migration|w9hb8","msg":"Stage Velero Backup has not yet been replicated to target cluster by Velero. Waiting","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252527498,"logger":"migration|27gdb","msg":"[RUN] (Step 31/48) Waiting for stage Velero backup replication to target cluster.","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252527808,"logger":"migration|27gdb","msg":"Checking if Velero Backup has been replicated to destination cluster","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252527814,"logger":"migration|27gdb","msg":"Stage Velero Backup has not yet been replicated to target cluster by Velero. Waiting","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252530836,"logger":"migration|m29wz","msg":"[RUN] (Step 31/48) Waiting for stage Velero backup replication to target cluster.","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252531151,"logger":"migration|m29wz","msg":"Checking if Velero Backup has been replicated to destination cluster","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252531162,"logger":"migration|m29wz","msg":"Stage Velero Backup has not yet been replicated to target cluster by Velero. Waiting","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration velero-77cd56899c-lbtwz velero time="2021-04-12T18:35:34Z" level=info msg="Found 2 backups in the backup location that do not exist in the cluster and need to be synced" backupLocation=awss3-qnwlc controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:197"
openshift-migration velero-77cd56899c-lbtwz velero time="2021-04-12T18:35:34Z" level=info msg="Attempting to sync backup into cluster" backup=c57bc800-9bbd-11eb-9660-83f13c9fa580-ct26r backupLocation=awss3-qnwlc controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205"
openshift-migration velero-77cd56899c-lbtwz velero time="2021-04-12T18:35:34Z" level=info msg="Successfully synced backup into cluster" backup=c57bc800-9bbd-11eb-9660-83f13c9fa580-ct26r backupLocation=awss3-qnwlc controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235"
openshift-migration velero-77cd56899c-lbtwz velero time="2021-04-12T18:35:34Z" level=info msg="Attempting to sync backup into cluster" backup=c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2 backupLocation=awss3-qnwlc controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205"
openshift-migration velero-77cd56899c-lbtwz velero time="2021-04-12T18:35:34Z" level=info msg="Successfully synced backup into cluster" backup=c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2 backupLocation=awss3-qnwlc controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235"
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252534180,"logger":"migration|sh6ww","msg":"[RUN] (Step 31/48) Waiting for stage Velero backup replication to target cluster.","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252534548,"logger":"migration|sh6ww","msg":"Checking if Velero Backup has been replicated to destination cluster","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252534569,"logger":"migration|sh6ww","msg":"FOUND Velero Backup has been replicated to destination cluster","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","backup":"openshift-migration/c57bc800-9bbd-11eb-9660-83f13c9fa580-tj9s2"}
openshift-migration migration-controller-5dd8cdb79b-98lg8 mtc {"level":"info","ts":1618252534569,"logger":"migration|sh6ww","msg":"Phase completed","migMigration":"c57bc800-9bbd-11eb-9660-83f13c9fa580","phase":"EnsureStageBackupReplicated","phaseElapsed":21.568764799}
@djwhatle djwhatle added the kind/feature Categorizes issue or PR as related to a new feature. label Apr 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/feature Categorizes issue or PR as related to a new feature.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@djwhatle