Self-Service Migrations

[dylan-smith]

Bring the Octoshift CLI to a state that aligns with how customers want to use Octoshift, covers running migrations from ADO, GHES & GHEC, and can be picked up self-service and used without in hand holding for the first few migrations. This will help to reduce the time investment that's needed to get a customer started using Octoshift. While also bringing the CLI benefit to GHES and GHEC migration customers.

DRI: @dylan-smith

Batches

• Plan, Vision and Roadmap #103
• GH->GH Support / GH CLI Extension #104
• Initial Tech Debt #105
• Support Parallel Migrations #106

[dylan-smith]

Status: 🟢

Target date: 2022-01-31

Work done this week

• Created a new "gei" CLI for GitHub -> GitHub migrations. Tested with GHEC -> GHEC
  • generate-script command that runs against a GH org #54
  • GH-CLI: migrate-repo command with the source in GH #55
  • Multi PAT support for GH to GH migrations #192 (expected to land tomorrow/monday)
• Add --ssh flag to allow customers who are encountering problems related to the HTTPS change to fall back to the old behavior
  • Add --ssh flag to migrate-repo #193
• Masking secrets from the logs to prevent accidental PAT disclosure when sharing log files
  • Don't log secrets #123
• Continued improvements in our unit test coverage, up to 81% coverage (up from 63% last week)
  • Unit Tests #114
    

Work planned next week

• v0.6 releasing on Monday with the above features
  • Release Notes: https://github.com/github/gh-gei/blob/main/RELEASENOTES.md
• Show and Tell with the MVP's on Thursday
  • Teams Meeting Link
• Support for paging when calling GitHub API's. The main place this will be noticed is when running generate-script against a GitHub source. The CLI currently will only list the first 30 repos because we haven't implemented paging like we have for ADO.
  • Implement Paging in GitHub API #45
• Improved error handling. User friendly messages + proper error codes
  • Proper Error Handling #116
• Begin work on e2e tests
  • Create automated e2e test(s) #3
• Publish gei as an extension to the official GitHub CLI
  • Publish as GH CLI extension #127

[dylan-smith]

Status: Yellow

Dylan was on vacation 2 days last week and 2 days next week
Arin is on-call so unavailable for CLI work next 2 weeks

Target date: 2022-01-31

Work done this week

• v0.6 released on Monday
  • Release Notes: https://github.com/github/gh-gei/releases/tag/v0.6
• Show and Tell with the MVP's
  • Recording
• Improved error handling. User friendly messages + proper error codes
  • Proper Error Handling #116
• Publish gei as an extension to the official GitHub CLI
  • Publish as GH CLI extension #127
• Begin work on e2e tests
  • Create automated e2e test(s) #3
• Continuing to improve Unit Test coverage. Up to 86% from 81% last week
  • Only one major piece of code remaining before we can call this done
  • Unit Tests #114
    

Work planned next week

• Support for paging when calling GitHub API's. The main place this will be noticed is when running generate-script against a GitHub source. The CLI currently will only list the first 30 repos because we haven't implemented paging like we have for ADO.
  • Implement Paging in GitHub API #45
• Finish the e2e testing efforts
  • Create automated e2e test(s) #3
• Support for ADO source in the gh->gh CLI
  • GH CLI: generate-script with a source of ADO #125
  • GH-CLI: migrate-repo command with the source in ADO #126
• migrator role commands in the gh->gh CLI
  • GH CLI: grant-migrator-role command #207
  • GH CLI: revoke-migrator-role command #208
• GHES as a source for gh->gh CLI
  • GH-CLI: GHES support as a source #128
• Parallel migration support
  • Support Parallel Migrations #106
• CLI Telemetry
  • Basic Telemetry #107

[dylan-smith]

Status: Green

Updated target date estimate to Feb 18th.

Target date: 2022-02-18

Work done this week

• Finish the e2e testing efforts
  • Create automated e2e test(s) #3
• Support for ADO source in the gh->gh CLI
  • GH CLI: generate-script with a source of ADO #125
  • GH-CLI: migrate-repo command with the source in ADO #126
• migrator role commands in the gh->gh CLI
  • GH CLI: grant-migrator-role command #207
  • GH CLI: revoke-migrator-role command #208

Work planned next week

• GHES as a source for gh->gh CLI
  • GH-CLI: GHES support as a source #128
• Parallel migration support
  • Support Parallel Migrations #106

[dylan-smith]

Status: Green

Target date: 2022-03-04

Work done this week

• GHES as a source for gh->gh CLI
  • GH-CLI: GHES support as a source #128
• Parallel migration support was started, but Arin is OOO this work so was put on hold until he returns
  • Support Parallel Migrations #106

Work planned next week

• Parallel migration support implementation continues
  • Support Parallel Migrations #106
• Telemetry
  • Basic Telemetry #107

[dylan-smith]

Status: Green

Target date: 2022-03-04

Work done this week

• Parallel migration support is progressing, still probably another week of work remains
  • Support Parallel Migrations #106

Work planned next week

• Parallel migration support implementation continues, possibly completes next week
  • Support Parallel Migrations #106
• Telemetry
  • Basic Telemetry #107

[dylan-smith]

Status: Green

Target date: 2022-03-31

Work done this week

• Parallel migration work is code complete, waiting on PR reviews before we can release it
  • Support Parallel Migrations #106

Work planned next week

• Telemetry
  • Basic Telemetry #107

[dylan-smith]

Status: Green

Target date: 2022-03-31

Work done this week

• Parallel migration work was merged in, but a number of issues were discovered during final release testing that we're still working on resolving
  • Support Parallel Migrations #106
  • Add wait option to migrate-repo #254
  • Generate parallel migration script #255
  • Add GraphQL pagination support #264
  • Deprecate --ssh flag #269
• Work started on making the CLI commands idempotent
  • Idempotency - AutoLink Command #259

Work planned next week

• Telemetry
  • Basic Telemetry #107
• Continue work on idempotency
  • Idempotency #117

[dylan-smith]

Status: Green (Complete)

Moved the telemetry batch out of this epic. This is now complete.

Target date: 2022-03-31

Work done this week

• Parallel migration support shipped in v0.10
  • Support Parallel Migrations #106
• Idempotency making more progress
  • Idempotency - disable repo command #287
• API updates to support backend changes
  • Remove PATs from createMigrationSource mutation #296
  • Remove PATs from createSourceMigration API call #258
• --ado-team-project option added for scoping (external contribution)
  • ado-team-project option on generate-script #124
  • Lookup for service connection needs to be case insensitive #242
• Last task for missing unit tests complete, our code coverage looks great now!
  • Unit Test AdoClient #177
    
• Added support for M1 macs
  • Support darwin-arm64 (i.e. M1 Macs) #302
• Re-enabled integration tests after the underlying issues causing flakiness have been resolved
  • Turn Integration Tests back on #300