Skip to content

Batch validation

Jump to bottom
mihir jha edited this page Mar 15, 2024 · 9 revisions
  • The CML Utility offers a convenient method for the migration of projects. However, for users migrating multiple projects, a wrapper script allows for batch migration validation. This script enables the validation of multiple projects in bulk, enhancing efficiency and scalability.
  • python script is available, for validation.
  • Batch validation script reads the list of project names from export-config.ini and import-config.ini files. Each section defined here corresponds to a specific project, with the section name corresponding to the project name. You can include project-specific configurations within each respective section, while configurations shared across multiple projects can be placed inside the "default" section.
  • BatchSize variable provided inside the script controls the number of projects that can be validated simultaneously. To prevent system errors like running out of memory, it is essential to select an appropriate batch size. Each validation operation of a project generates a distinct session on the source and destination workspace, utilizing 1 CPU and 0.5 GB of memory. Therefore, the batch size should be determined considering the available resources on both the source and target workspaces.
  • PROJECT_LIST_CSV_FILE variable within the script needs to be replaced with the absolute path of the CSV file created in Step 1.
  • Logs for each project are collected inside their respective project directories, enabling easy troubleshooting and monitoring of the validation process.
  • NOTE: Migration validation is resource-intensive task keep the BATCH_SIZE to an optimal size

Prerequisites

Before proceeding, ensure the following:

  1. You have access to the cmlutil command-line utility.
  2. Python and the necessary dependencies are installed.
  3. You have a CSV file containing the names of projects to be validated.

Steps

Follow these steps to validate project migration using a CSV file:

  1. Create a CSV File: Create a CSV file using a text editor or spreadsheet software. Save the file with the extension .csv.

  2. Format the CSV File: In the CSV file, list the names of projects to be validated. Separate multiple project names with commas. Each project name should be in its own row.

    Example CSV file content:

    Project-A,Project-B,Project-C

  3. Save the CSV File: Save the CSV file with the project names.

Clone this wiki locally