Troubleshooting migration from MANTA Automated Data Lineage to IBM Manta Data Lineage

Review the troubleshooting information if you encounter issues during migration. In addition, check the known issues that are documented in Known issues for migration of lineage metadata import configurations.

Changing the maximum retry attempts of migration

Downloading projects as a compressed file might take longer depending on the system load and its availability for download. By default, the migration process is configured with 200 maximum retry attempts, making one attempt every 10 seconds to check their download status. If you want to change this setting, you can provide PROJECT_EXPORT_MAX_RETRY_ATTEMPTS: <number>, where <number> can range between 1 and 500.

Exporting the project for the DataStage for Cloud Pak for Data connector

In the case of metadata import for DataStage for Cloud Pak for Data connector with include_all_assets_in_project: true, the migration process exports the project as a compressed file with datastage flows, subflows and their relationships. If you want to export the entire project as a compressed file, you can change this setting by specifying PROJECT_EXPORT_ALL_ASSETS: true.

Rerunning the migration in case of an error

If you encounter the following error, you can rerun the migration with the PROJECT_EXPORT_MAX_RETRY_ATTEMPTS parameter set to a higher value between 201 and 500. If the migration still fails with the same error even when PROJECT_EXPORT_MAX_RETRY_ATTEMPTS is set to 500, you can proceed by enabling the force option, which is disabled by default. To enable the force option, add FORCE: true setting to the input yaml file. The force option can be enabled only for specific error types.

The content of the error:

19:38:59.421 [main] INFO com.ibm.mdilineage.migration.MdiLineageExporter -- The download of project exports retry attempt: (200 of 200) after 10 seconds
19:38:59.425 [main] ERROR com.ibm.mdilineage.migration.MdiLineageExporter -- Some project exports have either failed or are still not ready for download, even after the maximum number of retry attempts: 200
com.ibm.mdilineage.migration.exception.MdiLineageMigrationException: Some project exports have either failed or are still not ready for download, even after the maximum number of retry attempts: 200
   at com.ibm.mdilineage.migration.MdiLineageExporter.downloadProjectExportsWhenReady(MdiLineageExporter.java:495)
   at com.ibm.mdilineage.migration.MdiLineageExporter.getMetadataImportAssetsEligibleForMigration(MdiLineageExporter.java:417)
   at com.ibm.mdilineage.migration.MdiLineageExporter.exportAssets(MdiLineageExporter.java:89)
   at com.ibm.mdilineage.migration.MdiLineageMigrator.main(MdiLineageMigrator.java:84)