Managing data transfer
Configure and manage data transfer nodes and the queue that serves them. All data
transfers are managed as LSF jobs.
You can control both the number of concurrent transfers and the priority of transfers in the data
transfer queue. For example, you can configure fair share between users in the data transfer queue.
Data transfer jobs
One data transfer job is submitted by LSF data manager for each file that needs to be transferred.
LSF data manager transfer queue
All transfer jobs that are requested by LSF data manager for that cluster go to this queue. LSF data manager is enabled with the LSF_DATA_HOSTS parameter in lsf.conf . Configure the data transfer queue and manage jobs in the queue.
Manage data transfer nodes
Each cluster that uses LSF data management must have a set of hosts that act as data transfer nodes (also referred to as I/O nodes ). Data transfer nodes are execution hosts for transfer job that LSF data manager submits to a data transfer queue.
Troubleshoot data transfer job failure
If a data transfer job execution fails, jobs that require the file that the transfer job is transferring are killed by LSF .
Script interface for data transfer jobs
LSF data manager administrators provide a customized data transfer command that is specified by the FILE_TRANSFER_CMD parameter in lsf.datamanager used by data transfer jobs.
Configuring IBM Aspera as a data transfer tool
IBM Aspera is a data transfer tool that makes efficient, policy-based use of network bandwidth in high latency networks.
Enabling data requirement file transfer with bsub -f
Configure LSF Data Manager to perform data file transfer with bsub -f instead of the default lsrcp command.