Topic
  • 13 replies
  • Latest Post - ‏2012-12-07T14:07:35Z by Christian_Svensson
Christian_Svensson
Christian_Svensson
19 Posts

Pinned topic mmbackup mount tapes all the time

‏2012-11-15T08:52:32Z |
Hi their,
I have a Single node GPFS Cluster based on 3.5.0.5 and running TSM GPFS/BA Client 6.3.0.17 running on a SLES 11 SP2 (x86_64)
I only use my GPFS cluster to archive (HSM) data to our TSM environment.
But every day when I run mmbackup do I see that mmbackup always request for media all the time and this slows down the backup A LOT.

Any ideas why mmbackup mount my take all the time? Basically does mmbackup request over 100 tapes a day for me.

Thanks
Christian
Updated on 2012-12-07T14:07:35Z at 2012-12-07T14:07:35Z by Christian_Svensson
  • HajoEhlers
    HajoEhlers
    253 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-11-15T12:46:22Z  
    Short question: What will happen if you migrate files which shell be backed up but are migrated before the backup ?
  • gcorneau
    gcorneau
    149 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-11-15T16:16:50Z  
    Could this be related?

    http://publib.boulder.ibm.com/infocenter/clresctr/vxrx/topic/com.ibm.cluster.gpfs.doc/gpfs_faqs/gpfsclustersfaq.html#backup

    Glen Corneau
    IBM Power Systems Advanced Technical Skills
  • m_strnad
    m_strnad
    36 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-11-15T18:51:05Z  
    Short question: What will happen if you migrate files which shell be backed up but are migrated before the backup ?
    It mainly depends on the TSM storage pools you use for migration and backups. If you migrate to the same storage pool as you back up, nothing happnes except of additional TSM DB entries. If the migration target storage pool is different from the one used for back ups then the data is copied within TSM.
  • Christian_Svensson
    Christian_Svensson
    19 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-11-16T16:50:31Z  
    • m_strnad
    • ‏2012-11-15T18:51:05Z
    It mainly depends on the TSM storage pools you use for migration and backups. If you migrate to the same storage pool as you back up, nothing happnes except of additional TSM DB entries. If the migration target storage pool is different from the one used for back ups then the data is copied within TSM.
    Hi,
    We have setup our system where MMBACKUP send all it's data to BACKUPDISK pool and that data will be migrated once a day to a BACKUPTAPE pool.
    Our HSM migration are sending all data to SPACEDISK pool that will migrate all that data once a day to SPACETAPE pool.

    If I understand you correctly, because of MMBACKUP and GPFS HSM command are sending the data to two different storage pools, TSM will then automatic recall the data?

    The solution to stop all the recalls is to let MMBACKUP and GPFS HSM migration to send it data to the same storage pool?

    Thanks
    Christian
  • m_strnad
    m_strnad
    36 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-11-22T11:50:41Z  
    Hi,
    We have setup our system where MMBACKUP send all it's data to BACKUPDISK pool and that data will be migrated once a day to a BACKUPTAPE pool.
    Our HSM migration are sending all data to SPACEDISK pool that will migrate all that data once a day to SPACETAPE pool.

    If I understand you correctly, because of MMBACKUP and GPFS HSM command are sending the data to two different storage pools, TSM will then automatic recall the data?

    The solution to stop all the recalls is to let MMBACKUP and GPFS HSM migration to send it data to the same storage pool?

    Thanks
    Christian
    No. The migrated data should not be recalled, but they need to be copied from the SPACETAPE pool to BACKUPDISK pool.

    From TSM documentation:
    "To back up your files after you migrate them, assign a management class to your files that does not include the requirement for an existing backup version. If you back up files to the same server to which you migrated them, files are copied from the migration destination to the backup destination. Files are not recalled to your local file system."

    You can check the migration status of your files using the dsmmigquery command.
  • Christian_Svensson
    Christian_Svensson
    19 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-12-06T10:35:10Z  
    • m_strnad
    • ‏2012-11-22T11:50:41Z
    No. The migrated data should not be recalled, but they need to be copied from the SPACETAPE pool to BACKUPDISK pool.

    From TSM documentation:
    "To back up your files after you migrate them, assign a management class to your files that does not include the requirement for an existing backup version. If you back up files to the same server to which you migrated them, files are copied from the migration destination to the backup destination. Files are not recalled to your local file system."

    You can check the migration status of your files using the dsmmigquery command.
    Hi,
    But I can't migrate the files until TSM have backed up the files.
    So why should TSM "restore/recall/migrate" files between does two pools if a backup are require before migration?

    I think their is a setup issue here somewhere. But need to find out how and why.

    /Christian
  • Christian_Svensson
    Christian_Svensson
    19 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-12-06T11:29:47Z  
    Hi,
    But I can't migrate the files until TSM have backed up the files.
    So why should TSM "restore/recall/migrate" files between does two pools if a backup are require before migration?

    I think their is a setup issue here somewhere. But need to find out how and why.

    /Christian
    Hi,
    I think I have found the problem. When I do ls in one directory I get a media mount in TSM.
    So it feels like GPFS have migrate the directories also.
    But if I run ls multiple times I got the same problem.

    Any ideas what this can be?

    Thanks
    Christian
  • HajoEhlers
    HajoEhlers
    253 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-12-06T12:47:49Z  
    Hi,
    I think I have found the problem. When I do ls in one directory I get a media mount in TSM.
    So it feels like GPFS have migrate the directories also.
    But if I run ls multiple times I got the same problem.

    Any ideas what this can be?

    Thanks
    Christian
    Does the same happen if you do a "echo *" or a "find ."? I assume not.

    If not please run "env | grep -i ls" and unset all variables like LS_OPTIONS LS_COLORS a.s.o. After that do a ls again and check how the systems behaves.

    Next question:
    What is the file system version ? - You mention that GPFS 3.5.0.5 is used but i think the GPFS has been created with an earliere version of GPFS .

    My current thought is that your "ls" is doing more than a directory lookup meaning it is accessing the file as well ( to determine file type a.s.o ) or reading some extra attributes which are stored with the file. I think the later is not valid anymore for GPFS created with version 3.4 or 3.5
  • Christian_Svensson
    Christian_Svensson
    19 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-12-06T15:14:23Z  
    Does the same happen if you do a "echo *" or a "find ."? I assume not.

    If not please run "env | grep -i ls" and unset all variables like LS_OPTIONS LS_COLORS a.s.o. After that do a ls again and check how the systems behaves.

    Next question:
    What is the file system version ? - You mention that GPFS 3.5.0.5 is used but i think the GPFS has been created with an earliere version of GPFS .

    My current thought is that your "ls" is doing more than a directory lookup meaning it is accessing the file as well ( to determine file type a.s.o ) or reading some extra attributes which are stored with the file. I think the later is not valid anymore for GPFS created with version 3.4 or 3.5
    Hi,
    The ls environment did help for the faster listing.
    But still have problem with tape mounts.

    You asked for what version the filesystem was created on. I think we did create the FS with version 3.4.0.?
    How can I see that on a easy way?

    /Christian
  • Christian_Svensson
    Christian_Svensson
    19 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-12-06T15:16:18Z  
    Hi,
    The ls environment did help for the faster listing.
    But still have problem with tape mounts.

    You asked for what version the filesystem was created on. I think we did create the FS with version 3.4.0.?
    How can I see that on a easy way?

    /Christian
    Found it. 3.4.0.7 did we install the FS with.
    Is that something I can upgrade?

    /Christian
  • HajoEhlers
    HajoEhlers
    253 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-12-06T16:46:48Z  
    Found it. 3.4.0.7 did we install the FS with.
    Is that something I can upgrade?

    /Christian
    The FS version be can seen via
    
    mmlsfs MyGpfs -V --create-time
    


    You also did not mention the behavior of the system for the "echo" or "find" command.

    In any way i would run a strace from linux to see what happen ( Best on the same node where the hsm damon is running ).

    Glen mentioned also the GPFS faq which has a topic about the backup of snapshot which can cause later recalls. Maybe related to your environment but not mentioned so far by you - are you using snapshots ?
  • Christian_Svensson
    Christian_Svensson
    19 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-12-06T16:54:02Z  
    The FS version be can seen via
    <pre class="jive-pre"> mmlsfs MyGpfs -V --create-time </pre>

    You also did not mention the behavior of the system for the "echo" or "find" command.

    In any way i would run a strace from linux to see what happen ( Best on the same node where the hsm damon is running ).

    Glen mentioned also the GPFS faq which has a topic about the backup of snapshot which can cause later recalls. Maybe related to your environment but not mentioned so far by you - are you using snapshots ?
    Hi,
    The find and echo did work much faster and when I change the environment variables then did it go much faster to do ls in my directories.

    But I have now upgrade the filesystem from 12.10 (3.4.0.7) to 13.01 (3.5.0.0) and start a new mmbackup of the filesystem.

    About your question on Snapshot. No we are not using snapshots. We are only using dsmmigrate and mmbackup on this filesystem.

    Just to update of my environment. I have upgrade to TSM BA Client 6.4.0.0 and GPFS version 3.5.0.6

    Thanks
    Christian
  • Christian_Svensson
    Christian_Svensson
    19 Posts

    Re: mmbackup mount tapes all the time

    ‏2012-12-07T14:07:35Z  
    Hi,
    The find and echo did work much faster and when I change the environment variables then did it go much faster to do ls in my directories.

    But I have now upgrade the filesystem from 12.10 (3.4.0.7) to 13.01 (3.5.0.0) and start a new mmbackup of the filesystem.

    About your question on Snapshot. No we are not using snapshots. We are only using dsmmigrate and mmbackup on this filesystem.

    Just to update of my environment. I have upgrade to TSM BA Client 6.4.0.0 and GPFS version 3.5.0.6

    Thanks
    Christian
    Hi,
    I'm glad to announce that I think my mounting problem have been solve.
    As soon I upgrade the Cluster and Filesystem to the same level as the binary then did everything work as it should.

    No media mount during mmbackup for recall the last 20 hours and the speed we have now is approx 250MB/s instead of 80MB/s on a SATA disk subsystem.

    Thanks for the help everyone
    Christian