Topic
  • 2 replies
  • Latest Post - ‏2012-12-11T22:47:09Z by jvasudeo
jvasudeo
jvasudeo
9 Posts

Pinned topic mmdeldisk fails removing disk

‏2012-12-11T20:00:11Z |
Hi,

I have a rather peculiar problem. One of our customers has a disk (which was removed from the system) which still shows up in mmlsdisk. The output of mmlsdisk as follows

mmlsdisk fs0
disk driver sector failure holds holds storage
name type size group metadata data status availability pool

--------
-------
-----
------------
SATA_ST3500320NS_9QMC2GP2_part4 nsd 512 4002 Yes Yes ready up system
SATA_ST500NM0011_Z1M0YP2C_part4 nsd 512 4003 Yes Yes ready up system
SATA_ST3500320NS_9QMC2GQQ_part4 nsd 512 4002 Yes Yes ready up system
SATA_ST3500320NS_9QMC2LPQ_part4 nsd 512 4002 Yes Yes ready up system
SATA_ST3500320NS_9QMC5KWD_part4 nsd 512 4001 Yes Yes ready down system
SATA_ST500NM0011_Z1M0J1FH_part4 nsd 512 4001 Yes Yes ready up system
SATA_ST500NM0011_Z1M0J6MX_part4 nsd 512 4001 Yes Yes ready up system
SATA_ST500NM0011_Z1M04M02_part4 nsd 512 4001 Yes Yes ready up system
SATA_ST3500320NS_9QMC1N1K_part4 nsd 512 4003 Yes Yes ready up system
SATA_ST3500320NS_9QMC2GHS_part4 nsd 512 4003 Yes Yes ready up system
SATA_ST500NM0011_Z1M0YRQR_part4 nsd 512 4002 Yes Yes ready up system
SATA_ST3500320NS_9QMC2LTT_part4 nsd 512 4003 Yes Yes ready up system
SATA_ST3500514NS_9WJ0E2EV_part4 nsd 512 4001 Yes Yes ready up system

The disk in question is SATA_ST3500320NS_9QMC5KWD_part4. I am not able to delete this disk using mmdeldisk

mmdeldisk fs0 SATA_ST3500320NS_9QMC5KWD_part4
mmdeldisk: SATA_ST3500320NS_9QMC5KWD_part4 not found in file system fs0
mmdeldisk: Command failed. Examine previous error messages to determine cause.

Another thing to note is that that disk does not show up when running mmlsnsd:

mmlsnsd

File system Disk name NSD servers
fs0 SATA_ST3500320NS_9QMC2GP2_part4 scale-172-16-5-52
fs0 SATA_ST3500320NS_9QMC2GQQ_part4 scale-172-16-5-52
fs0 SATA_ST3500320NS_9QMC2LPQ_part4 scale-172-16-5-52
fs0 SATA_ST3500320NS_9QMC1N1K_part4 scale-172-16-5-51
fs0 SATA_ST3500320NS_9QMC2GHS_part4 scale-172-16-5-51
fs0 SATA_ST3500320NS_9QMC2LTT_part4 scale-172-16-5-51
fs0 SATA_ST500NM0011_Z1M0J1FH_part4 scale-172-16-5-50
fs0 SATA_ST500NM0011_Z1M0J6MX_part4 scale-172-16-5-50
fs0 SATA_ST500NM0011_Z1M04M02_part4 scale-172-16-5-50
fs0 SATA_ST500NM0011_Z1M0YP2C_part4 scale-172-16-5-51
fs0 SATA_ST500NM0011_Z1M0YRQR_part4 scale-172-16-5-52
fs0 SATA_ST3500514NS_9WJ0E2EV_part4 scale-172-16-5-50
fsscale0 SATA_ST3500320NS_9QMC2GP2_part3 scale-172-16-5-52
fsscale0 SATA_ST3500320NS_9QMC2GQQ_part3 scale-172-16-5-52
fsscale0 SATA_ST3500320NS_9QMC2LPQ_part3 scale-172-16-5-52
fsscale0 SATA_ST3500320NS_9QMC1N1K_part3 scale-172-16-5-51
fsscale0 SATA_ST3500320NS_9QMC2GHS_part3 scale-172-16-5-51
fsscale0 SATA_ST3500320NS_9QMC2LTT_part3 scale-172-16-5-51
fsscale0 SATA_ST500NM0011_Z1M0J1FH_part3 scale-172-16-5-50
fsscale0 SATA_ST500NM0011_Z1M0J6MX_part3 scale-172-16-5-50
fsscale0 SATA_ST500NM0011_Z1M04M02_part3 scale-172-16-5-50
fsscale0 SATA_ST500NM0011_Z1M0YP2C_part3 scale-172-16-5-51
fsscale0 SATA_ST500NM0011_Z1M0YRQR_part3 scale-172-16-5-52
fsscale0 SATA_ST3500514NS_9WJ0E2EV_part3 scale-172-16-5-50

This is on gpfs 3.4.0-8 with linux kernel 2.6.32. Does any one know how i can delete that disk. Thanks

  • Jyotindra
Updated on 2012-12-11T22:47:09Z at 2012-12-11T22:47:09Z by jvasudeo
  • dlmcnabb
    dlmcnabb
    1012 Posts

    Re: mmdeldisk fails removing disk

    ‏2012-12-11T21:39:40Z  
    They must have removed the disk line from the /var/mmfs/gen/mmsdrfs file, so that the mmdeldisk (and mmlsnsd) script indicates that it knows nothing about that disk. However, the on-disk structures (mmlsdisk) still think the disk is still part of the filesystem. So in this case you can bypass the mmdeldisk script and run
    
    tsdeldisk fs0 SATA_ST3500320NS_9QMC5KWD_part4 -p
    


    The -p option tells GPFS that there is no way to ever access the disk again, so don't even try. This is a dangerous option to use in general since it is irrevocable as soon as the command starts. If there were any files or system metadata on the disk that does not have a replica on some other disk, the pointers will be changes to a special BROKEN value. For regular files, this will turn into EIO when you try to read this block. If you do not have replicated metadata, then you may be missing system metadata which can cause filesystem panics (forced unmount).
  • jvasudeo
    jvasudeo
    9 Posts

    Re: mmdeldisk fails removing disk

    ‏2012-12-11T22:47:09Z  
    • dlmcnabb
    • ‏2012-12-11T21:39:40Z
    They must have removed the disk line from the /var/mmfs/gen/mmsdrfs file, so that the mmdeldisk (and mmlsnsd) script indicates that it knows nothing about that disk. However, the on-disk structures (mmlsdisk) still think the disk is still part of the filesystem. So in this case you can bypass the mmdeldisk script and run
    <pre class="jive-pre"> tsdeldisk fs0 SATA_ST3500320NS_9QMC5KWD_part4 -p </pre>

    The -p option tells GPFS that there is no way to ever access the disk again, so don't even try. This is a dangerous option to use in general since it is irrevocable as soon as the command starts. If there were any files or system metadata on the disk that does not have a replica on some other disk, the pointers will be changes to a special BROKEN value. For regular files, this will turn into EIO when you try to read this block. If you do not have replicated metadata, then you may be missing system metadata which can cause filesystem panics (forced unmount).
    Thanks, that worked.