Chris's AIX Blog

LPM ifix for JS22 blades and IVM.

cggibbo 4,157 Views

If you come across the following LPM issue with IVM and JS22 blades,

IZ63357: LPM HUNG AT 100% ON BOTH SOURCE AND DESTINATION IVMS

Error description

The problem that these customers are seeing is the same

As described in this particular defect.

Migrating mobile partition from one IVM to another:

The destination IVM GUI shows the migration is complete,

but the percent complete is "unknown".

The source IVM GUI shows the "migration status" as

Migration Complete and "percent Complete" as 100%.

Once the recover operation is performed, the status shows

that the LPAR is now "Running" on the target and removed

from the source, as expected.

There are two PMRs with the same issue and the

Environment is the same on both the cases:

* Firmware level FSP: EA340_075

* IVM VIOS Level: 2.1.1.10-FP21

* Machine Type: JS22 blade

Local fix

Run the "Recover" operation as the Migration appears to

be "hung". Once the recover is complete, the status shows

that the LPAR is now "Running" on the target and removed

from the source, as expected.

Then I recommend you request the following ifix from IBM support:

IZ63357F21.091110.epkg.Z

From IBM support:

“It appears that this problem is due to a timing issue.

The trace data shows that IVM is calling the migmover -m end command on the destination partition. That command in turn calls a system call. When everything is in the correct state, that system call will end the migration and cleanup. The problem is it is not being called because the mover has not yet been notified that VASI is in the END state as indicated by the mover's state being: MIG_STATE_COMPLETED. The trace shows this notification arriving a split second after the migmover -m end command was issued.

On a good migration, the mover is notified by VASI of the state change before IVM calls migmover -m. IVM runs migmover -m end once it gets a migration completed message from phyp. If this message is issued about the same time as the message that tells VASI that
the migration has ended, a timing issue seems a real possibility.

The problem was fixed in the VIOS code. A new call was added when the "end" state change comes in from IVM/HMC. If the state is complete we are good to go, otherwise we issue an error.”

Installing this fix on my VIOS resolved the problem. My VIOS are running 2.1.1.10-FP21. If you are running FP22 for VIOS 2.1, then you must request a different ifix from IBM support.

hd11admin is created as jfs instead of jfs2?

cggibbo 5,596 Views

We came across this issue,

IZ58496 NIMADM TO 61 DOES NOT CREATE A /DEV/HD11ADMIN APPLIES TO AIX 6100-03

while performing some AIX 5.3 to 6.1 migrations with nimadm.

This was resolved by applying SP2 for TL3 on the NIM master.

However, we then noticed that the hd11admin LV is being created as type of jfs not jfs2.

We worked around this problem by creating a custom image.data, changing the jfs type to jfs2 and using this as a NIM image_data resource to

nimadm (see example below).

This worked OK in our environment:

NIM master: 6100-03-02-0939

---

NIM client prior to migration: 5300-07-05-0831

NIM client after migration: 6100-03-01-0921

Creating a custom image.data:

1. On bxaix87(the NIM client), create a new image.data file. Copy it to the NIM master.

# mkszfile

# scp /image.data bxaix85:/tmp/cg

2. On bxaix85 (the NIM master), edit the image.data file, add hd11admin and create a new NIM image_data resource.

# cd /tmp/cg

# vi image.data

lv_data:

VOLUME_GROUP= rootvg

LV_SOURCE_DISK_LIST=

LV_IDENTIFIER=

LOGICAL_VOLUME= hd11admin

TYPE= jfs2

MAX_LPS= 512

COPIES= 1

LPs= 1

STALE_PPs= 0

INTER_POLICY= minimum

INTRA_POLICY= center

MOUNT_POINT= /admin

MIRROR_WRITE_CONSISTENCY= on/ACTIVE

LV_SEPARATE_PV= yes

PERMISSION= read/write

LV_STATE= opened/syncd

WRITE_VERIFY= off

PP_SIZE= 64

SCHED_POLICY= parallel

PP= 4

BB_POLICY= relocatable

RELOCATABLE= yes

UPPER_BOUND= 32

LABEL= /admin

MAPFILE=

LV_MIN_LPS= 1

STRIPE_WIDTH=

STRIPE_SIZE=

SERIALIZE_IO= no

FS_TAG=

DEV_SUBTYP=

…

fs_data:

FS_NAME= /admin

FS_SIZE= 262144

FS_MIN_SIZE= 32768

FS_LV= /dev/hd11admin

FS_JFS2_BS= 4096

FS_JFS2_SPARSE= yes

FS_JFS2_INLINELOG= no

FS_JFS2_SIZEINLINELOG= 0

FS_JFS2_EAFORMAT= v1

FS_JFS2_QUOTA= no

FS_JFS2_DMAPI= no

FS_JFS2_VIX= yes

FS_JFS2_EFS= no

# smit nim_mkres

image_data = config file used during base system installation

Define a Resource

Type or select values in entry fields.

Press Enter AFTER making all desired changes.

[Entry Fields]

* Resource Name [cg_image_data]

* Resource Type image_data

* Server of Resource [master] +

* Location of Resource [/tmp/cg/image.data] /

# lsnim -t image_data

cg_image_data resources image_data

# lsnim -l cg_image_data

cg_image_data:

class = resources

type = image_data

Rstate = ready for use

prev_state = unavailable for use

location = /tmp/cg/image.data

alloc_count = 1

server = master

3. Perform the migration with the -i flag on the NIM master.

# nimadm -i cg_image_data -j nimadmvg -c bxaix87 -s spotaix61031 -l lppsourceaix61031 -d "hdisk1" -Y

4. The hd11admin LV is created with type of jfs2 on the NIM client.

# lsvg -l altinst_rootvg | grep hd11

alt_hd11admin jfs2 1 1 1 open/syncd /alt_inst/admin

Using this procedure means we would have to create a new image.data resource for every NIM client. Or just overwrite the file each time.

This is a known problem. Apparently APAR IZ45287 will resolve this issue for AIX 6.1 TL03.

According to the support guys, only one other customer has reported this problem.

So I thought I’d share this with you in order to workaround or avoid it, when it’s time for you to upgrade to AIX 6.1.

chlv: AIX 6.1 TL4 - Change an LV name online.

cggibbo 1 Comment 26,203 Views

TL4 for AIX 6.1 now allows you to rename logical volumes (LV) while they are still online i.e. open.

I confirmed this on a test system today.

# oslevel -s

6100-04-01-0944

I renamed the logical volume for the /home/nmon filesystem. The original LV name was nmonlv.

# df -m /home/nmon

Filesystem MB blocks Free %Used Iused %Iused Mounted on

/dev/nmonlv 256.00 254.73 1% 23 1% /home/nmon

# lsvg -l rootvg | grep nmon

nmonlv jfs2 1 1 1 open/syncd /home/nmon

I changed the LV name to nmon_lv.

# chlv -n nmon_lv nmonlv

The df command did not show any change i.e. it still displayed the old LV name. As expected.

# df -m /home/nmon

Filesystem MB blocks Free %Used Iused %Iused Mounted on

/dev/nmonlv 256.00 254.73 1% 23 1% /home/nmon

However, the lsvg command confirmed that the LV name had indeed changed. As did the stanza in /etc/filesystems.

# lsvg -l rootvg | grep nmon

nmon_lv jfs2 1 1 1 open/syncd /home/nmon

# grep -p nmon /etc/filesystems

/home/nmon:

dev = /dev/nmon_lv

vfs = jfs2

log = /dev/hd8

mount = true

options = rw

account = false

quota = no

After re-mounting the filesystem, the df command now displayed the new LV name.

# umount /home/nmon

# mount /home/nmon

# df /home/nmon

Filesystem 512-blocks Free %Used Iused %Iused Mounted on

/dev/nmon_lv 524288 521696 1% 23 1% /home/nmon

Not a big deal you say? Well, prior to TL4, I would have to unmount the filesystem first and then change the LV name. e.g.

# oslevel -s

6100-02-02-0849

# chlv -n nmon_lv nmonlv

0516-708 chlv: Cannot rename open logical volume. If LV

contains a filesystem, unmount to close logical volume nmonlv.

Just another enhancement to the usability features of the AIX operating system.

Not as impressive as being able to shrink a filesystem ‘on-the-fly’, but it’s certainly making life easier for AIX administrators. J

Installing the AIX Runtime Expert

cggibbo 8,063 Views

I was attempting to install the new AIX Runtime Expert on an LPAR today. I found that the base level fileset for this new utility was not included with the supporting Technology Level i.e. TL4 for AIX 6.1.

I was presented with the following 'Requisite Failures' message:

Requisite Failures

------------------

SELECTED FILESETS: The following is a list of filesets that you asked to

install. They cannot be installed until all of their requisite filesets

are also installed. See subsequent lists for details of requisites.

artex.base.rte 6.1.4.1 # AIX Runtime Expert

MISSING REQUISITES: The following filesets are required by one or more

of the selected filesets listed above. They are not currently installed

and could not be found on the installation media.

artex.base.rte 6.1.0.0 # Base Level Fileset

However, I discovered that the base fileset IS included with the latest Fix Pack for the Virtual I/O Server i.e. FP22 for VIOS 2.1.

I was then able to install the base filesets i.e. the AIX Runtime Expert and the sample profiles. i.e.

artex.base

+ 6.1.4.0 AIX Runtime Expert

+ 6.1.4.0 AIX Runtime Expert sample profiles

After the filesets installed successfully I needed to then apply the latest level from TL4. e.g.

# oslevel -s

6100-04-00-0000

# instfix -i | grep AIX

All filesets for 6.1.0.0_AIX_ML were found.

All filesets for 6100-00_AIX_ML were found.

All filesets for 6100-01_AIX_ML were found.

All filesets for 6100-02_AIX_ML were found.

All filesets for 6100-03_AIX_ML were found.

All filesets for 6100-04_AIX_ML were found.

# instfix -i | grep SP

All filesets for 61-00-010748_SP were found.

All filesets for 61-00-020750_SP were found.

All filesets for 61-00-030808_SP were found.

All filesets for 61-00-040815_SP were found.

All filesets for 61-01-010823_SP were found.

All filesets for 61-00-050822_SP were found.

All filesets for 61-00-060834_SP were found.

All filesets for 61-01-020834_SP were found.

All filesets for 61-00-070846_SP were found.

All filesets for 61-01-030846_SP were found.

All filesets for 61-02-010847_SP were found.

All filesets for 61-02-020849_SP were found.

All filesets for 61-00-080909_SP were found.

All filesets for 61-01-040909_SP were found.

All filesets for 61-02-030909_SP were found.

All filesets for 61-03-010921_SP were found.

All filesets for 61-00-090920_SP were found.

All filesets for 61-01-050920_SP were found.

All filesets for 61-02-040920_SP were found.

All filesets for 61-00-100939_SP were found.

All filesets for 61-01-060939_SP were found.

All filesets for 61-02-050939_SP were found.

All filesets for 61-03-020939_SP were found.

Not all filesets for 61-04-010944_SP were found.

I applied the update at this point.

# oslevel -s

6100-04-01-0944

# instfix -i | grep AIX

All filesets for 6.1.0.0_AIX_ML were found.

All filesets for 6100-00_AIX_ML were found.

All filesets for 6100-01_AIX_ML were found.

All filesets for 6100-02_AIX_ML were found.

All filesets for 6100-03_AIX_ML were found.

All filesets for 6100-04_AIX_ML were found.

# instfix -i | grep SP

All filesets for 61-00-010748_SP were found.

All filesets for 61-00-020750_SP were found.

All filesets for 61-00-030808_SP were found.

All filesets for 61-00-040815_SP were found.

All filesets for 61-01-010823_SP were found.

All filesets for 61-00-050822_SP were found.

All filesets for 61-00-060834_SP were found.

All filesets for 61-01-020834_SP were found.

All filesets for 61-00-070846_SP were found.

All filesets for 61-01-030846_SP were found.

All filesets for 61-02-010847_SP were found.

All filesets for 61-02-020849_SP were found.

All filesets for 61-00-080909_SP were found.

All filesets for 61-01-040909_SP were found.

All filesets for 61-02-030909_SP were found.

All filesets for 61-03-010921_SP were found.

All filesets for 61-00-090920_SP were found.

All filesets for 61-01-050920_SP were found.

All filesets for 61-02-040920_SP were found.

All filesets for 61-00-100939_SP were found.

All filesets for 61-01-060939_SP were found.

All filesets for 61-02-050939_SP were found.

All filesets for 61-03-020939_SP were found.

All filesets for 61-04-010944_SP were found.

# lslpp -l artex*

Fileset Level State Description

----------------------------------------------------------------------------

Path: /usr/lib/objrepos

artex.base.rte 6.1.4.1 COMMITTED AIX Runtime Expert

artex.base.samples 6.1.4.0 COMMITTED AIX Runtime Expert sample

profiles

Path: /etc/objrepos

artex.base.rte 6.1.4.0 COMMITTED AIX Runtime Expert

artex.base.samples 6.1.4.0 COMMITTED AIX Runtime Expert sample

profiles

Now I could run the new AIX Runtime Expert commands e.g.

# artexget

Usage: artexget [-p|-r|-n] [-l {dynamic|disruptive|reboot}]

[-f {txt|csv|xml}] profile

# artexlist

/etc/security/artex/samples/acctctlProfile.xml

/etc/security/artex/samples/aixpertProfile.xml

/etc/security/artex/samples/all.xml

/etc/security/artex/samples/alogProfile.xml

/etc/security/artex/samples/authProfile.xml

/etc/security/artex/samples/authentProfile.xml

/etc/security/artex/samples/chconsProfile.xml

/etc/security/artex/samples/chdevProfile.xml

/etc/security/artex/samples/chlicenseProfile.xml

/etc/security/artex/samples/chservicesProfile.xml

/etc/security/artex/samples/chssysProfile.xml

/etc/security/artex/samples/chsubserverProfile.xml

/etc/security/artex/samples/chuserProfile.xml

/etc/security/artex/samples/classProfile.xml

/etc/security/artex/samples/coreProfile.xml

/etc/security/artex/samples/dumpctrlProfile.xml

/etc/security/artex/samples/envProfile.xml

/etc/security/artex/samples/errdemonProfile.xml

/etc/security/artex/samples/ewlmProfile.xml

/etc/security/artex/samples/ffdcProfile.xml

/etc/security/artex/samples/filterProfile.xml

/etc/security/artex/samples/gencopyProfile.xml

/etc/security/artex/samples/iooProfile.xml

/etc/security/artex/samples/krecoveryProfile.xml

/etc/security/artex/samples/login.cfgProfile.xml

/etc/security/artex/samples/lvmoProfile.xml

/etc/security/artex/samples/mktcpipProfile.xml

/etc/security/artex/samples/mkuser.defaultProfile.xml

/etc/security/artex/samples/namerslvProfile.xml

/etc/security/artex/samples/nfsProfile.xml

/etc/security/artex/samples/nfsoProfile.xml

/etc/security/artex/samples/nisProfile.xml

/etc/security/artex/samples/noProfile.xml

/etc/security/artex/samples/probevueProfile.xml

/etc/security/artex/samples/rasoProfile.xml

/etc/security/artex/samples/roleProfile.xml

/etc/security/artex/samples/ruserProfile.xml

/etc/security/artex/samples/schedoProfile.xml

/etc/security/artex/samples/secattrProfile.xml

/etc/security/artex/samples/shconfProfile.xml

/etc/security/artex/samples/smtctlProfile.xml

/etc/security/artex/samples/syscorepathProfile.xml

/etc/security/artex/samples/sysdumpdevProfile.xml

/etc/security/artex/samples/trcctlProfile.xml

/etc/security/artex/samples/trustchkProfile.xml

/etc/security/artex/samples/tsdProfile.xml

/etc/security/artex/samples/viosdevattrProfile.xml

/etc/security/artex/samples/vmoProfile.xml

And I could access all the sample profiles:

# cd /etc/security/artex/samples

# ls -ltr

total 496

-r--r----- 1 root system 1439 Nov 05 13:58 chsubserverProfile.xml

-r--r----- 1 root system 2672 Nov 05 13:58 chssysProfile.xml

-r--r----- 1 root system 1435 Nov 05 13:58 chservicesProfile.xml

-r--r----- 1 root system 1460 Nov 05 13:58 chlicenseProfile.xml

-r--r----- 1 root system 2360 Nov 05 13:58 chdevProfile.xml

-r--r----- 1 root system 1759 Nov 05 13:58 chconsProfile.xml

-r--r----- 1 root system 1426 Nov 05 13:58 authentProfile.xml

-r--r----- 1 root system 1429 Nov 05 13:58 authProfile.xml

-r--r----- 1 root system 1497 Nov 05 13:58 alogProfile.xml

-r--r----- 1 root system 1441 Nov 05 13:58 aixpertProfile.xml

-r--r----- 1 root system 1666 Nov 05 13:58 acctctlProfile.xml

-r--r----- 1 root system 4301 Nov 05 13:58 vmoProfile.xml

-r--r----- 1 root system 2116 Nov 05 13:58 viosdevattrProfile.xml

-r--r----- 1 root system 1423 Nov 05 13:58 tsdProfile.xml

-r--r----- 1 root system 1883 Nov 05 13:58 trustchkProfile.xml

-r--r----- 1 root system 1538 Nov 05 13:58 trcctlProfile.xml

-r--r----- 1 root system 1617 Nov 05 13:58 sysdumpdevProfile.xml

-r--r----- 1 root system 1441 Nov 05 13:58 syscorepathProfile.xml

-r--r----- 1 root system 1427 Nov 05 13:58 smtctlProfile.xml

-r--r----- 1 root system 2130 Nov 05 13:58 shconfProfile.xml

-r--r----- 1 root system 1595 Nov 05 13:58 secattrProfile.xml

-r--r----- 1 root system 3611 Nov 05 13:58 schedoProfile.xml

-r--r----- 1 root system 1474 Nov 05 13:58 ruserProfile.xml

-r--r----- 1 root system 1420 Nov 05 13:58 roleProfile.xml

-r--r----- 1 root system 2156 Nov 05 13:58 rasoProfile.xml

-r--r----- 1 root system 2045 Nov 05 13:58 probevueProfile.xml

-r--r----- 1 root system 7278 Nov 05 13:58 noProfile.xml

-r--r----- 1 root system 1453 Nov 05 13:58 nisProfile.xml

-r--r----- 1 root system 1931 Nov 05 13:58 nfsoProfile.xml

-r--r----- 1 root system 1872 Nov 05 13:58 nfsProfile.xml

-r--r----- 1 root system 1490 Nov 05 13:58 namerslvProfile.xml

-r--r----- 1 root system 4283 Nov 05 13:58 mkuser.defaultProfile.xml

-r--r----- 1 root system 2201 Nov 05 13:58 mktcpipProfile.xml

-r--r----- 1 root system 1439 Nov 05 13:58 lvmoProfile.xml

-r--r----- 1 root system 2617 Nov 05 13:58 login.cfgProfile.xml

-r--r----- 1 root system 1471 Nov 05 13:58 krecoveryProfile.xml

-r--r----- 1 root system 3934 Nov 05 13:58 iooProfile.xml

-r--r----- 1 root system 184 Nov 05 13:58 gencopyProfile.xml

-r--r----- 1 root system 1434 Nov 05 13:58 filterProfile.xml

-r--r----- 1 root system 1456 Nov 05 13:58 ffdcProfile.xml

-r--r----- 1 root system 2238 Nov 05 13:58 ewlmProfile.xml

-r--r----- 1 root system 1594 Nov 05 13:58 errdemonProfile.xml

-r--r----- 1 root system 331 Nov 05 13:58 envProfile.xml

-r--r----- 1 root system 2039 Nov 05 13:58 dumpctrlProfile.xml

-r--r----- 1 root system 1754 Nov 05 13:58 coreProfile.xml

-r--r----- 1 root system 3905 Nov 05 13:58 classProfile.xml

-r--r----- 1 root system 7461 Nov 05 13:58 chuserProfile.xml

-rw-r--r-- 1 root system 41459 Nov 05 13:58 all.xml

Feed for Blog Entries ▼ Feed for Blog Comments ▼

Blogs

Chris's AIX Blog

▼ Tags

▼ Similar Blogs

AIX Down Unde...

Application P...

Asset Managem...

Application I...

AIXpert Blog

▼ Similar Ideation Blogs

IBM PureData-...

IBM Forms Exp...

IBM Tunisia H...

Rational Soft...

IBM Configura...

▼ Archive

▼ Blog Authors

Chris's AIX Blog

LPM ifix for JS22 blades and IVM.

IZ63357: LPM HUNG AT 100% ON BOTH SOURCE AND DESTINATION IVMS

Error description

Local fix

hd11admin is created as jfs instead of jfs2?

chlv: AIX 6.1 TL4 - Change an LV name online.

Installing the AIX Runtime Expert