IBM Support

OA69108: ABEND 2C3 RSN EAA10167 EAA1015F EA8001B7 IOEZ00890E IOEZ00353E ERROR 129 REASON EFF26501

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • Closed as program error.

Error description

  • The issue occurred during IPL processing file system mount fails
    as it was disabled due to ACL for character-special file.
    
    ANALYSIS:
    During checking anode buffer in verify_anode_buffer routine for
    specific anode for ZFSMOUNT call we are detecting that ACL are
    available for character-special file in show_statusv5 and the
    customer is experiencing non-termination exception 2C3 with RSN
    EAA10167.
    The salvager is not detecting the mismatch of the ACLs.
    
    146 .334313) CNMOUNT: on entry stkp->flags2=00
    (146 .334313) CNMOUNT: vfsp=7F57ADF0 sequence=0 fp=C31EA288
    nextStack=0
    (146 .334313) ZFSMOUNT: OE--> stkp=C31EA000 recov=50BD313C40
    devno=5459 filesys=FILE.SYSTEM.NAME
    (146 .334318) ZFSMOUNT: type = ZFS
    (146 .334318) ZFSMOUNT: USS held=1C9 high=1C9 open=0 high=0
    (146 .334318) GET_REQUEST: req=7C6EBBB0 anchor=<FFFFFE20
    00000000>
    (146 .334319) dispatch: XCF REQ=50C2EE00B0 func=2253AAE8
    arg=7C6EBBB0 retp=7C6EBD50 rsnp=7C6EBD54 sync_flag=80000000
    mask=100000 1
    (146 .334321) osi_thread_post: code=0 ecb addr=7DB35B38
    ret=0000199A rtn=dispatch
    (146 .334329) plo_wait: waiting lock=0 ser=7C4E8D30 00000002
    elem=7C4E8D30 wflgs=0 ret=00001A78 rtn=dispatch
    (06F .334332) plo_wait: done, rc=0 newwait=0 state=00000000
    00000000
    (06F .334333) xcf_server: USS held=1C9 high=1C9 open=0 high=0
    (06F .334333) xcf_server: processing request=50C2EE00B0 type=1
    op=0, shutdown=0
    (06F .334334) knsvfs_mount: USS held=1C9 high=1C9 open=0 high=0
    (06F .334334) knsvfs_mount: start req=7C6EBBB0, vfsp=00000000,
    .......
    (06F .360588) verify_anode_buffer: bP=50C7B6B8E0 block=42
    index=16 IFSP ACL mismatch acl=36 fsp_flag2=00
    (06F .360588) verify_anode_buffer: file/dir/sym index=16
    unique=250
    (06F .360588) show_anodev5: -> disk anode=50C7DDAFCC logPage=42
    offset=FCC desc=|verify_anode_buffer|
    (06F .360588) show_anodev5: (C) flags=B4002F98 compressed=0
    LPI=0 index=10 allocated=0 length=0 EC_Flags=00 visible=0
    (06F .360588) show_anodev5: (D) .0.=FFFFFFFF .1.=FFFFFFFF
    .2.=FFFFFFFF .3.=FFFFFFFF .4.=FFFFFFFF .5.=FFFFFFFF .6.=FFFFFFFF
    .7.=FFFFFFFF
    (06F .360588) show_anodev5: (I) .0.=FFFFFFFF .1.=FFFFFFFF
    .2.=FFFFFFFF
    (06F .360589) show_statusv5: --> anode=50C7DDAFCC
    desc=|verify_anode_buffer|
    (06F .360589) show_statusv5: (I) ver=1 len=40 uid=0 gid=64
    flag=0 seclabel=||
    (06F .360590) show_statusv5: (I) perms (own=02 grp=00 oth=00
    flag2=0)
    (06F .360590) show_statusv5: (I) uaudit (r=02 w=02 x=02) aaudit
    (r=00 2=00 x=00)
    (06F .360590) show_statusv5: (C) entryCt=0 linkCnt=12 unique=FA
    datavers=0 genvalue=0 ACLS=<a=24 d=0 f=0>
    (06F .360590) show_statusv5: <-- linkCount(f)=1 mode=02 level=00
    (06F .360591) cm_issue_abend_recov, assert line=15563
    file=|episode/logbuf/buffer_xmem.c|
    (06F .360623) cm_malloc_cond: a=7C3BC330 size=3272, c=4 t=3,
    off=0000076A subr=cm_issue_abend_recov
    (06F .360624) cm_issue_abend_recov: frrinfo addr 7C3BC330
    (06F .360625) cm_issue_abend_recov: back from setfrra
    (06F .360625) cm_issue_abend_recov: calling ASSERTAB for 2C3
    abend
    (06F .407722) FRRRTN: abend code 042C3000 rsn EAA10167 psw
    077C1001 A2CDD60C
    
    TraceBack Information:
    Routine at addr 2242E9D0 name: assert_recovery
    
    Routine at addr 22F26FD0 name: verify_anode_buffer
    
    Routine at addr 22F43C58 name: verify_buffer
    
    Routine at addr 22F64690 name: elbb_ReadGeneral
    
    Routine at addr 22E47E30 name: epiv_Open
    
    Routine at addr 22DFC390 name: epig_OpenVolume
    
    Routine at addr 22A9ED08 name: efsag_volinfo
    
    Routine at addr 2276D798 name: ag_RegisterVolumes
    
    Routine at addr 227823E8 name: aggr_continue_init
    
    Routine at addr 22794BD0 name: ag_NewAggr
    
    Routine at addr 227715C8 name: dynamic_aggr_mount
    
    Routine at addr 2252D000 name: knsvfs_mount
                    Routine at addr 2253AAE8 name: knsvfs_router
                                     Routine at addr 22686F68 name:
    xcf_server                                             Routine
    at addr 22D88D08 name: osi_thread_first
    
                 zFS and USS Tasks
    
    
    STK/Recov     TCB     ASID   Stack      Routine
    State
    ----------  --------  ----  ----------  --------
    --------
    50C31EA000  009D9AD0  0012  50C31EA7C0  ZFSMOUNT
    WAITECB
    50BD313C40
    
           since  Feb 10 08:10:12 2026  Current DSA: 50C31EB158
    
            wait code location offset=1A78 rtn=dispatch
    
             wait for resource=50C2EE00B0 28
           resource description=Request completion on server thread
    
      Operation counted for OEVFS=7F57ADF0  VOLP=0  fs=
    
    
      7DA31000  009B3E88  0034    7DA32000  xcf_server
    RUNNING
    500005E880
            since  Feb 10 08:10:12 2026
        Resource 50C2EE00B0 28 held
           resource description=Request completion on server thread
    
        Resource 7EA88000 F held
           resource description=ADMIN zFS dump is in progress
        Holding enqname=IOEZNS
        Holding enqname=IOEZTM.FILE.SYSTEM.NAME
    
     xcf thread pool: 0  size 10
    
     ---------------------------
    
      service thread 7DB35B20 tcb 009B3E88 mask 00000001 admin req
    50C2EE00B0
      .. Mount arrived=Feb 10 08:10:12 2026 started=Feb 10 08:10:12
    2026
    
    During IPL processing the filesystem was disabled and the
    customer experiencing several non-terminating exception 2C3 with
    RSN EAA10167 , EAA1015F and EA8001B7 during the mount
    processing.
    
    SYSLOG:
    IOEZ00890E The local system failed with rc 128 and reason
    05AF002E while retrieving the automove option for aggregate
    FILE.SYSTEM.NAME. The local system will not become the zFS owner
    of the aggregate.
    IOEZ00422E Aggregate FILE.SYSTEM.NAME disabled
    
    IOEZ00353E Error 129 reason EFF26501 received from system SYS1
    during disable aggregate for FILE.SYSTEM.NAME
    IOEZ00784E Non-terminating exception 042C3000 occurred, reason
    EAA10167 abend psw <07741001 80000000> <00000000 22CDD60C>
    IOEZ00784E Non-terminating exception 042C3000 occurred, reason
    EAA1015F abend psw <07741001 80000000> <00000000 22CDD60C>
    IOEZ00784E Non-terminating exception 042C3000 occurred, reason
    EA8001B7 abend psw <07741001 80000000> <00000000 22CDD60C>
    
    KNOWN IMPACT:
    The filesystem is disabled indicated with IOEZ00422E msg.
    Error 129 reason EFF26501 was received while attempting to
    notify a remote system of disable operation with IOEZ00353E for
    the filesystem.
    The system generates several non-terminating exception 2C3 with
    reason code EAA10167, EAA1015F and EA8001B7.
    
    VERIFICATION STEPS:
    1. Extract zFS trace records from generated dump.
    2. Locate mount processing thread and worker thread executing
    the request
    3. Confirm fail is in verify_anode_buffer routine during ACL
    check in show_statusv5.
    
    ADDITIONAL SYMPTOMS:
    ABEND2C3 RSN EAA10167 EAA1015F EA8001B7 MSG IOEZ00890E MSG
    IOEZ00353E Error 129 reason EFF26501
    

Local fix

Problem summary

  • ****************************************************************
    * USERS AFFECTED: z/OS File System (zFS) 3.2                   *
    *                 zFS FMID:HZFS520                             *
    ****************************************************************
    * PROBLEM DESCRIPTION: A non-terminating abend was encountered *
    *                      during IPL processing after a zFS  file *
    *                      system mount failed as it was disabled  *
    *                      due to an ACL for character-special     *
    *                      file.                                   *
    *                                                              *
    *                      Additional symptoms:                    *
    *                      ABEND 2C3 RSN EAA10167 EAA1015F         *
    *                      EA8001B7 IOEZ00890E IOEZ00353E          *
    *                      ERROR 129 REASON EFF26501               *
    ****************************************************************
    * RECOMMENDATION: APPLY PTF                                    *
    ****************************************************************
    During anode buffer checking for a specific anode for a
    ZFSMOUNT call, ZFS  detected that a condition against a
    character-special file causing a non-termination exception
    2C3 with RSN EAA10167. The root cause is a character special
    file contains a ZFS ACL, even though RACF does not use ACLs for
    these objects.  This triggered the assert due to the mismatch of
    the ACLs. The salvager is not detecting the mismatch of the ACLs
    because the mismatch does not cause an integrity or security
    issue.
    

Problem conclusion

  • Fix has been added to ignore the ACLs on character special
    files.
    
    The fix must be activated on all shared filesystem environment
    members to ensure the mismatch of ACLs is ignored.
    

Temporary fix

Comments

APAR Information

  • APAR number

    OA69108

  • Reported component name

    ZFS ZSERIES FIL

  • Reported component ID

    5696EFS00

  • Reported release

    520

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2026-02-17

  • Closed date

    2026-03-31

  • Last modified date

    2026-03-31

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

    UJ99252

Modules/Macros

  • IOEAGFMT IOEAGSLV IOEDUMPF IOEFSCM  IOEFSKN  IOEFSTHD IOEFSUTL
    IOEZADM
    

Fix information

  • Fixed component name

    ZFS ZSERIES FIL

  • Fixed component ID

    5696EFS00

Applicable component levels

[{"Business Unit":{"code":"BU011","label":"Systems - zSystems software"},"Product":{"code":"SG19O"},"Platform":[{"code":"PF054","label":"z Systems"}],"Version":"520"}]

Document Information

Modified date:
01 April 2026