IT46934: OBJECT AGENT PANIC WHEN S3 LIST OBJECTS IS CALLED

8.1.25.000-IBM-SPSRV-WindowsX64-340
8.1.25.000-IBM-SPSRV-Linuxx86_64-340
8.1.25.000-IBM-SPSRV-Linuxs390x-340
8.1.25.000-IBM-SPSRV-Linuxppc64le-340
8.1.25.000-IBM-SPSRV-AIX-340

APAR status

• Closed as program error.

Error description

• When a S3 client (e.g. IBM Storage Protect Plus) is doing a S3
  call 'ListObjects', the Object Agent logs the following error
  and the ListObjects fails.
  
  
  The Object Agent protect.log logs following error when the
  issue is seen:
  
  
  <date>  INFO    -> Entry at s3_list.go ListObjectsV1:147.
   {"requestID": "7W79PGYQ20", "class": "entry", "bucket":
   "<bucket>", "prefix": "spp_archive_metadata/<volume>/volume-",
   "marker": "", "delimiter": "/", "maxKeys": 1000}
  <date>  INFO    -> Entry at client.go GetFilespace:1357.
   {"requestID": "7W79PGYQ20", "class": "entry", "fsName":
   "<bucket>"}
  <date>  INFO    Current session count ceiling.  {"class":
   "pooling", "ceiling": 2, "tracking": "SSFWI"}
  <date>  INFO    <- Exit at client.go GetFilespace:1379.
   {"requestID": "7W79PGYQ20", "class": "exit"}
  <date>  INFO    <- Exit at panic.go gopanic:884.
   {"requestID": "7W79PGYQ20", "class": "exit", "result": {"IsTrun
  
   cated":false,"NextMarker":"","Objects":null,"Prefixes":["spp_ar
  
   chive_metadata/<volume>/volume-spp_archive/","spp_archive_metad
  
   ata/<volume>/volume-spp_archive_metadata/"]}}
  <date>  INFO    Incoming session recycle.       {"requestID":
   "7W79PGYQ20", "class": "pooling", "tracking": "SSFWI"}
  <date>  INFO    Worker received recycle.        {"class":
   "pooling", "session": {"node": "SPP_OBJECT", "endpoint": "<SP
   server>", "id": "3LK7WP", "requests": 8, "requestId":
   "7W79PGYQ20"}, "tracking": "SSFWI"}
  <date>  INFO    http: panic serving <SP server>: runtime error:
   slice bounds out of range [22:0]
  goroutine 8973 [running]:
  net/http.(*conn).serve.func1()
  /usr/local/go1.19.8/src/net/http/server.go:1850 +0xbf
  panic({0x17bbf40, 0xc000122210})
       /usr/local/go1.19.8/src/runtime/panic.go:890 +0x262
  github.ibm.com/Spectrum-Protect/protect-api/api.objInfoWrapper.
  parse({{0x0,0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, .
  
       /extracts/8.1.19.000/srv_git/src/github.ibm.com/Spectrum
  -Protect/protect-api/api/verb_ingest.go:151+0x194
  github.ibm.com/Spectrum-Protect/protect-api/api.newObjInfoFromS
  tr(...)       /extracts/8.1.19.000/srv_git/src/github.ibm.com/Sp
  
  
  -Protect/protect-api/api/verb_ingest.go:188
  github.ibm.com/Spectrum-Protect/protect-api/api.(*Session).List
  ObjectsV1(0xc0000a77c0,{0x1a43108, 0xc000701140}, {0xc0004ca005,
  
  
  0x3d}, {0x0, 0x0}, {0xc0011a824d, ...}, ...)
       /extracts/8.1.19.000/srv_git/src/github.ibm.com/Spectrum
  -Protect/protect-api/api/s3_list.go:207+0xd18
  github.com/minio/minio/cmd/gateway/protect.(*protectObjects).Li
  stObjects(0x3d?,{0x1a43108?, 0xc000701050?}, {0xc0004ca005, 0x16
  
  
  {0xc0003b0e00, 0x3d}, {0x0, 0x0}, {0xc0011a824d, ...}, ...)
       /extracts/8.1.19.000/srv_git/src/github.com/minio/minio/
  cmd/gateway/protect/gateway-protect.go:346+0x3b9
  github.com/minio/minio/cmd.objectAPIHandlers.ListObjectsV1Handl
  er({0x18ddec0?,0x18ddeb8?}, {0x1a409f8, 0xc000108240}, 0xc00078a
  
       /extracts/8.1.19.000/srv_git/src/github.com/minio/minio/
  cmd/bucket-handlers-listobjects.go:166+0x30c
  net/http.HandlerFunc.ServeHTTP(0xc00078a200?, {0x1a409f8?,
  0xc000108240?}, 0x12f5eec0a28?)
  
  
  | MDVREGR 8.1.23.000 5698ISMSV |
  
  
  IBM Storage Protect Versions Affected:
  
  IBM Storage Protect Server 8.1.23.000 on all supported
  platforms
  
  
  Additional Keywords: Object Agent, SPP, TS016906864
  

Local fix

• n/a
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * All IBM Storage Protect server users on AIX, Windows and     *
  * Linux                                                        *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See error description.                                       *
  ****************************************************************
  * RECOMMENDATION:                                              *
  ****************************************************************
  

Problem conclusion

• This problem was fixed for s3 panic
  Platforms fixed:  AIX, Linux, and Windows
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  TSM SERVER

• Fixed component ID

  5698ISMSV

Applicable component levels