LI81237: WHENEVER WE TRY TO PUBLISH AN API, WE SEE THAT PRODUCT PUBLISH GETS BLOCKED AND WE ENCOUNTER 409

APAR status

• Closed as duplicate of another APAR.

Error description

• Whenever we try to publish an API, we see that Product publish
  gets blocked and we encounter 409.
  
  Version
  2018.4.1.8
  
  -------------
  
  2019-11-27T03:29:48.485Z
  apim:routes:product [0b1ea53c71269bfc11c0c472b4e0e323] apiUrl: "
  /api/catalogs/67442703-4c3c-4ca7-9d61-c6adce46bfde/00ec02ab-0208
  -426f-8522-04a6e7bcae68/apis/23e0e070-8cc7-4cdd-9426-b081663834d
  e"
  
  2019-11-27T03:29:48.485Z apim:routes:product
  [0b1ea53c71269bfc11c0c472b4e0e323] Looking up:
  "23e0e070-8cc7-4cdd-9426-b081663834de"
  
   "id":
  "23e0e070-8cc7-4cdd-9426-b0816638xxxe",
  
   "url": "/api/catalogs/
  67442703-4c3c-4ca7-9d61-c6adce46bfde/00ec02ab-0208-426f-8522-04a
  6e7bcae68/apis/23e0e070-8cc7-4cdd-9426-b081663xxxxx",
  
  2019-11-2
  7T03:29:48.685Z bhendi:error
  cassandraLock::lwtUpdateStatusTransaction actualRow : UPDATE
  apim.transactionlock USING TTL ? SET shadow_id = ?,
  transaction_id = ?, status = ?, new_timestamp = ? WHERE
  namespace = ? AND lock_id = ? IF status = ? and shadow_id <= ?;
  0,db0e5b90-0f6b-11ea-ac6d-5e42a5125bce,1ace02d0-81e0-4d47-8972-e
  a043b88eddc,IU,2a42a080-10c6-11ea-8b56-40fd7a0ec6a1,apim.api|674
  42703-4c3c-4ca7-9d61-c6adce46bfde:00ec02ab-0208-426f-8522-04a6e7
  bcae68|23e0e070-8cc7-4cdd-9426-b081663834de|1.0.0,apim.api|67442
  703-4c3c-4ca7-9d61-c6adce46bfde:00ec02ab-0208-426f-8522-04a6e7bc
  ae68|23e0e070-8cc7-4cdd-9426-b081663834de|1.0.0,CO,db0e5b90-0f6b
  -11ea-ac6d-5e42a5125bce
  
  2019-11-27T03:29:48.685Z bhendi:error
  cassandraLock::lwtUpdateStatusTransaction actualRow : UPDATE
  apim.transactionlock USING TTL ? SET shadow_id = ?,
  transaction_id = ?, status = ?, new_timestamp = ? WHERE
  namespace = ? AND lock_id = ? IF status = ? and shadow_id <= ?;
  0,db0e5b90-0f6b-11ea-ac6d-5e42a5125bce,1ace02d0-81e0-4d47-8972-e
  a043b88eddc,IU,2a42a080-10c6-11ea-8b56-40fd7a0ec6a1,apim.api|674
  42703-4c3c-4ca7-9d61-c6adce46bfde:00ec02ab-0208-426f-8522-04a6e7
  bcae68|23e0e070-8cc7-4cdd-9426-b081663834de|1.0.0,apim.api|67442
  703-4c3c-4ca7-9d61-c6adce46bfde:00ec02ab-0208-426f-8522-04a6e7bc
  ae68|23e0e070-8cc7-4cdd-9426-b081663834de|1.0.0,CO,db0e5b90-0f6b
  -11ea-ac6d-5e42a5125bce
  
  2019-11-27T03:29:48.685Z
  bhendi:cassandra-transactions Acquire lock: getting lock
  failed, try again - transaction
  id=1ace02d0-81e0-4d47-8972-ea043b88eddc and lock key=apim.api|67
  442703-4c3c-4ca7-9d61-c6adce46bfde:00ec02ab-0208-426f-8522-04a6e
  7bcae68|23e0e070-8cc7-4cdd-9426-b081663834de|1.0.0,
  operation=DELETE, retry count was=0, shadow id (main
  table)=db0e5b90-0f6b-11ea-ac6d-5e42a51xxxxx, shadow id (lock
  table)=db0e5b90-0f6b-11ea-ac6d-5e42a51xxxxx, the previous
  transaction=1296878c-045e-4dd1-94af-bbf6ae9xxxxx holds the
  lock
  
  ...
  
  2019-11-27T03:29:48.712Z audit
  [0b1ea53c71269bfc11c0c472b4exxxx] Stack trace for response
  error: Error: Another request is operating on resource of type
  api (id: 23e0e070-8cc7-4cdd-9426-b08166xxxxx) with the name
  'titan-otc-api-alerts' and version '1.0.0'. Please try again
  later.
  
   "Another request is operating on resource of type api
  (id: 23e0e070-8cc7-4cdd-9426-b081663xxxxx) with the name
  'titan-otc-api-alerts' and version '1.0.0'. Please try again
  later."
  

Local fix

• Run Cleanuplocks.js script
  

Problem summary

• Duplicate to LI81236
  

Problem conclusion

Temporary fix

Comments

• This APAR is a duplicate of LI81236
  

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

Applicable component levels