IBM Support

Kafka service does not start

Troubleshooting


Problem

Zookeeper, Solr services start but only Kafka service does not start. # ./start-linux-services.sh Starting the zookeeper server on node 1 JMX enabled by default Using config: /opt/IBM/InformationServer/shared-open-source/zookeeper/conf/zoo1.cfg Starting zookeeper ... STARTED Waiting for zookeeper 1 to listen on port 52181: 10 --- --- Starting the kafka server on node 1 Waiting for kafka 1 to listen on port 59092: 1 Application kafka 1 not started after 10 seconds! # # ./status-linux-services.sh service name state pid ==================== ======= ====== InfoSrvZookeeper running 24077 InfoSrvSolrCloud running 24262 InfoSrvKafka stopped

Diagnosing The Problem

The following error messages are shown in <IS_INSTALL>/shared-open-source/kafka/logs/kafka-server.log

2018-01-31 18:29:33,041 INFO [main] starting
2018-01-31 18:29:33,050 INFO [main] Connecting to zookeeper on ipsvm6:52181
2018-01-31 18:29:33,481 FATAL [main] Fatal error during KafkaServer startup. Prepare to shutdown
kafka.common.KafkaException: Failed to acquire lock on file .lock in /opt/IBM/InformationServer/shared-open-source/kafka/data/1. A Kafka instance in another process or thread is using this directory.
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:100)
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:97)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:35)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at kafka.log.LogManager.lockLogDirs(LogManager.scala:97)

Resolving The Problem

Following steps solve the issue.

1. Stop services using stop-linux-services.sh
2. Remove <IS_INSTALL>/shared-open-source/kafka/data/1/.lock
3. Start services using start-linux-services.sh

(*) start/stop/status check scripts for AIX are start-aix-services.sh/stop-aix-services.sh/status-aix-services.sh.

[{"Product":{"code":"SSZJLG","label":"InfoSphere Information Analyzer"},"Business Unit":{"code":"BU053","label":"Cloud & Data Platform"},"Component":"--","Platform":[{"code":"PF002","label":"AIX"},{"code":"PF016","label":"Linux"}],"Version":"11.5.0.1;11.5.0.2;11.7","Edition":"All Editions","Line of Business":{"code":"","label":""}}]

Document Information

More support for:
InfoSphere Information Analyzer

Software version:
11.5.0.1, 11.5.0.2, 11.7

Operating system(s):
AIX, Linux

Document number:
305365

Modified date:
16 June 2018

UID

swg22014109

Manage My Notification Subscriptions