Troubleshooting
Problem
nginx-ingress keeps on restarting continuously causing the PAIV WebUI to be unavailable.
/opt/powerai-vision/bin/kubectl.sh get pods --namespace kube-system
NAME READY STATUS RESTARTS AGE
coredns-84786db598-xhxbn 1/1 Running 0 3m12s
nginx-ingress-lb-ppc64le-9tcqh 0/1 Running 2 3m12s
nvidia-device-plugin-daemonset-zmrd9 1/1 Running 0 3m1s
tiller-deploy-7f65888dc8-b2tv2 1/1 Running 0 3m12s
Symptom
/var/log/messages show:
[emerg] 267#267: bind() to 0.0.0.0:80 failed (13: Permission denied)
nginx: [emerg] bind() to 0.0.0.0:80 failed (13: Permission denied)
nginx: configuration file /tmp/nginx-cfg176547800 test failed
Cause
This can happen if there are firewall issues with the port, selinux and/or problems with nginx itself.
Environment
Red Hat 7.x
PowerAI Vision 1.x
Diagnosing The Problem
1. Check Firewall to ensure ports are opened.
# firewall-cmd --list-all-zones
2. Check selinux for possible denials
# ausearch -m avc -ts today
3. Verify if nginx was installed manually or there was an issue during the load_images.sh run.
Resolving The Problem
1. Open firewall ports:
# /opt/powerai-vision/sbin/firewall.sh
2. Put selinux in permissive mode temporarily and see if the issue persists:
# setenforce 0
3. Uninstall nginx if it was manually installed and/or problems seen during the load_images.sh during install. Then, load the images again via:
# /opt/powerai-vision/bin/load_images.sh -f ./<powerai-bundle>.tar
Document Location
Worldwide
[{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"HW1W1","label":"Power ->PowerLinux"},"Component":"","Platform":[{"code":"PF043","label":"Red Hat"}],"Version":"All Versions","Edition":"","Line of Business":{"code":"","label":""}}]
Was this topic helpful?
Document Information
Modified date:
19 December 2019
UID
ibm11136362