[TechNote] IHS not restarting after httpd.conf and ssl.conf files were modified

IHS not restarting after httpd.conf and ssl.conf files were modified

Problem(Abstract)

This technote identifies an IBM® Rational® ClearCase® defect on Linux® relating to incorrectly defined symlinks for the GSK libraries causing Rational Web Platform (RWP) failures and provides you with information on how to workaround the issue.

Symptom

Symlinks for the GSK libraries within the /usr/lib directory are incorrectly defined at time of installation.
As a result, components that use these libraries will fail or encounter difficulties.
For example SSL enabled RWP will fail to start the IBM HTTP Server (IHS) because it cannot resolve the gsk libraries /usr/lib/libgsk7ssl.so, /usr/lib/libgsk7cms.so, and /usr/lib/libgsk7sys.so.
...
Starting IHS...
IHS failed to start.  Check log files in /opt/rational/common/rwp/logs and/or /opt/rational/common/rwp/IHS/logs

Following the above failure the logs under .../rwp/logs are empty and there are no logs created under .../rwp/IHS/logs

Cause

Incorrect symlinks in the /usr/lib directory for GSK libraries are causing the RWP failures

Within the /usr/lib directory, symlinks to the GSK libraries are incorrectly defined.

For example:

/usr/lib/libgsk7ssl.so -> /usr/local/ibm/gsk7/lib/libgsk7ssl.so
lrwxrwxrwx   1 root     root          36 Sep 18  2006 /usr/lib/libgsk7acmeidup.so -> /usr/local/gsk7/lib/libgsk7acmeidup.so
lrwxrwxrwx   1 root     root          31 Sep 18  2006 /usr/lib/libgsk7cms.so -> /usr/local/gsk7/lib/libgsk7cms.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7dbfl.so -> /usr/local/gsk7/lib/libgsk7dbfl.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7drld.so -> /usr/local/gsk7/lib/libgsk7drld.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7iccs.so -> /usr/local/gsk7/lib/libgsk7iccs.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7kicc.so -> /usr/local/gsk7/lib/libgsk7kicc.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7kjni.so -> /usr/local/gsk7/lib/libgsk7kjni.so
lrwxrwxrwx   1 root     root          30 Sep 18  2006 /usr/lib/libgsk7km.so -> /usr/local/gsk7/lib/libgsk7km.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7krnc.so -> /usr/local/gsk7/lib/libgsk7krnc.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7krrb.so -> /usr/local/gsk7/lib/libgsk7krrb.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7krsw.so -> /usr/local/gsk7/lib/libgsk7krsw.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7msca.so -> /usr/local/gsk7/lib/libgsk7msca.so
lrwxrwxrwx   1 root     root          31 Sep 18  2006 /usr/lib/libgsk7p11.so -> /usr/local/gsk7/lib/libgsk7p11.so
lrwxrwxrwx   1 root     root          31 Nov 29 11:48 /usr/lib/libgsk7ssl.so -> /usr/local/gsk7/lib/libgsk7ssl.so
lrwxrwxrwx   1 root     root          31 Sep 18  2006 /usr/lib/libgsk7sys.so -> /usr/local/gsk7/lib/libgsk7sys.so
lrwxrwxrwx   1 root     root          32 Sep 18  2006 /usr/lib/libgsk7valn.so -> /usr/local/gsk7/lib/libgsk7valn.so

Defect APAR PK57465 has been opened to investigate this issue.

Resolving the problem

There is no fix for the defect at this time.
WORKAROUND:
This problem can be easily rectified by removing the current symlinks within the /usr/lib directory for the GSK libraries.
Example:
rm -f /usr/lib/libgsk7ssl.so
or
rm -f /usr/lib/libgsk7*
Then recreate the symlink with the proper location of the library.
Example:
ln -s /opt/ibm/gsk7/lib/libgsk7acmeidup.so /usr/lib/libgsk7acmeidup.so
ln -s /opt/ibm/gsk7/lib/libgsk7cms.so /usr/lib/libgsk7cms.so  
ln -s /opt/ibm/gsk7/lib/libgsk7dbfl.so /usr/lib/libgsk7dbfl.so  
ln -s /opt/ibm/gsk7/lib/libgsk7drld.so /usr/lib/libgsk7drld.so  
ln -s /opt/ibm/gsk7/lib/libgsk7iccs.so /usr/lib/libgsk7iccs.so  
ln -s /opt/ibm/gsk7/lib/libgsk7kicc.so /usr/lib/libgsk7kicc.so  
ln -s /opt/ibm/gsk7/lib/libgsk7kjni.so /usr/lib/libgsk7kjni.so  
ln -s /opt/ibm/gsk7/lib/libgsk7km.so /usr/lib/libgsk7km.so  
ln -s /opt/ibm/gsk7/lib/libgsk7krnc.so /usr/lib/libgsk7krnc.so  
ln -s /opt/ibm/gsk7/lib/libgsk7krrb.so /usr/lib/libgsk7krrb.so  
ln -s /opt/ibm/gsk7/lib/libgsk7krsw.so /usr/lib/libgsk7krsw.so  
ln -s /opt/ibm/gsk7/lib/libgsk7msca.so /usr/lib/libgsk7msca.so  
ln -s /opt/ibm/gsk7/lib/libgsk7p11.so /usr/lib/libgsk7p11.so  
ln -s /opt/ibm/gsk7/lib/libgsk7ssl.so /usr/lib/libgsk7ssl.so  
ln -s /opt/ibm/gsk7/lib/libgsk7sys.so /usr/lib/libgsk7sys.so  
ln -s /opt/ibm/gsk7/lib/libgsk7valn.so /usr/lib/libgsk7valn.so  

For ClearCase 7.0.1.4 in order to fix the issue on SUSE Enterprise server 9 patch level 3:

cd /usr/lib; rm -f libgsk7*

ln -s /usr/local/ibm/gsk7/lib/libgsk7acmeidup.so /usr/lib/libgsk7acmeidup.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7cms.so /usr/lib/libgsk7cms.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7dbfl.so /usr/lib/libgsk7dbfl.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7drld.so /usr/lib/libgsk7drld.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7iccs.so /usr/lib/libgsk7iccs.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7kicc.so /usr/lib/libgsk7kicc.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7kjni.so /usr/lib/libgsk7kjni.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7km.so /usr/lib/libgsk7km.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7krnc.so /usr/lib/libgsk7krnc.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7krrb.so /usr/lib/libgsk7krrb.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7krsw.so /usr/lib/libgsk7krsw.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7msca.so /usr/lib/libgsk7msca.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7p11.so /usr/lib/libgsk7p11.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7ssl.so /usr/lib/libgsk7ssl.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7sys.so /usr/lib/libgsk7sys.so
ln -s /usr/local/ibm/gsk7/lib/libgsk7valn.so /usr/lib/libgsk7valn.so