ORA-29701 When Starting Up Standalone ASM

 
First of all, Oracle clusterware services are needed by any ASM instance whether it is a single node (standalone) or clustered setup (RAC). This means, ASM will not start up if the clusterware services are not running on the database environment.

Oracle 10g

Error Message:

ORA-29701: unable to connect to Cluster Manager

Solution #1:

Execute the following as root user

/etc/init.d/init.cssd run

If solution one doesn’t work, proceed to solution #2.

Solution #2:

Using Unable to Start ASM on Standalone: CSS Does Not Start on Server Reboots. [ID 1437492.1]

To implement the solution, execute ALL steps in this exact order, don’t miss removing IPC sockets files and reboot the box in the middle as it doesn’t work without reboot.

How to remove and recreate the CSS
========================================
A)  First, make sure that the DB and ASM instances are shutdown.

B) Then, MAKE SURE THAT OLD CSS PROCESSES ARE DOWN:

ps -ef | grep css
kill -9 YOUR PROCESSID

C)  Login as ROOT

1.1)  At the bottom of the file, /etc/inittab, comment out (disable) the following entries from the /etc/inittab file.  These do not belong for a non-RAC configuration, so are not needed:

As root user, place a # in front of associated line:

#h2:2:respawn:/etc/init.cssd fatal >/dev/null 2>&1 </dev/null
#h3:2:respawn:/etc/init.crsd run >/dev/null 2>&1 </dev/null

1.2)  Set $ORACLE_HOME to the ASM home

1.3)  Clear the directory containing the IPC socket files:

# rm -f /usr/tmp/.oracle/*
# rm -f /tmp/.oracle/*
# rm -f /var/tmp/.oracle/*

Please NOTE:  The directory location of will vary across platforms.   Files would be present in one of the above locations.

1.4)  Rerun root.sh

1.5)  Remove the existing CSS:

$ORACLE_HOME/bin/localconfig delete

1.6)  REBOOT THE BOX

1.7)  Verify the removal succeeded:

ps -fea | grep css

There should be no rows other than possibly the grep itself … if this is not the case then
shutdown and restart the server AGAIN and then check again … if there are still processes
retry the removal … and check again … if it still fails …. STOP

1.8) Recreate the CSS:

$ORACLE_HOME/bin/localconfig add

Please NOTE:  For standalone, when ‘localconfig add’ is executed, then we have created/added:

* ‘/etc/inittab’ is updated with the line:

h1:35:respawn:/etc/init.d/init.cssd run >/dev/null 2>&1 </dev/null

This entry is used to start OCSSD by init (see ‘man inittab’ for details).

1.9) Verify the add succeeded:

ps -fea | grep css

Output should be similar to:

oracle 10498 1 0 Aug28 ? 00:00:00 /u02/app/oracle/11g/bin/ocssd.bin

If you get warnings:

INIT: Command is respawning too rapidly. Check for possible errors.
id: h3 "/etc/init.crsd run >/dev/null 2>&1 </dev/null"

Then, check/verify that the following entries in the /etc/inittab file have been disabled:

#h2:2:respawn:/etc/init.cssd fatal >/dev/null 2>&1 </dev/null
#h3:2:respawn:/etc/init.crsd run >/dev/null 2>&1 </dev/null

Oracle 11g

Error Message:

ORA-29701: unable to connect to Cluster Synchronization Service

$ . oraenv

ORACLE_SID = [+ASM] ? +ASM

The Oracle base for ORACLE_HOME=/ora/fs0000/asm/oracle/product/11.2.0.2 is /ora/fs0000/app/oracle

oracle : server1 : @+ASM : /ora/fs0000/asm/oracle/product/11.2.0.2

$ sqlplus ‘/ as sysasm’

SQL*Plus: Release 11.2.0.2.0 Production on Thu Apr 4 07:51:18 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.

Connected to an idle instance.

SQL> startup

ORA-01078: failure in processing system parameters
ORA-29701: unable to connect to Cluster Synchronization Service

Solution:

This can be fixed by starting up the CSS daemon manually (as root), command is as follows:

./ora/fs0000/asm/oracle/product/11.2.0.2/bin/crsctl start resource ora.cssd

 

If you need more help with database issues, feel free to send me an email (jimmycdo@yahoo.com) and I'll gladly help.

About Jimbart