Wednesday, August 29, 2012

Install on 11.2.0.3 RAC: Patch 13440962: DIFFERENT SUBNET FAILED TO CONNECT TO VIP AFTER RESTART VIP (11.2.0.3)


As oracle


[oracle@oracle-node-2 ~]$ vi .bash_profile
# .bash_profile

# Get the aliases and functions
if [ -f ~/.bashrc ]; then
        . ~/.bashrc
fi

# User specific environment and startup programs
ORACLE_UNQNAME=oraclerac
ORACLE_SID= oraclerac2
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/oracle/product/11.2.0/dbhome_1

export ORACLE_SID ORACLE_BASE ORACLE_HOME ORACLE_UNQNAME

CRS_HOME=/u01/app/11.2.0/grid
RDBMS_HOME=/u01/app/oracle/product/11.2.0/dbhome_1

export CRS_HOME RDBMS_HOME

PATH=$PATH:$HOME/bin:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch

export PATH

As grid


[grid@oracle-node-2 ~]$ more .bash_profile
# .bash_profile

# Get the aliases and functions
if [ -f ~/.bashrc ]; then
        . ~/.bashrc
fi

# User specific environment and startup programs
umask 022

ORACLE_SID=+ASM2
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/11.2.0/grid

export ORACLE_SID ORACLE_BASE ORACLE_HOME

GRID_HOME=/u01/app/11.2.0/grid
export GRID_HOME

CRS_HOME=/u01/app/11.2.0/grid
RDBMS_HOME=/u01/app/oracle/product/11.2.0/dbhome_1

export CRS_HOME RDBMS_HOME

PATH=$PATH:$HOME/bin:$GRID_HOME/bin:$GRID_HOME/OPatch

export PATH
[grid@oracle-node-2 ~]$

As root


[root@oracle-node-2 u01]# unzip p13440962_112030_Linux-x86-64.zip

As grid


[grid@oracle-node-2 ~]$ opatch lsinventory -detail -oh $CRS_HOME
Invoking OPatch 11.2.0.1.7

Oracle Interim Patch Installer version 11.2.0.1.7
Copyright (c) 2011, Oracle Corporation.  All rights reserved.


Oracle Home       : /u01/app/11.2.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.7
OUI version       : 11.2.0.3.0
Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2012-08-29_10-06-31AM.log

Lsinventory Output file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2012-08-29_10-06-31AM.txt

--------------------------------------------------------------------------------
Installed Top-level Products (1):

Oracle Grid Infrastructure                                           11.2.0.3.0
There are 1 products installed in this Oracle Home.


Installed Products (88):

.............
There are 88 products installed in this Oracle Home.


There are no Interim patches installed in this Oracle Home.


Rac system comprising of multiple nodes
  Local node = oracle-node-1
  Remote node = oracle-node-2

--------------------------------------------------------------------------------

OPatch succeeded.
[grid@oracle-node-2 ~]$

[oracle@oracle-node-2 ~]$ opatch lsinventory -detail -oh $RDBMS_HOME
Invoking OPatch 11.2.0.1.7

Oracle Interim Patch Installer version 11.2.0.1.7
Copyright (c) 2011, Oracle Corporation.  All rights reserved.


Oracle Home       : /u01/app/oracle/product/11.2.0/dbhome_1
Central Inventory : /u01/app/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.7
OUI version       : 11.2.0.3.0
Log file location : /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/opatch2012-08-29_10-07-40AM.log

Lsinventory Output file location : /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/lsinv/lsinventory2012-08-29_10-07-40AM.txt

--------------------------------------------------------------------------------
Installed Top-level Products (1):

Oracle Database 11g                                                  11.2.0.3.0
There are 1 products installed in this Oracle Home.


Installed Products (136):

..................
There are 136 products installed in this Oracle Home.


There are no Interim patches installed in this Oracle Home.


Rac system comprising of multiple nodes
  Local node = oracle-node-1
  Remote node = oracle-node-2

--------------------------------------------------------------------------------

OPatch succeeded.

As oracle


[oracle@oracle-node-2 ~]$ emctl stop dbconsole
Oracle Enterprise Manager 11g Database Control Release 11.2.0.3.0
Copyright (c) 1996, 2011 Oracle Corporation.  All rights reserved.
https://oracle-node-1:1158/em/console/aboutApplication
Stopping Oracle Enterprise Manager 11g Database Control ...
 ...  Stopped.
[oracle@oracle-node-2 ~]$

As oracle


[oracle@oracle-node-2 ~]$ $RDBMS_HOME/bin/srvctl stop home -o $RDBMS_HOME -s /home/oracle/status -n oracle-node-2

As root


[root@oracle-node-2 opatch]# cd /u01/app/11.2.0/grid/crs/install/
[root@oracle-node-2 install]# ./rootcrs.pl -unlock
Using configuration parameter file: ./crsconfig_params
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'oracle-node-2'
CRS-2673: Attempting to stop 'ora.crsd' on 'oracle-node-2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'oracle-node-2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'oracle-node-2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'oracle-node-2'
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'oracle-node-2'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'oracle-node-2'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.oracle-node-2.vip' on 'oracle-node-2'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'oracle-node-2'
CRS-2677: Stop of 'ora.oracle-node-2.vip' on 'oracle-node-2' succeeded
CRS-2672: Attempting to start 'ora.oracle-node-2.vip' on 'oracle-node-1'
CRS-2677: Stop of 'ora.scan1.vip' on 'oracle-node-2' succeeded
CRS-2672: Attempting to start 'ora.scan1.vip' on 'oracle-node-1'
CRS-2676: Start of 'ora.oracle-node-2.vip' on 'oracle-node-1' succeeded
CRS-2676: Start of 'ora.scan1.vip' on 'oracle-node-1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'oracle-node-1'
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'oracle-node-1' succeeded
CRS-2677: Stop of 'ora.FRA.dg' on 'oracle-node-2' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'oracle-node-2'
CRS-2677: Stop of 'ora.asm' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'oracle-node-2'
CRS-2677: Stop of 'ora.ons' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'oracle-node-2'
CRS-2677: Stop of 'ora.net1.network' on 'oracle-node-2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'oracle-node-2' has completed
CRS-2677: Stop of 'ora.crsd' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'oracle-node-2'
CRS-2673: Attempting to stop 'ora.ctssd' on 'oracle-node-2'
CRS-2673: Attempting to stop 'ora.evmd' on 'oracle-node-2'
CRS-2673: Attempting to stop 'ora.asm' on 'oracle-node-2'
CRS-2677: Stop of 'ora.evmd' on 'oracle-node-2' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'oracle-node-2' succeeded
CRS-2677: Stop of 'ora.asm' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'oracle-node-2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'oracle-node-2' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'oracle-node-2'
CRS-2677: Stop of 'ora.cssd' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'oracle-node-2'
CRS-2677: Stop of 'ora.crf' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'oracle-node-2'
CRS-2677: Stop of 'ora.gipcd' on 'oracle-node-2' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'oracle-node-2'
CRS-2677: Stop of 'ora.gpnpd' on 'oracle-node-2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'oracle-node-2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully unlock /u01/app/11.2.0/grid
[root@oracle-node-2 install]#

As oracle


[oracle@oracle-node-2 scripts]$ pwd
/u01/13440962/custom/server/13440962/custom/scripts
[oracle@oracle-node-2 scripts]$
[oracle@oracle-node-2 scripts]$ ./prepatch.sh -dbhome $RDBMS_HOME
./prepatch.sh completed successfully.

As grid


[grid@oracle-node-2 ~]$ cd /u01/13440962/
[grid@oracle-node-2 13440962]$ ls
custom  etc  files  README.txt
[grid@oracle-node-2 13440962]$ opatch napply -local -oh $CRS_HOME -id 13440962
Invoking OPatch 11.2.0.1.7

Oracle Interim Patch Installer version 11.2.0.1.7
Copyright (c) 2011, Oracle Corporation.  All rights reserved.

UTIL session

Oracle Home       : /u01/app/11.2.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.7
OUI version       : 11.2.0.3.0
Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2012-08-29_11-02-29AM.log

Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   13440962

Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/app/11.2.0/grid')


Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '13440962' to OH '/u01/app/11.2.0/grid'

Patching component oracle.crs, 11.2.0.3.0...
Copying file to "/u01/app/11.2.0/grid/crs/install/crsconfig_lib.pm"
Copying file to "/u01/app/11.2.0/grid/crs/install/crspatch.pm"
Copying file to "/u01/app/11.2.0/grid/crs/install/s_crsconfig_lib.pm"
Patches 13440962 successfully applied.
Log file location: /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2012-08-29_11-02-29AM.log

OPatch succeeded.
[grid@oracle-node-2 13440962]$

As oracle


[oracle@oracle-node-2 ~]$ cd /u01/13440962/
[oracle@oracle-node-2 13440962]$ opatch napply custom/server/ -local -oh $RDBMS_HOME -id 13440962
Invoking OPatch 11.2.0.1.7

Oracle Interim Patch Installer version 11.2.0.1.7
Copyright (c) 2011, Oracle Corporation.  All rights reserved.

UTIL session

Oracle Home       : /u01/app/oracle/product/11.2.0/dbhome_1
Central Inventory : /u01/app/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.7
OUI version       : 11.2.0.3.0
Log file location : /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/opatch2012-08-29_11-04-29AM.log

Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   13440962

Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/app/oracle/product/11.2.0/dbhome_1')


Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '13440962' to OH '/u01/app/oracle/product/11.2.0/dbhome_1'

Patching component oracle.rdbms, 11.2.0.3.0...
Patches 13440962 successfully applied.
Log file location: /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/opatch2012-08-29_11-04-29AM.log

OPatch succeeded.
[oracle@oracle-node-2 13440962]$


As oracle


[oracle@oracle-node-2 13440962]$ cd custom/server/13440962/custom/scripts
[oracle@oracle-node-2 scripts]$ pwd
/u01/13440962/custom/server/13440962/custom/scripts
[oracle@oracle-node-2 scripts]$ ls
postpatch.sh  prepatch.sh
[oracle@oracle-node-2 scripts]$ ./postpatch.sh -dbhome $RDBMS_HOME
Reading /u01/app/oracle/product/11.2.0/dbhome_1/install/params.ora..
Reading /u01/app/oracle/product/11.2.0/dbhome_1/install/params.ora..
Parsing file /u01/app/oracle/product/11.2.0/dbhome_1/bin/racgwrap
Parsing file /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvctl
Parsing file /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvconfig
Parsing file /u01/app/oracle/product/11.2.0/dbhome_1/bin/cluvfy
Verifying file /u01/app/oracle/product/11.2.0/dbhome_1/bin/racgwrap
Verifying file /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvctl
Verifying file /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvconfig
Verifying file /u01/app/oracle/product/11.2.0/dbhome_1/bin/cluvfy
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/racgwrap
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvctl
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvconfig
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/cluvfy
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/diskmon.bin
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/lsnodes
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/osdbagrp
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/rawutl
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/srvm/admin/ractrans
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/srvm/admin/getcrshome
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/gnsd
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/crsdiag.pl
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libhasgen11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libclsra11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libdbcfg11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libocr11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libocrb11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libocrutl11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libuini11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/librdjni11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libgns11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libgnsjni11.so
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/lib/libagfw11.so
[oracle@oracle-node-2 scripts]$

As root


[root@oracle-node-2 install]# cd /u01/app/11.2.0/grid/crs/install/
[root@oracle-node-2 install]# ./rootcrs.pl -patch
Using configuration parameter file: ./crsconfig_params
CRS-4123: Oracle High Availability Services has been started.

As oracle


[oracle@oracle-node-2 ~]$ cd /u01/app/oracle/product/11.2.0/dbhome_1/bin
[oracle@oracle-node-2 bin]$ ./srvctl start home -o /u01/app/oracle/product/11.2.0/dbhome_1 -s /home/oracle/status -n oracle-node-2

As oracle


[oracle@oracle-node-2 bin]$ opatch lsinventory -oh $RDBMS_HOME
Invoking OPatch 11.2.0.1.7

Oracle Interim Patch Installer version 11.2.0.1.7
Copyright (c) 2011, Oracle Corporation.  All rights reserved.


Oracle Home       : /u01/app/oracle/product/11.2.0/dbhome_1
Central Inventory : /u01/app/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.7
OUI version       : 11.2.0.3.0
Log file location : /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/opatch2012-08-29_11-12-50AM.log

Lsinventory Output file location : /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/lsinv/lsinventory2012-08-29_11-12-50AM.txt

--------------------------------------------------------------------------------
Installed Top-level Products (1):

Oracle Database 11g                                                  11.2.0.3.0
There are 1 products installed in this Oracle Home.


Interim patches (1) :

Patch  13440962     : applied on Wed Aug 29 11:04:42 EEST 2012
Unique Patch ID:  14422521
   Created on 28 Dec 2011, 08:46:48 hrs PST8PDT
   Bugs fixed:
     13440962



Rac system comprising of multiple nodes
  Local node = oracle-node-2
  Remote node = oracle-node-1

--------------------------------------------------------------------------------

OPatch succeeded.
[oracle@oracle-node-2 bin]$

As grid


[grid@oracle-node-2 ~]$ opatch lsinventory -oh $CRS_HOME
Invoking OPatch 11.2.0.1.7

Oracle Interim Patch Installer version 11.2.0.1.7
Copyright (c) 2011, Oracle Corporation.  All rights reserved.


Oracle Home       : /u01/app/11.2.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.7
OUI version       : 11.2.0.3.0
Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2012-08-29_11-13-32AM.log

Lsinventory Output file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2012-08-29_11-13-32AM.txt

--------------------------------------------------------------------------------
Installed Top-level Products (1):

Oracle Grid Infrastructure                                           11.2.0.3.0
There are 1 products installed in this Oracle Home.


Interim patches (1) :

Patch  13440962     : applied on Wed Aug 29 11:03:03 EEST 2012
Unique Patch ID:  14422521
   Created on 28 Dec 2011, 08:48:56 hrs PST8PDT
   Bugs fixed:
     13440962



Rac system comprising of multiple nodes
  Local node = oracle-node-2
  Remote node = oracle-node-1

--------------------------------------------------------------------------------

OPatch succeeded.
[grid@oracle-node-2 ~]$

Repeat the same steps on other node in cluster ...

As grid


[grid@oracle-node-1 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
               ONLINE  ONLINE       oracle-node-1
               ONLINE  ONLINE       oracle-node-2
ora.FRA.dg
               ONLINE  ONLINE       oracle-node-1
               ONLINE  ONLINE       oracle-node-2
ora.LISTENER.lsnr
               ONLINE  ONLINE       oracle-node-1
               ONLINE  ONLINE       oracle-node-2
ora.asm
               ONLINE  ONLINE       oracle-node-1            Started
               ONLINE  ONLINE       oracle-node-2            Started
ora.gsd
               OFFLINE OFFLINE      oracle-node-1
               OFFLINE OFFLINE      oracle-node-2
ora.net1.network
               ONLINE  ONLINE       oracle-node-1
               ONLINE  ONLINE       oracle-node-2
ora.ons
               ONLINE  ONLINE       oracle-node-1
               ONLINE  ONLINE       oracle-node-2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       oracle-node-1
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       oracle-node-2
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       oracle-node-2
ora.cvu
      1        ONLINE  ONLINE       oracle-node-2
ora.oc4j
      1        ONLINE  ONLINE       oracle-node-2
ora.oracle-node-1.vip
      1        ONLINE  ONLINE       oracle-node-1
ora.oracle-node-2.vip
      1        ONLINE  ONLINE       oracle-node-2
ora.oraclerac.db
      1        ONLINE  ONLINE       oracle-node-1            Open
      2        ONLINE  ONLINE       oracle-node-2            Open
ora.scan1.vip
      1        ONLINE  ONLINE       oracle-node-1
ora.scan2.vip
      1        ONLINE  ONLINE       oracle-node-2
ora.scan3.vip
      1        ONLINE  ONLINE       oracle-node-2

Same steps must be done on all the nodes in cluster.

No comments:

Post a Comment