Guenadi N Jilevski's Oracle BLOG

Oracle RAC, DG, EBS, DR and HA DBA BLOG

Oracle 11g R2 (11.2.0.2) RAC One Node management

Oracle 11g R2 11.2.0.2 RAC One Node management

In Oracle 11gR2 11.2.0.2 RAC One Node database creation and management is simplified. The traditional srvctl utility used to manage RAC databases now can natively manage RAC One Node databases as well. Another enhancement in 11.2.0.2 is the ability to easy create RAC One Node database using dbca utility as specified here. To recount, prior to Oracle 11gR2 11.2.0.2 patch 9004119 had to be applied to provide the utilities for Oracle RAC One Node management as described here. Starting with Oracle 11gR2 11.2.0.2 srvctl utility adds features to relocate RAC One Node database to another server or to convert between Oracle RAC database and Oracle RAC One Node database.

In this article we will look at managing RAC One Node databases using the srvctl utility for relocation to another server and for conversion between Oracle RAC and Oracle RAC One Node database.

Let’s set Transparent Application Failover (TAF) service

Create an entry in tnsnames.ora as follows.

 

 


RONETAF =

  (DESCRIPTION =

    (ENABLE = BROKEN)

    (LOAD_BALANCE = OFF)

    (FAILOVER = ON)

    (ADDRESS = (PROTOCOL = TCP)(HOST = rac-scan)(PORT = 1521))

      (CONNECT_DATA =

      (SERVER = DEDICATED)

      (SERVICE_NAME = RONE)

      (FAILOVER_MODE =

        (TYPE = SELECT)

        (METHOD = BASIC)

        (BACKUP = RONE)

      )

    )

  )

 

 

 

 

 

 

Relocate a RAC One Node database instance to another server from the list of candidate servers.

In this example we will use RONE RAC One Node database running on raclinux2 node and with candidate servers defined as raclinux1 and raclinux2, that is, the RONE can be relocated between raclinux1 and raclinux2.

 

 


[oracle@raclinux2 admin]$ srvctl status database -d rone

Instance RONE_1 is running on node raclinux2

Online relocation: INACTIVE

[oracle@raclinux2 admin]$ srvctl config database -d rone

Database unique name: RONE

Database name: RONE

Oracle home: /u01/app/oracle/product/11.2.0/db_20

Oracle user: oracle

Spfile: +DATA/RONE/spfileRONE.ora

Domain:

Start options: open

Stop options: immediate

Database role: PRIMARY

Management policy: AUTOMATIC

Server pools: RONE

Database instances:

Disk Groups: DATA

Mount point paths:

Services: RACONE

Type: RACOneNode

Online relocation timeout: 30

Instance name prefix: RONE

Candidate servers: raclinux2,raclinux1

Database is administrator managed

[oracle@raclinux2 admin]$

 

 

 

 

 

Connect to the database using the TAF tnsnames.ora entry and run a query in one terminal session and relocate the instance to another candidate server while query is running in another terminal session

 

10pt;"> 

10pt;">[oracle@raclinux2 admin]$ sqlplus system/sys1@ronetaf

SQL*Plus: Release 11.2.0.2.0 Production on Tue Oct 5 14:21:50 2010

Copyright (c) 1982, 2010, Oracle.  All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production

With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,

Data Mining and Real Application Testing options

SQL> select * from gv$instance;

   INST_ID INSTANCE_NUMBER INSTANCE_NAME

---------- --------------- ----------------

HOST_NAME

----------------------------------------------------------------

VERSION           STARTUP_T STATUS       PAR    THREAD# ARCHIVE LOG_SWITCH_WAIT

----------------- --------- ------------ --- ---------- ------- ---------------

LOGINS     SHU DATABASE_STATUS   INSTANCE_ROLE      ACTIVE_ST BLO

---------- --- ----------------- ------------------ --------- ---

         1               1 RONE_1

raclinux2.gj.com

11.2.0.2.0        05-OCT-10 OPEN         YES          1 STOPPED

ALLOWED    NO  ACTIVE            PRIMARY_INSTANCE   NORMAL    NO

SQL>

SQL> @/u03/testtaf.sql

 SID   SERIAL# FAILOVER_TYPE FAILOVER_METHOD FAILED_OVER

---- --------- ------------- --------------- -----------

  37         7 SELECT        BASIC           NO

INSTANCE_NAME

----------------

RONE_1

  COUNT(*)

----------

    628628

 SID   SERIAL# FAILOVER_TYPE FAILOVER_METHOD FAILED_OVER

---- --------- ------------- --------------- -----------

  53         3 SELECT        BASIC           YES

INSTANCE_NAME

----------------

RONE_2

  COUNT(*)

----------

    628628

SQL>

 

 

 

Once the query is started relocate the instance to node raclinux1 in another terminal session.


[oracle@raclinux1 ~]$ srvctl status database -d RONE

Instance RONE_1 is running on node raclinux2

Online relocation: INACTIVE

[oracle@raclinux1 ~]$ srvctl relocate database -d RONE -n raclinux1

[oracle@raclinux1 ~]$ srvctl status database -d RONE

Instance RONE_2 is running on node raclinux1

Online relocation: INACTIVE

[oracle@raclinux1 ~]$

 

 

 

 

 

 

 

 

 

Monitor the failover in the first terminal session where the SQL is executing. RONE get relocated to node raclinux1 and the active instance is RONE_2. The TAF works and the session fails over to RONE_2.

Converting RAC One Node database to RAC database

Here we will use the srvctl utility to convert RAC One Node database to RAC database (srvctl convert database –c RAC). Initially RONE is configured as RAC One Node database with active instance running onraclinux1.

 


[oracle@raclinux1 db_20]$ srvctl config database -d RONE

Database unique name: RONE

Database name: RONE

Oracle home: /u01/app/oracle/product/11.2.0/db_20

Oracle user: oracle

Spfile: +DATA/RONE/spfileRONE.ora

Domain:

Start options: open

Stop options: immediate

Database role: PRIMARY

Management policy: AUTOMATIC

Server pools: RONE

Database instances:

Disk Groups: DATA

Mount point paths:

Services: RACONE

Type: RACOneNode

Online relocation timeout: 30

Instance name prefix: RONE

Candidate servers: raclinux1

Database is administrator managed

[oracle@raclinux1 db_20]$

 

 

 

 

Use srvctl to convert the database to RAC and create and start second instance as shown below.

 


[oracle@raclinux1 db_20]$ srvctl convert database -d RONE -c RAC

[oracle@raclinux1 db_20]$ srvctl status database -d RONE

Instance RONE_1 is running on node raclinux1

[oracle@raclinux1 db_20]$ srvctl config database -d RONE

Database unique name: RONE

Database name: RONE

Oracle home: /u01/app/oracle/product/11.2.0/db_20

Oracle user: oracle

Spfile: +DATA/RONE/spfileRONE.ora

Domain:

Start options: open

Stop options: immediate

Database role: PRIMARY

Management policy: AUTOMATIC

Server pools: RONE

Database instances: RONE_1

Disk Groups: DATA

Mount point paths:

Services: RACONE

Type: RAC

Database is administrator managed

[oracle@raclinux1 db_20]$

[oracle@raclinux1 db_20]$ srvctl add instance -d RONE -i RONE_2 -n raclinux2

[oracle@raclinux1 db_20]$ srvctl config database -d RONE

Database unique name: RONE

Database name: RONE

Oracle home: /u01/app/oracle/product/11.2.0/db_20

Oracle user: oracle

Spfile: +DATA/RONE/spfileRONE.ora

Domain:

Start options: open

Stop options: immediate

Database role: PRIMARY

Management policy: AUTOMATIC

Server pools: RONE

Database instances: RONE_1,RONE_2

Disk Groups: DATA

Mount point paths:

Services: RACONE

Type: RAC

Database is administrator managed

[oracle@raclinux1 db_20]$

[oracle@raclinux1 db_20]$ srvctl start instance -d RONE -i RONE_2

[oracle@raclinux1 db_20]$ srvctl status database -d RONE

Instance RONE_1 is running on node raclinux1

Instance RONE_2 is running on node raclinux2

[oracle@raclinux1 db_20]$

[oracle@raclinux1 db_20]$ sqlplus system/sys1@rone

SQL*Plus: Release 11.2.0.2.0 Production on Wed Oct 6 14:44:57 2010

Copyright (c) 1982, 2010, Oracle.  All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production

With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,

Data Mining and Real Application Testing options

SQL> select * from gv$instance;

   INST_ID INSTANCE_NUMBER INSTANCE_NAME

---------- --------------- ----------------

HOST_NAME

----------------------------------------------------------------

VERSION           STARTUP_T STATUS       PAR    THREAD# ARCHIVE LOG_SWITCH_WAIT

----------------- --------- ------------ --- ---------- ------- ---------------

LOGINS     SHU DATABASE_STATUS   INSTANCE_ROLE      ACTIVE_ST BLO

---------- --- ----------------- ------------------ --------- ---

         1               1 RONE_1

raclinux1.gj.com

11.2.0.2.0        06-OCT-10 OPEN         YES          1 STOPPED

ALLOWED    NO  ACTIVE            PRIMARY_INSTANCE   NORMAL    NO

   INST_ID INSTANCE_NUMBER INSTANCE_NAME

---------- --------------- ----------------

HOST_NAME

----------------------------------------------------------------

VERSION           STARTUP_T STATUS       PAR    THREAD# ARCHIVE LOG_SWITCH_WAIT

----------------- --------- ------------ --- ---------- ------- ---------------

LOGINS     SHU DATABASE_STATUS   INSTANCE_ROLE      ACTIVE_ST BLO

---------- --- ----------------- ------------------ --------- ---

         2               2 RONE_2

raclinux2.gj.com

11.2.0.2.0        06-OCT-10 OPEN         YES          2 STOPPED

ALLOWED    NO  ACTIVE            PRIMARY_INSTANCE   NORMAL    NO

SQL>

 

 

 

 

Converting RAC database to RAC One Node database

In order to convert a RAC database to RAC One Node database we need to

  1. Remove the second instance
  2. Use srvct to conver to RAC One Node database (srvctl convert database –c RACONENODE)

 

 


[oracle@raclinux1 db_20]$ srvctl stop instance -d RONE -i RONE_2

[oracle@raclinux1 db_20]$ srvctl status database -d RONE

Instance RONE_1 is running on node raclinux1

Instance RONE_2 is not running on node raclinux2

[oracle@raclinux1 db_20]$

[oracle@raclinux1 db_20]$ srvctl stop instance -d RONE -i RONE_2

[oracle@raclinux1 db_20]$ srvctl status database -d RONE

Instance RONE_1 is running on node raclinux1

Instance RONE_2 is not running on node raclinux2

[oracle@raclinux1 db_20]$ srvctl remove instance -d RONE -i RONE_2

Remove instance from the database RONE? (y/[n]) y

[oracle@raclinux1 db_20]$ srvctl status database -d RONE

Instance RONE_1 is running on node raclinux1

[oracle@raclinux1 db_20]$

[oracle@raclinux1 db_20]$ srvctl config database -d RONE

Database unique name: RONE

Database name: RONE

Oracle home: /u01/app/oracle/product/11.2.0/db_20

Oracle user: oracle

Spfile: +DATA/RONE/spfileRONE.ora

Domain:

Start options: open

Stop options: immediate

Database role: PRIMARY

Management policy: AUTOMATIC

Server pools: RONE

Database instances: RONE_1

Disk Groups: DATA

Mount point paths:

Services: RACONE

Type: RAC

Database is administrator managed

[oracle@raclinux1 db_20]$

[oracle@raclinux1 db_20]$ srvctl convert database -d RONE -c RACONENODE

PRKO-2159 : Option '-i' should be specified to convert an administrator-managed RAC database to its equivalent RAC One Node database configuration

[oracle@raclinux1 db_20]$ srvctl convert database -d RONE -c RACONENODE -i RONE_1

[oracle@raclinux1 db_20]$ srvctl config database -d RONE

Database unique name: RONE

Database name: RONE

Oracle home: /u01/app/oracle/product/11.2.0/db_20

Oracle user: oracle

Spfile: +DATA/RONE/spfileRONE.ora

Domain:

Start options: open

Stop options: immediate

Database role: PRIMARY

Management policy: AUTOMATIC

Server pools: RONE

Database instances:

Disk Groups: DATA

Mount point paths:

Services: RACONE

Type: RACOneNode

Online relocation timeout: 30

Instance name prefix: RONE

Candidate servers: raclinux1

Database is administrator managed

[oracle@raclinux1 db_20]$

[oracle@raclinux1 db_20]$ srvctl status database -d RONE

Instance RONE_1 is running on node raclinux1

Online relocation: INACTIVE

[oracle@raclinux1 db_20]$

[oracle@raclinux1 db_20]$ sqlplus system/sys1@rone

SQL*Plus: Release 11.2.0.2.0 Production on Wed Oct 6 15:13:24 2010

Copyright (c) 1982, 2010, Oracle.  All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production

With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,

Data Mining and Real Application Testing options

SQL> select * from gv$instance;

   INST_ID INSTANCE_NUMBER INSTANCE_NAME

---------- --------------- ----------------

HOST_NAME

----------------------------------------------------------------

VERSION           STARTUP_T STATUS       PAR    THREAD# ARCHIVE LOG_SWITCH_WAIT

----------------- --------- ------------ --- ---------- ------- ---------------

LOGINS     SHU DATABASE_STATUS   INSTANCE_ROLE      ACTIVE_ST BLO

---------- --- ----------------- ------------------ --------- ---

         1               1 RONE_1

raclinux1.gj.com

11.2.0.2.0        06-OCT-10 OPEN         YES          1 STOPPED

ALLOWED    NO  ACTIVE            PRIMARY_INSTANCE   NORMAL    NO

SQL>  

 

 

 

 

 

Summary

Staring with Oracle 11gR2 version 11.2.0.2 srvctl utility is used entirely to manage RAC ONE Node database activities such as relocation and conversion to and from RAC database to name a few.

October 7, 2010 Posted by | oracle | 4 Comments

Create Oracle RAC and Oracle RAC ONE Node Database using dbca in Oracle 11g R2 (11.2.0.2)

Create Oracle RAC and Oracle RAC ONE Node Database using dbca in Oracle 11g R2 (11.2.0.2)
  

In this article we will look at creating Oracle RAC and RAC ONE Node database using dbca. For install/upgrade to Oracle 11.2.0.2 look here.
  

Create Oracle RAC ONE Node database using dbca
  

Start dbca and select Oracle RAC One Node database and press Next to continue.
  


  

Select ‘Create a Database’ and press Next to continue.
  


  

Select Custom Database and press Next to continue.
  


  

Select Admin-Managed, enter database global name, SID prefix and service name and press Next to continue. DBCA will create one database with one instance which can be migrated across the nodes selected.
  


  

Enter and confirm the password(s) and press Next to continue.
  


  

Specify storage type and storage location and press Next to continue.
  


  

Specify the Fast recovery area (formerly flash recovery area) and press Next to continue.
  


  

Select the database components and component location and press Next to continue.
  


  

Select the init parameters. In this case use AMM is selected and the memory size is specified. Press Next to continue.
  


  

Keep the defaults and press Next to continue.
  


  

Select the options for dbca to generate a template and generation scripts and press Next to continue.
  


  

Review the summary and press OK to continue.
  


  

Wait for the dbca to complete.
  


  

Optionally choose the password management to change the passwords and unlock the accounts and once done press Exit to exit from dbca.
  


  

Create Oracle RAC database using dbca
  

Start dbca and select Oracle RAC database and press Next to continue.
  


  

Select ‘Create a Database’ and press Next to continue.
  


  

Select General Purpose or Transaction Processing Database and press Next to continue.
  


  

Select Admin-Managed, enter database global name, SID prefix and press Next to continue. DBCA will create one database with two instances on each node respectively.
  


  

Select Configure Enterprise Manager and select Automatic Maintenance Tasks Tab.
  


  

Select Enable automatic maintenance tasks and press Next to continue.
  


  

Enter and confirm the password(s) and press Next to continue.
  


  

Specify storage type and storage location and press Next to continue.
  


  

Specify the Fast recovery area (formerly flash recovery area) and press Next to continue.
  


  

Select the database components and component location and press Next to continue.
  


  

Select the init parameters. In this case use AMM is selected and the memory size is specified. Press Next to continue.
  


  

Keep the defaults and press Next to continue.
  


  

Select the options for dbca to generate a template and generation scripts and press Next to continue.
  


  

Review the summary and press OK to continue.
  


  

Wait for the dbca to complete.
  


  

Wait for the dbca to complete.
  


  

Wait for the dbca to complete. Optionally choose the password management to change the passwords and unlock the accounts and once done press Exit to exit from dbca.
  


  

Verify RACDB installation
  

 

 [oracle@raclinux1 ~]$ srvctl status database -d RACDB
 

Instance RACDB1 is not running on node raclinux1
 

Instance RACDB2 is not running on node raclinux2
 

[oracle@raclinux1 ~]$ srvctl start database -d RACDB
 

[oracle@raclinux1 ~]$ srvctl status database -d RACDB
 

Instance RACDB1 is running on node raclinux1
 

Instance RACDB2 is running on node raclinux2
 

[oracle@raclinux1 ~]$ srvctl config database -d RACDB
 

Database unique name: RACDB
 

Database name: RACDB
 

Oracle home: /u01/app/oracle/product/11.2.0/db_10
 

Oracle user: oracle
 

Spfile: +DGDUP/RACDB/spfileRACDB.ora
 

Domain:
 

Start options: open
 

Stop options: immediate
 

Database role: PRIMARY
 

Management policy: AUTOMATIC
 

Server pools: RACDB
 

Database instances: RACDB1,RACDB2
 

Disk Groups: DGDUP,DATA
 

Mount point paths:
 

Services:
 

Type: RAC
 

Database is administrator managed
 

[oracle@raclinux1 ~]$
 

 
 

[oracle@raclinux1 ~]$ sqlplus system/sys1@racdb
 

 
 

SQL*Plus: Release 11.2.0.2.0 Production on Tue Oct 5 14:26:32 2010
 

 
 

Copyright (c) 1982, 2010, Oracle.  All rights reserved.
 

 
 

 
 

Connected to:
 

Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
 

With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
 

Data Mining and Real Application Testing options
 

 
 

SQL> select * from gv$instance;
 

 
 

   INST_ID INSTANCE_NUMBER INSTANCE_NAME
 

---------- --------------- ----------------
 

HOST_NAME
 

----------------------------------------------------------------
 

VERSION           STARTUP_T STATUS       PAR    THREAD# ARCHIVE LOG_SWITCH_WAIT
 

----------------- --------- ------------ --- ---------- ------- ---------------
 

LOGINS     SHU DATABASE_STATUS   INSTANCE_ROLE      ACTIVE_ST BLO
 

---------- --- ----------------- ------------------ --------- ---
 

         1               1 RACDB1
 

raclinux1.gj.com
 

11.2.0.2.0        05-OCT-10 OPEN         YES          1 STOPPED
 

ALLOWED    NO  ACTIVE            PRIMARY_INSTANCE   NORMAL    NO
 

 
 

 
 

   INST_ID INSTANCE_NUMBER INSTANCE_NAME
 

---------- --------------- ----------------
 

HOST_NAME
 

----------------------------------------------------------------
 

VERSION           STARTUP_T STATUS       PAR    THREAD# ARCHIVE LOG_SWITCH_WAIT
 

----------------- --------- ------------ --- ---------- ------- ---------------
 

LOGINS     SHU DATABASE_STATUS   INSTANCE_ROLE      ACTIVE_ST BLO
 

---------- --- ----------------- ------------------ --------- ---
 

         2               2 RACDB2
 

raclinux2.gj.com
 

11.2.0.2.0        05-OCT-10 OPEN         YES          2 STOPPED
 

ALLOWED    NO  ACTIVE            PRIMARY_INSTANCE   NORMAL    NO
 

 
 

 
 

SQL>
 

 

 

 

  

   

   

   

   

   

Verify RONE installation
  

   

 

 [oracle@raclinux2 admin]$ srvctl status database -d rone 

Instance RONE_1 is running on node raclinux2 

Online relocation: INACTIVE 

[oracle@raclinux2 admin]$ srvctl config database -d rone 

Database unique name: RONE 

Database name: RONE 

Oracle home: /u01/app/oracle/product/11.2.0/db_20 

Oracle user: oracle 

Spfile: +DATA/RONE/spfileRONE.ora 

Domain: 

Start options: open 

Stop options: immediate 

Database role: PRIMARY 

Management policy: AUTOMATIC 

Server pools: RONE 

Database instances: 

Disk Groups: DATA 

Mount point paths: 

Services: RACONE 

Type: RACOneNode 

Online relocation timeout: 30 

Instance name prefix: RONE 

Candidate servers: raclinux2,raclinux1 

Database is administrator managed 

[oracle@raclinux2 admin]$ 

[oracle@raclinux2 admin]$ sqlplus system/sys1@ronetaf 

SQL*Plus: Release 11.2.0.2.0 Production on Tue Oct 5 14:21:50 2010 

Copyright (c) 1982, 2010, Oracle.  All rights reserved. 

Connected to: 

Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production 

With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP, 

Data Mining and Real Application Testing options 

SQL> select * from gv$instance; 

   INST_ID INSTANCE_NUMBER INSTANCE_NAME 

---------- --------------- ---------------- 

HOST_NAME 

---------------------------------------------------------------- 

VERSION           STARTUP_T STATUS       PAR    THREAD# ARCHIVE LOG_SWITCH_WAIT 

----------------- --------- ------------ --- ---------- ------- --------------- 

LOGINS     SHU DATABASE_STATUS   INSTANCE_ROLE      ACTIVE_ST BLO 

---------- --- ----------------- ------------------ --------- --- 

         1               1 RONE_1 

raclinux2.gj.com 

11.2.0.2.0        05-OCT-10 OPEN         YES          1 STOPPED 

ALLOWED    NO  ACTIVE            PRIMARY_INSTANCE   NORMAL    NO 

SQL> 

 

 

Summary
  

We looked at creating RAC and RAC ONE Node databases using dbca in Oracle 11gR2 11.2.0.2. We verified that the databases was successfully created. 

October 5, 2010 Posted by | oracle | 5 Comments

Upgrade to Oracle 11.2.0.2 from Oracle 11.2.0.1

Upgrade to Oracle 11.2.0.2 from Oracle 11.2.0.1
   

Starting with the first patch set for Oracle Database 11g Release 2 (11.2.0.2), Oracle Database patch sets are full installations of the Oracle Database software. In past releases, Oracle Database patch sets consisted of a set of files that replaced files in an existing Oracle home. Beginning with Oracle Database 11g Release 2, patch sets are full installations that replace existing installations as per MOS Important Changes to Oracle Database Patch Sets Starting With 11.2.0.2 [ID 1189783.1]
   

In this article we will look at how to upgrade existing Oracle GI and will install new Oracle RDBMS. For information on installing fresh Oracle 11.2.0.2 GI see here.
   

Prerequisites for Oracle 11gR2 11.2.0.2 installation is to install patch 9655006 to the 11.2.0.1 GI home before upgrading to 11.2.0.2 from 11.2.0.1. See Bug 9413827 on MOS.
   

If not patched upon running ./rootupgrade.sh will fail as shown below.
   

    

 
[root@raclinux1 grid]# ./rootupgrade.sh 
Running Oracle 11g root script... 
The following environment variables are set as: 
<p>    ORACLE_OWNER= oracle </p>
    ORACLE_HOME=  /u01/app/11.2.0.2/grid 
Enter the full pathname of the local bin directory: [/usr/local/bin]: 
<p>The contents of &quot;dbhome&quot; have not changed. No need to overwrite. </p>
The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) 
<p>[n]: </p>
The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) 
<p>[n]: </p>
Entries will be added to the /etc/oratab file as needed by 
Database Configuration Assistant when a database is created 
Finished running generic part of root script. 
Now product-specific root actions will be performed. 
Using configuration parameter file: /u01/app/11.2.0.2/grid/crs/install/crsconfig_params 
<p>Creating trace directory </p>
<p>Failed to add (property/value):('OLD_OCR_ID/'-1') for checkpoint:ROOTCRS_OLDHOMEINFO.Error code is 256 </p>
The fixes for bug 9413827 are not present in the 11.2.0.1 crs home 
Apply the patches for these bugs in the 11.2.0.1 crs home and then run rootupgrade.sh 
/u01/app/11.2.0.2/grid/perl/bin/perl -I/u01/app/11.2.0.2/grid/perl/lib -I/u01/app/11.2.0.2/grid/crs/install /u01/app/11.2.0.2/grid/crs/install/rootcrs.pl execution failed 
[root@raclinux1 grid]# 
<strong>

   

    

    

Patching 11.2.0.1 to 9655006
   

  1. Download and unzip latest OPatch utility with patch number 6880880 in $GI_HOME
  2. Download and unzip patch 9655006 in a stage directory in my case in /u01/stage. This will create two directories 9655006 and 9654983.
  3. Invoke OPatch from $GI_HOME/OPatch as root

    ./opatch auto /u01/stage -och /u01/app/11.2.0/grid
       

  4. Verify patching with opatch lsinventory. See the ANNEX for sample output.
  5. Refer to MOS ‘How to Manually Apply A Grid Infrastructure PSU Without Opatch Auto’ [ID 1210964.1] in case of problems.

        

Patching Oracle GI to 11.2.0.2
   

Create a new directory /u01/app/11.2.0.2/grid for Oracle 11.2.0.2 GI on all nodes.
   

mkdir –p /u01/app/11.2.0.2/grid
   

chmod –R 775 /u01/app/11.2.0.2/
   

chown –R oracle:oinstall /u01/app/11.2.0.2/
   

Download and unzip patch 10098816 into a stage directory in my case /u01/stage/11.2.0.2.
   

Start the installer from /u01/stage/11.2.0.2/grid. Either enter MOS credentials to check for updates or select ‘Skip software updates’. Press Next to continue.
   


   

Select Upgrade Oracle Grid Infrastructure or Oracle ASM and press Next to continue.
   


   

Select the languages and press Next to continue.
   


   

Make sure that all nodes are selected and press Next to continue.
   


   

Keep the defaults and press Next to continue.
   


   

Enter the new location for Oracle GI 11.2.0.2 as /u01/app/11.2.0.2/grid and press Next to continue.
   


   

Wait for the prerequisite checks to complete.
   


   

Review the Summary and press Install to continue.
   


   

Wait for the installation to complete.
   


   


   

Run rootupgrade.sh script first on raclinux1 and after that on raclinux2. Look at the output of the script in the Annex.
   

Wait for the Oracle GI installation to complete.
   

Verify that the GI is upgraded successfully from the new GI home
   

    

    

 [root@raclinux1 bin]# pwd
/u01/app/11.2.0.2/grid/bin
[root@raclinux1 bin]# ./crsctl check cluster -all
**************************************************************
raclinux1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
raclinux2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@raclinux1 bin]#

  

    

Install new Oracle 11.2.0.2 RDBMS binaries
   

Start the installer from /u01/stage/11.2.0.2/database. Press Next to continue.
   


   

Acknowledge that you do not want at present to provide MOS credentials and continue.
   


   

Either enter MOS credentials to check for updates or select ‘Skip software updates’. Press Next to continue.
   


   

Select ‘Install database software only’ and press Next to continue.
   


   

Select Oracle Real Application clusters database installation, select all nodes on the cluster and press Next to continue. We will show in later articles Oracle RAC and RAC ONE node database creation using dbca. Here we are installing only Oracle RDBMS binaries.
   


   

Optionally select the language and press Next to continue.
   


   

Select Enterprise Edition and press Next to continue.
   


   

Select the location for the New Oracle RDBMS home and press Next to continue.
   


   

Chose the defaults and press Next to continue.
   


   

Check the errors and fix them. In this case I select the Ignore All and press Next to continue.
   


   

Verify the Summary and press Install to continue.
   


   

Wait for the installation to complete.
   


   

Press Close upon successful completion.
   


   

In the next posts we will look into creating RAC and RAC ONE Node databases using dbca. If you have an existing database and you want to upgrade it using dbua.
   

Annex
   

Sample opach lsinventory ouput
   

  

 [oracle@raclinux2 OPatch]$ ./opatch lsinventory Invoking OPatch 11.2.0.1.3   Oracle Interim Patch Installer version 11.2.0.1.3 Copyright (c) 2010, Oracle Corporation.  All rights reserved.   Oracle Home       : /u01/app/11.2.0/grid Central Inventory : /u01/app/oraInventory    from           : /etc/oraInst.loc OPatch version    : 11.2.0.1.3 OUI version       : 11.2.0.1.0 OUI location      : /u01/app/11.2.0/grid/oui Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2010-09-23_19-45-20PM.log   Patch history file: /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch_history.txt   Lsinventory Output file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2010-09-23_19-45-20PM.txt   -------------------------------------------------------------------------------- Installed Top-level Products (1):   Oracle Grid Infrastructure                                           11.2.0.1.0 There are 1 products installed in this Oracle Home.   Interim patches (2) :   Patch  9655006      : applied on Thu Sep 23 19:34:31 EDT 2010 Unique Patch ID:  12651761    Created on 6 Jul 2010, 12:00:17 hrs PST8PDT    Bugs fixed:      9655006, 9778840, 9343627, 9783609, 9262748, 9262722   Patch  9654983      : applied on Thu Sep 23 19:20:20 EDT 2010 Unique Patch ID:  12651761    Created on 18 Jun 2010, 00:16:02 hrs PST8PDT    Bugs fixed:      9068088, 9363384, 8865718, 8898852, 8801119, 9054253, 8725286, 8974548      9093300, 8909984, 8755082, 8780372, 8664189, 8769569, 7519406, 8822531      7705591, 8650719, 9637033, 8639114, 8723477, 8729793, 8919682, 8856478      9001453, 8733749, 8565708, 8735201, 8684517, 8870559, 8773383, 8981059      8812705, 9488887, 8813366, 9242411, 8822832, 8897784, 8760714, 8775569      8671349, 8898589, 9714832, 8642202, 9011088, 9170608, 9369797, 9165206      8834636, 8891037, 8431487, 8570322, 8685253, 8872096, 8718952, 8799099      9032717, 9399090, 9546223, 9713537, 8588519, 8783738, 8834425, 9454385      8856497, 8890026, 8721315, 8818175, 8674263, 9145541, 8720447, 9272086      9467635, 9010222, 9197917, 8991997, 8661168, 8803762, 8769239, 9654983      8706590, 8778277, 8815639, 9027691, 9454036, 9454037, 9454038, 9255542      8761974, 9275072, 8496830, 8702892, 8818983, 8475069, 8875671, 9328668      8798317, 8891929, 8774868, 8820324, 8544696, 8702535, 8268775, 9036013      9363145, 8933870, 8405205, 9467727, 8822365, 9676419, 8761260, 8790767      8795418, 8913269, 8717461, 8607693, 8861700, 8330783, 8780281, 8780711      8784929, 9341448, 9015983, 9119194, 8828328, 8665189, 8717031, 8832205      9676420, 8633358, 9321701, 9655013, 8796511, 9167285, 8782971, 8756598      8703064, 9066116, 9007102, 9461782, 9352237, 8505803, 8753903, 9216806      8918433, 9057443, 8790561, 8733225, 9067282, 8928276, 9210925, 8837736       Rac system comprising of multiple nodes   Local node = raclinux2   Remote node = raclinux1   --------------------------------------------------------------------------------   OPatch succeeded. [oracle@raclinux2 OPatch]$       [oracle@raclinux1 OPatch]$ ./opatch lsinventory Invoking OPatch 11.2.0.1.3   Oracle Interim Patch Installer version 11.2.0.1.3 Copyright (c) 2010, Oracle Corporation.  All rights reserved.   Oracle Home       : /u01/app/11.2.0/grid Central Inventory : /u01/app/oraInventory    from           : /etc/oraInst.loc OPatch version    : 11.2.0.1.3 OUI version       : 11.2.0.1.0 OUI location      : /u01/app/11.2.0/grid/oui Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2010-09-23_19-41-01PM.log   Patch history file: /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch_history.txt   Lsinventory Output file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2010-09-23_19-41-01PM.txt   -------------------------------------------------------------------------------- Installed Top-level Products (1):   Oracle Grid Infrastructure                                           11.2.0.1.0 There are 1 products installed in this Oracle Home.   Interim patches (2) :   Patch  9655006      : applied on Thu Sep 23 19:39:38 EDT 2010 Unique Patch ID:  12651761    Created on 6 Jul 2010, 12:00:17 hrs PST8PDT    Bugs fixed:      9655006, 9778840, 9343627, 9783609, 9262748, 9262722   Patch  9654983      : applied on Thu Sep 23 19:20:43 EDT 2010 Unique Patch ID:  12651761    Created on 18 Jun 2010, 00:16:02 hrs PST8PDT    Bugs fixed:      9068088, 9363384, 8865718, 8898852, 8801119, 9054253, 8725286, 8974548      9093300, 8909984, 8755082, 8780372, 8664189, 8769569, 7519406, 8822531      7705591, 8650719, 9637033, 8639114, 8723477, 8729793, 8919682, 8856478      9001453, 8733749, 8565708, 8735201, 8684517, 8870559, 8773383, 8981059      8812705, 9488887, 8813366, 9242411, 8822832, 8897784, 8760714, 8775569      8671349, 8898589, 9714832, 8642202, 9011088, 9170608, 9369797, 9165206      8834636, 8891037, 8431487, 8570322, 8685253, 8872096, 8718952, 8799099      9032717, 9399090, 9546223, 9713537, 8588519, 8783738, 8834425, 9454385      8856497, 8890026, 8721315, 8818175, 8674263, 9145541, 8720447, 9272086      9467635, 9010222, 9197917, 8991997, 8661168, 8803762, 8769239, 9654983      8706590, 8778277, 8815639, 9027691, 9454036, 9454037, 9454038, 9255542      8761974, 9275072, 8496830, 8702892, 8818983, 8475069, 8875671, 9328668      8798317, 8891929, 8774868, 8820324, 8544696, 8702535, 8268775, 9036013      9363145, 8933870, 8405205, 9467727, 8822365, 9676419, 8761260, 8790767      8795418, 8913269, 8717461, 8607693, 8861700, 8330783, 8780281, 8780711      8784929, 9341448, 9015983, 9119194, 8828328, 8665189, 8717031, 8832205      9676420, 8633358, 9321701, 9655013, 8796511, 9167285, 8782971, 8756598      8703064, 9066116, 9007102, 9461782, 9352237, 8505803, 8753903, 9216806      8918433, 9057443, 8790561, 8733225, 9067282, 8928276, 9210925, 8837736       Rac system comprising of multiple nodes   Local node = raclinux1   Remote node = raclinux2   --------------------------------------------------------------------------------   OPatch succeeded. [oracle@raclinux1 OPatch]$   Output of running rootupgrade.sh on raclinux1   [root@raclinux1 grid]# ./rootupgrade.sh Running Oracle 11g root script...   The following environment variables are set as:     ORACLE_OWNER= oracle     ORACLE_HOME=  /u01/app/11.2.0.2/grid   Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]: y    Copying oraenv to /usr/local/bin ... The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]: y    Copying coraenv to /usr/local/bin ...   Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Using configuration parameter file: /u01/app/11.2.0.2/grid/crs/install/crsconfig_params Creating trace directory Failed to add (property/value):('OLD_OCR_ID/'-1') for checkpoint:ROOTCRS_OLDHOMEINFO.Error code is 256   ASM upgrade has started on first node.   CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'raclinux1' CRS-2673: Attempting to stop 'ora.crsd' on 'raclinux1' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'raclinux1' CRS-2673: Attempting to stop 'ora.DATA.dg' on 'raclinux1' CRS-2673: Attempting to stop 'ora.registry.acfs' on 'raclinux1' CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'raclinux1' CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'raclinux1' CRS-2677: Stop of 'ora.DATA.dg' on 'raclinux1' succeeded CRS-2677: Stop of 'ora.registry.acfs' on 'raclinux1' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'raclinux1' CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'raclinux1' succeeded CRS-2673: Attempting to stop 'ora.scan1.vip' on 'raclinux1' CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'raclinux1' succeeded CRS-2673: Attempting to stop 'ora.raclinux1.vip' on 'raclinux1' CRS-2677: Stop of 'ora.scan1.vip' on 'raclinux1' succeeded CRS-2672: Attempting to start 'ora.scan1.vip' on 'raclinux2' CRS-2677: Stop of 'ora.asm' on 'raclinux1' succeeded CRS-2677: Stop of 'ora.raclinux1.vip' on 'raclinux1' succeeded CRS-2672: Attempting to start 'ora.raclinux1.vip' on 'raclinux2' CRS-2676: Start of 'ora.scan1.vip' on 'raclinux2' succeeded CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'raclinux2' CRS-2676: Start of 'ora.raclinux1.vip' on 'raclinux2' succeeded CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'raclinux2' succeeded CRS-2673: Attempting to stop 'ora.ons' on 'raclinux1' CRS-2673: Attempting to stop 'ora.eons' on 'raclinux1' CRS-2677: Stop of 'ora.ons' on 'raclinux1' succeeded CRS-2673: Attempting to stop 'ora.net1.network' on 'raclinux1' CRS-2677: Stop of 'ora.net1.network' on 'raclinux1' succeeded CRS-2677: Stop of 'ora.eons' on 'raclinux1' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'raclinux1' has completed CRS-2677: Stop of 'ora.crsd' on 'raclinux1' succeeded CRS-2673: Attempting to stop 'ora.mdnsd' on 'raclinux1' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'raclinux1' CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'raclinux1' CRS-2673: Attempting to stop 'ora.ctssd' on 'raclinux1' CRS-2673: Attempting to stop 'ora.evmd' on 'raclinux1' CRS-2673: Attempting to stop 'ora.asm' on 'raclinux1' CRS-2677: Stop of 'ora.cssdmonitor' on 'raclinux1' succeeded CRS-2677: Stop of 'ora.evmd' on 'raclinux1' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'raclinux1' succeeded CRS-2677: Stop of 'ora.ctssd' on 'raclinux1' succeeded CRS-2677: Stop of 'ora.drivers.acfs' on 'raclinux1' succeeded CRS-2677: Stop of 'ora.asm' on 'raclinux1' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'raclinux1' CRS-2677: Stop of 'ora.cssd' on 'raclinux1' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'raclinux1' CRS-2673: Attempting to stop 'ora.diskmon' on 'raclinux1' CRS-2677: Stop of 'ora.gpnpd' on 'raclinux1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'raclinux1' CRS-2677: Stop of 'ora.diskmon' on 'raclinux1' succeeded CRS-2677: Stop of 'ora.gipcd' on 'raclinux1' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'raclinux1' has completed CRS-4133: Oracle High Availability Services has been stopped. Successfully deleted 1 keys from OCR. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. OLR initialization - successful Adding daemon to inittab ACFS-9200: Supported ACFS-9300: ADVM/ACFS distribution files found. ACFS-9312: Existing ADVM/ACFS installation detected. ACFS-9314: Removing previous ADVM/ACFS installation. ACFS-9315: Previous ADVM/ACFS components successfully removed. ACFS-9307: Installing requested ADVM/ACFS software. ACFS-9308: Loading installed ADVM/ACFS drivers. ACFS-9321: Creating udev for ADVM/ACFS. ACFS-9323: Creating module dependencies - this may take some time. ACFS-9327: Verifying ADVM/ACFS devices. ACFS-9309: ADVM/ACFS installation correctness verified. clscfg: EXISTING configuration version 5 detected. clscfg: version 5 is 11g Release 2. Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. Configure Oracle Grid Infrastructure for a Cluster ... succeeded [root@raclinux1 grid]#       Output of running rootupgrade.sh on raclinux2.   [root@raclinux2 grid]# ./rootupgrade.sh Running Oracle 11g root script...   The following environment variables are set as:     ORACLE_OWNER= oracle     ORACLE_HOME=  /u01/app/11.2.0.2/grid   Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite.   Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Using configuration parameter file: /u01/app/11.2.0.2/grid/crs/install/crsconfig_params clscfg: EXISTING configuration version 5 detected. clscfg: version 5 is 11g Release 2. Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. CRS-1115: Oracle Clusterware has already been upgraded.   ASM upgrade has finished on last node.   Configure Oracle Grid Infrastructure for a Cluster ... succeeded [root@raclinux2 grid]# 

    

 

October 5, 2010 Posted by | oracle | 54 Comments

Fresh Oracle 11.2.0.2 Grid Infrastructure Installation PRVF-5150 PRVF-5184

Fresh Oracle 11.2.0.2 Grid Infrastructure Installation PRVF-5150 PRVF-5184

Oracle 11gR2 Grid Infrastructure installation version 11.2.0.1 is covered here. Linux installation is covered here. The prerequisites for the Oracle 11gR2 installation are described here. Setting up a VMware clusters for Oracle 11gR2 installation is covered here.

The article will not cover a detail step-by-step installation of 11.2.0.2 GI installation as it is similar to 11.2.0.1. Using runcluvfy confirmed that the prerequisites for Oracle GI and RAC are met. Using the OUI from GI 11.2.0.1 also confirmed that the installation prerequisites checks. For the output of the runcluvfy output see the Annex.

However, during a fresh installation of 11.2.0.2 Oracle GI following the 11.2.0.1 document the following errors were encountered, that is, PRVF-5150 and PRVF-5184 while executing the prerequisites checks.

If I use /dev/oracleasm/DISK* instead of ORCL:DISK* as a search patch I get the following error PRVF-5184.

Apparently there is something with the OUI/cluvfy in regards to Udev that is buggy or not documented.

The Oracle® Database Readme 11g Release 2 (11.2) suggests a bug 10044507.

I skipped the prerequisite checks selecting Ignore All check box and pressing Install button. Following the concepts for the 11.2.0.1 install the Oracle GI 11.2.0.2 installation succeeded.

MOS shed some light as well: PRVF-5449 : Check of Voting Disk location “ORCL:(ORCL:)” failed [ID 1267569.1] See Johan Westerduin comment.

Annex


[oracle@raclinux1 grid]$ ./runcluvfy.sh stage -pre crsinst -n raclinux1,raclinux2

Performing pre-checks for cluster services setup

Checking node reachability...
Node reachability check passed from node "raclinux1"
Checking user equivalence...
User equivalence check passed for user "oracle"

Checking node connectivity...

Checking hosts config file...

Verification of the hosts config file successful

Node connectivity passed for subnet "10.0.2.0" with node(s) raclinux2,raclinux1

ERROR:
PRVF-7617 : Node connectivity between "raclinux1 : 10.0.2.15" and "raclinux2 : 10.0.2.15" failed
TCP connectivity check failed for subnet "10.0.2.0"

Node connectivity passed for subnet "192.168.56.0" with node(s) raclinux2,raclinux1
TCP connectivity check passed for subnet "192.168.56.0"

Node connectivity passed for subnet "10.10.20.0" with node(s) raclinux2,raclinux1
TCP connectivity check passed for subnet "10.10.20.0"

Node connectivity passed for subnet "192.168.20.0" with node(s) raclinux2,raclinux1
TCP connectivity check passed for subnet "192.168.20.0"
Interfaces found on subnet "10.0.2.0" that are likely candidates for VIP are:
raclinux2 eth0:10.0.2.15
raclinux1 eth0:10.0.2.15

Interfaces found on subnet "192.168.56.0" that are likely candidates for a private interconnect are:
raclinux2 eth1:192.168.56.102
raclinux1 eth1:192.168.56.101

Node connectivity check failed
Checking ASMLib configuration.
Check for ASMLib configuration passed.
Total memory check passed
Available memory check passed
Swap space check passed
Free disk space check passed for "raclinux2:/tmp"
Free disk space check passed for "raclinux1:/tmp"
Check for multiple users with UID value 1100 passed
User existence check passed for "oracle"
Group existence check passed for "oinstall"
Group existence check passed for "dba"
Membership check for user "oracle" in group "oinstall" [as Primary] passed
Membership check for user "oracle" in group "dba" passed
Run level check passed
Hard limits check passed for "maximum open file descriptors"
Soft limits check passed for "maximum open file descriptors"
Hard limits check passed for "maximum user processes"
Soft limits check passed for "maximum user processes"
System architecture check passed
Kernel version check passed
Kernel parameter check passed for "semmsl"
Kernel parameter check passed for "semmns"
Kernel parameter check passed for "semopm"
Kernel parameter check passed for "semmni"
Kernel parameter check passed for "shmmax"
Kernel parameter check passed for "shmmni"
Kernel parameter check passed for "shmall"
Kernel parameter check passed for "file-max"
Kernel parameter check passed for "ip_local_port_range"
Kernel parameter check passed for "rmem_default"
Kernel parameter check passed for "rmem_max"
Kernel parameter check passed for "wmem_default"
Kernel parameter check passed for "wmem_max"
Kernel parameter check passed for "aio-max-nr"
Package existence check passed for "make-3.81( x86_64)"
Package existence check passed for "binutils-2.17.50.0.6( x86_64)"
Package existence check passed for "gcc-4.1.2 (x86_64)( x86_64)"
Package existence check passed for "libaio-0.3.106 (x86_64)( x86_64)"
Package existence check passed for "glibc-2.5-24 (x86_64)( x86_64)"
Package existence check passed for "compat-libstdc++-33-3.2.3 (x86_64)( x86_64)"
Package existence check passed for "elfutils-libelf-0.125 (x86_64)( x86_64)"

WARNING:
PRVF-7584 : Multiple versions of package "elfutils-libelf-devel" found on node raclinux1: elfutils-libelf-devel-0.137-3.el5 (x86_64),elfutils-libelf-devel-0.137-3.el5 (i386)
Package existence check passed for "elfutils-libelf-devel-0.125( x86_64)"
Package existence check passed for "glibc-common-2.5( x86_64)"
Package existence check passed for "glibc-devel-2.5 (x86_64)( x86_64)"
Package existence check passed for "glibc-headers-2.5( x86_64)"
Package existence check passed for "gcc-c++-4.1.2 (x86_64)( x86_64)"
Package existence check passed for "libaio-devel-0.3.106 (x86_64)( x86_64)"
Package existence check passed for "libgcc-4.1.2 (x86_64)( x86_64)"
Package existence check passed for "libstdc++-4.1.2 (x86_64)( x86_64)"
Package existence check passed for "libstdc++-devel-4.1.2 (x86_64)( x86_64)"
Package existence check passed for "sysstat-7.0.2( x86_64)"
Package existence check passed for "ksh-20060214( x86_64)"
Check for multiple users with UID value 0 passed
Current group ID check passed

Starting Clock synchronization checks using Network Time Protocol(NTP)...

NTP Configuration file check started...
No NTP Daemons or Services were found to be running

Clock synchronization check using Network Time Protocol(NTP) passed

Core file name pattern consistency check passed.

User "oracle" is not part of "root" group. Check passed
Default user file creation mask check passed
Checking consistency of file "/etc/resolv.conf" across nodes

File "/etc/resolv.conf" does not have both domain and search entries defined
domain entry in file "/etc/resolv.conf" is consistent across nodes
search entry in file "/etc/resolv.conf" is consistent across nodes
The DNS response time for an unreachable node is within acceptable limit on all nodes

File "/etc/resolv.conf" is consistent across nodes

Time zone consistency check passed

Starting check for Huge Pages Existence ...

Check for Huge Pages Existence passed

Starting check for Hardware Clock synchronization at shutdown ...

Check for Hardware Clock synchronization at shutdown passed

Pre-check for cluster services setup was unsuccessful.
Checks did not pass for the following node(s):
raclinux1 : 10.0.2.15
[oracle@raclinux1 grid]$
[oracle@raclinux1 grid]$ ./runcluvfy.sh stage -pre crsinst -n raclinux1,raclinux2 -verbose

Performing pre-checks for cluster services setup

Checking node reachability...

Check: Node reachability from node "raclinux1"
Destination Node                      Reachable?
------------------------------------  ------------------------
raclinux1                             yes
raclinux2                             yes
Result: Node reachability check passed from node "raclinux1"
Checking user equivalence...

Check: User equivalence for user "oracle"
Node Name                             Comment
------------------------------------  ------------------------
raclinux2                             passed
raclinux1                             passed
Result: User equivalence check passed for user "oracle"

Checking node connectivity...

Checking hosts config file...
Node Name     Status                    Comment
------------  ------------------------  ------------------------
raclinux2     passed
raclinux1     passed

Verification of the hosts config file successful
Interface information for node "raclinux2"
Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0   10.0.2.15       10.0.2.0        0.0.0.0         10.0.2.2        08:00:27:9C:41:1A 1500
eth1   192.168.56.102  192.168.56.0    0.0.0.0         10.0.2.2        08:00:27:3A:50:B2 1500
eth2   10.10.20.22     10.10.20.0      0.0.0.0         10.0.2.2        08:00:27:CA:35:14 1500
eth3   192.168.20.22   192.168.20.0    0.0.0.0         10.0.2.2        08:00:27:B1:72:31 1500
Interface information for node "raclinux1"
Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0   10.0.2.15       10.0.2.0        0.0.0.0         10.0.2.2        08:00:27:97:73:42 1500
eth1   192.168.56.101  192.168.56.0    0.0.0.0         10.0.2.2        08:00:27:A8:70:2A 1500
eth2   192.168.20.21   192.168.20.0    0.0.0.0         10.0.2.2        08:00:27:BF:C3:12 1500
eth3   10.10.20.21     10.10.20.0      0.0.0.0         10.0.2.2        08:00:27:68:35:9F 1500

Interface information for node "raclinux1"
Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0   10.0.2.15       10.0.2.0        0.0.0.0         10.0.2.2        08:00:27:97:73:42 1500
eth1   192.168.56.101  192.168.56.0    0.0.0.0         10.0.2.2        08:00:27:A8:70:2A 1500
eth2   192.168.20.21   192.168.20.0    0.0.0.0         10.0.2.2        08:00:27:BF:C3:12 1500
eth3   10.10.20.21     10.10.20.0      0.0.0.0         10.0.2.2        08:00:27:68:35:9F 1500
Check: Node connectivity of subnet "10.0.2.0"
Source                          Destination                     Connected?
------------------------------  ------------------------------  ----------------
raclinux2[10.0.2.15]            raclinux1[10.0.2.15]            yes
Result: Node connectivity passed for subnet "10.0.2.0" with node(s) raclinux2,raclinux1
Check: TCP connectivity of subnet "10.0.2.0"
Source                          Destination                     Connected?
------------------------------  ------------------------------  ----------------
raclinux1:10.0.2.15             raclinux2:10.0.2.15             failed

ERROR:
PRVF-7617 : Node connectivity between "raclinux1 : 10.0.2.15" and "raclinux2 : 10.0.2.15" failed
Result: TCP connectivity check failed for subnet "10.0.2.0"
Check: Node connectivity of subnet "192.168.56.0"
Source                          Destination                     Connected?
------------------------------  ------------------------------  ----------------
raclinux2[192.168.56.102]       raclinux1[192.168.56.101]       yes
Result: Node connectivity passed for subnet "192.168.56.0" with node(s) raclinux2,raclinux1
Check: TCP connectivity of subnet "192.168.56.0"
Source                          Destination                     Connected?
------------------------------  ------------------------------  ----------------
raclinux1:192.168.56.101        raclinux2:192.168.56.102        passed
Result: TCP connectivity check passed for subnet "192.168.56.0"
Check: Node connectivity of subnet "10.10.20.0"
Source                          Destination                     Connected?
------------------------------  ------------------------------  ----------------
raclinux2[10.10.20.22]          raclinux1[10.10.20.21]          yes
Result: Node connectivity passed for subnet "10.10.20.0" with node(s) raclinux2,raclinux1
Check: TCP connectivity of subnet "10.10.20.0"
Source                          Destination                     Connected?
------------------------------  ------------------------------  ----------------
raclinux1:10.10.20.21           raclinux2:10.10.20.22           passed
Result: TCP connectivity check passed for subnet "10.10.20.0"
Check: Node connectivity of subnet "192.168.20.0"
Source                          Destination                     Connected?
------------------------------  ------------------------------  ----------------
raclinux2[192.168.20.22]        raclinux1[192.168.20.21]        yes
Result: Node connectivity passed for subnet "192.168.20.0" with node(s) raclinux2,raclinux1
Check: TCP connectivity of subnet "192.168.20.0"
Source                          Destination                     Connected?
------------------------------  ------------------------------  ----------------
raclinux1:192.168.20.21         raclinux2:192.168.20.22         passed
Result: TCP connectivity check passed for subnet "192.168.20.0"
Interfaces found on subnet "10.0.2.0" that are likely candidates for VIP are:
raclinux2 eth0:10.0.2.15
raclinux1 eth0:10.0.2.15

Interfaces found on subnet "192.168.56.0" that are likely candidates for a private interconnect are:
raclinux2 eth1:192.168.56.102
raclinux1 eth1:192.168.56.101

Result: Node connectivity check failed
Checking ASMLib configuration.
Node Name                             Comment
------------------------------------  ------------------------
raclinux2                             passed
raclinux1                             passed
Result: Check for ASMLib configuration passed.

Check: Total memory
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     2.8773GB (3017016.0KB)    1.5GB (1572864.0KB)       passed
raclinux1     2.8773GB (3017016.0KB)    1.5GB (1572864.0KB)       passed
Result: Total memory check passed

Check: Available memory
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     2.71GB (2841676.0KB)      50MB (51200.0KB)          passed
raclinux1     2.6299GB (2757680.0KB)    50MB (51200.0KB)          passed
Result: Available memory check passed

Check: Swap space
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     4.8437GB (5079032.0KB)    2.8773GB (3017016.0KB)    passed
raclinux1     4.8437GB (5079032.0KB)    2.8773GB (3017016.0KB)    passed
Result: Swap space check passed

Check: Free disk space for "raclinux2:/tmp"
Path              Node Name     Mount point   Available     Required      Comment
----------------  ------------  ------------  ------------  ------------  ------------
/tmp              raclinux2     /             366.0488GB    1GB           passed
Result: Free disk space check passed for "raclinux2:/tmp"

Check: Free disk space for "raclinux1:/tmp"
Path              Node Name     Mount point   Available     Required      Comment
----------------  ------------  ------------  ------------  ------------  ------------
/tmp              raclinux1     /             356.672GB     1GB           passed
Result: Free disk space check passed for "raclinux1:/tmp"

Check: User existence for "oracle"
Node Name     Status                    Comment
------------  ------------------------  ------------------------
raclinux2     exists(1100)              passed
raclinux1     exists(1100)              passed

Checking for multiple users with UID value 1100
Result: Check for multiple users with UID value 1100 passed
Result: User existence check passed for "oracle"

Check: Group existence for "oinstall"
Node Name     Status                    Comment
------------  ------------------------  ------------------------
raclinux2     exists                    passed
raclinux1     exists                    passed
Result: Group existence check passed for "oinstall"

Check: Group existence for "dba"
Node Name     Status                    Comment
------------  ------------------------  ------------------------
raclinux2     exists                    passed
raclinux1     exists                    passed
Result: Group existence check passed for "dba"

Check: Membership of user "oracle" in group "oinstall" [as Primary]
Node Name         User Exists   Group Exists  User in Group  Primary       Comment
----------------  ------------  ------------  ------------  ------------  ------------
raclinux2         yes           yes           yes           yes           passed
raclinux1         yes           yes           yes           yes           passed
Result: Membership check for user "oracle" in group "oinstall" [as Primary] passed

Check: Membership of user "oracle" in group "dba"
Node Name         User Exists   Group Exists  User in Group  Comment
----------------  ------------  ------------  ------------  ----------------
raclinux2         yes           yes           yes           passed
raclinux1         yes           yes           yes           passed
Result: Membership check for user "oracle" in group "dba" passed

Check: Run level
Node Name     run level                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     5                         3,5                       passed
raclinux1     5                         3,5                       passed
Result: Run level check passed

Check: Hard limits for "maximum open file descriptors"
Node Name         Type          Available     Required      Comment
----------------  ------------  ------------  ------------  ----------------
raclinux2         hard          65536         65536         passed
raclinux1         hard          65536         65536         passed
Result: Hard limits check passed for "maximum open file descriptors"

Check: Soft limits for "maximum open file descriptors"
Node Name         Type          Available     Required      Comment
----------------  ------------  ------------  ------------  ----------------
raclinux2         soft          65536         1024          passed
raclinux1         soft          65536         1024          passed
Result: Soft limits check passed for "maximum open file descriptors"

Check: Hard limits for "maximum user processes"
Node Name         Type          Available     Required      Comment
----------------  ------------  ------------  ------------  ----------------
raclinux2         hard          16384         16384         passed
raclinux1         hard          16384         16384         passed
Result: Hard limits check passed for "maximum user processes"

Check: Soft limits for "maximum user processes"
Node Name         Type          Available     Required      Comment
----------------  ------------  ------------  ------------  ----------------
raclinux2         soft          16384         2047          passed
raclinux1         soft          16384         2047          passed
Result: Soft limits check passed for "maximum user processes"

Check: System architecture
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     x86_64                    x86_64                    passed
raclinux1     x86_64                    x86_64                    passed
Result: System architecture check passed

Check: Kernel version
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     2.6.18-194.el5            2.6.18                    passed
raclinux1     2.6.18-194.el5            2.6.18                    passed
Result: Kernel version check passed

Check: Kernel parameter for "semmsl"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     250                       250                       passed
raclinux1     250                       250                       passed
Result: Kernel parameter check passed for "semmsl"

Check: Kernel parameter for "semmns"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     32000                     32000                     passed
raclinux1     32000                     32000                     passed
Result: Kernel parameter check passed for "semmns"

Check: Kernel parameter for "semopm"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     100                       100                       passed
raclinux1     100                       100                       passed
Result: Kernel parameter check passed for "semopm"

Check: Kernel parameter for "semmni"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     128                       128                       passed
raclinux1     128                       128                       passed
Result: Kernel parameter check passed for "semmni"

Check: Kernel parameter for "shmmax"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     1544712192                1544712192                passed
raclinux1     1544712192                1544712192                passed
Result: Kernel parameter check passed for "shmmax"

Check: Kernel parameter for "shmmni"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     4096                      4096                      passed
raclinux1     4096                      4096                      passed
Result: Kernel parameter check passed for "shmmni"

Check: Kernel parameter for "shmall"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     2097152                   2097152                   passed
raclinux1     2097152                   2097152                   passed
Result: Kernel parameter check passed for "shmall"

Check: Kernel parameter for "file-max"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     6815744                   6815744                   passed
raclinux1     6815744                   6815744                   passed
Result: Kernel parameter check passed for "file-max"

Check: Kernel parameter for "ip_local_port_range"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     between 9000 & 65500      between 9000 & 65500      passed
raclinux1     between 9000 & 65500      between 9000 & 65500      passed
Result: Kernel parameter check passed for "ip_local_port_range"

Check: Kernel parameter for "rmem_default"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     262144                    262144                    passed
raclinux1     262144                    262144                    passed
Result: Kernel parameter check passed for "rmem_default"

Check: Kernel parameter for "rmem_max"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     4194304                   4194304                   passed
raclinux1     4194304                   4194304                   passed
Result: Kernel parameter check passed for "rmem_max"

Check: Kernel parameter for "wmem_default"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     262144                    262144                    passed
raclinux1     262144                    262144                    passed
Result: Kernel parameter check passed for "wmem_default"

Check: Kernel parameter for "wmem_max"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     1048586                   1048576                   passed
raclinux1     1048586                   1048576                   passed
Result: Kernel parameter check passed for "wmem_max"

Check: Kernel parameter for "aio-max-nr"
Node Name     Configured                Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     1048576                   1048576                   passed
raclinux1     1048576                   1048576                   passed
Result: Kernel parameter check passed for "aio-max-nr"

Check: Package existence for "make-3.81( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     make-3.81-3.el5           make-3.81( x86_64)        passed
raclinux1     make-3.81-3.el5           make-3.81( x86_64)        passed
Result: Package existence check passed for "make-3.81( x86_64)"

Check: Package existence for "binutils-2.17.50.0.6( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     binutils-2.17.50.0.6-14.el5  binutils-2.17.50.0.6( x86_64)  passed
raclinux1     binutils-2.17.50.0.6-14.el5  binutils-2.17.50.0.6( x86_64)  passed
Result: Package existence check passed for "binutils-2.17.50.0.6( x86_64)"

Check: Package existence for "gcc-4.1.2 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     gcc-4.1.2-48.el5 (x86_64)  gcc-4.1.2 (x86_64)( x86_64)  passed
raclinux1     gcc-4.1.2-48.el5 (x86_64)  gcc-4.1.2 (x86_64)( x86_64)  passed
Result: Package existence check passed for "gcc-4.1.2 (x86_64)( x86_64)"

Check: Package existence for "libaio-0.3.106 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     libaio-0.3.106-5 (x86_64)  libaio-0.3.106 (x86_64)( x86_64)  passed
raclinux1     libaio-0.3.106-5 (x86_64)  libaio-0.3.106 (x86_64)( x86_64)  passed
Result: Package existence check passed for "libaio-0.3.106 (x86_64)( x86_64)"

Check: Package existence for "glibc-2.5-24 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     glibc-2.5-49 (x86_64)     glibc-2.5-24 (x86_64)( x86_64)  passed
raclinux1     glibc-2.5-49 (x86_64)     glibc-2.5-24 (x86_64)( x86_64)  passed
Result: Package existence check passed for "glibc-2.5-24 (x86_64)( x86_64)"

Check: Package existence for "compat-libstdc++-33-3.2.3 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     compat-libstdc++-33-3.2.3-61 (x86_64)  compat-libstdc++-33-3.2.3 (x86_64)( x86_64)  passed
raclinux1     compat-libstdc++-33-3.2.3-61 (x86_64)  compat-libstdc++-33-3.2.3 (x86_64)( x86_64)  passed
Result: Package existence check passed for "compat-libstdc++-33-3.2.3 (x86_64)( x86_64)"

Check: Package existence for "elfutils-libelf-0.125 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     elfutils-libelf-0.137-3.el5 (x86_64)  elfutils-libelf-0.125 (x86_64)( x86_64)  passed
raclinux1     elfutils-libelf-0.137-3.el5 (x86_64)  elfutils-libelf-0.125 (x86_64)( x86_64)  passed
Result: Package existence check passed for "elfutils-libelf-0.125 (x86_64)( x86_64)"

Check: Package existence for "elfutils-libelf-devel-0.125( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.125( x86_64)  passed
raclinux1     elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.125( x86_64)  passed

WARNING:
PRVF-7584 : Multiple versions of package "elfutils-libelf-devel" found on node raclinux1: elfutils-libelf-devel-0.137-3.el5 (x86_64),elfutils-libelf-devel-0.137-3.el5 (i386)
Result: Package existence check passed for "elfutils-libelf-devel-0.125( x86_64)"

Check: Package existence for "glibc-common-2.5( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     glibc-common-2.5-49       glibc-common-2.5( x86_64)  passed
raclinux1     glibc-common-2.5-49       glibc-common-2.5( x86_64)  passed
Result: Package existence check passed for "glibc-common-2.5( x86_64)"

Check: Package existence for "glibc-devel-2.5 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     glibc-devel-2.5-49 (x86_64)  glibc-devel-2.5 (x86_64)( x86_64)  passed
raclinux1     glibc-devel-2.5-49 (x86_64)  glibc-devel-2.5 (x86_64)( x86_64)  passed
Result: Package existence check passed for "glibc-devel-2.5 (x86_64)( x86_64)"

Check: Package existence for "glibc-headers-2.5( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     glibc-headers-2.5-49      glibc-headers-2.5( x86_64)  passed
raclinux1     glibc-headers-2.5-49      glibc-headers-2.5( x86_64)  passed
Result: Package existence check passed for "glibc-headers-2.5( x86_64)"

Check: Package existence for "gcc-c++-4.1.2 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     gcc-c++-4.1.2-48.el5 (x86_64)  gcc-c++-4.1.2 (x86_64)( x86_64)  passed
raclinux1     gcc-c++-4.1.2-48.el5 (x86_64)  gcc-c++-4.1.2 (x86_64)( x86_64)  passed
Result: Package existence check passed for "gcc-c++-4.1.2 (x86_64)( x86_64)"

Check: Package existence for "libaio-devel-0.3.106 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     libaio-devel-0.3.106-5 (x86_64)  libaio-devel-0.3.106 (x86_64)( x86_64)  passed
raclinux1     libaio-devel-0.3.106-5 (x86_64)  libaio-devel-0.3.106 (x86_64)( x86_64)  passed
Result: Package existence check passed for "libaio-devel-0.3.106 (x86_64)( x86_64)"

Check: Package existence for "libgcc-4.1.2 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     libgcc-4.1.2-48.el5 (x86_64)  libgcc-4.1.2 (x86_64)( x86_64)  passed
raclinux1     libgcc-4.1.2-48.el5 (x86_64)  libgcc-4.1.2 (x86_64)( x86_64)  passed
Result: Package existence check passed for "libgcc-4.1.2 (x86_64)( x86_64)"

Check: Package existence for "libstdc++-4.1.2 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     libstdc++-4.1.2-48.el5 (x86_64)  libstdc++-4.1.2 (x86_64)( x86_64)  passed
raclinux1     libstdc++-4.1.2-48.el5 (x86_64)  libstdc++-4.1.2 (x86_64)( x86_64)  passed
Result: Package existence check passed for "libstdc++-4.1.2 (x86_64)( x86_64)"

Check: Package existence for "libstdc++-devel-4.1.2 (x86_64)( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     libstdc++-devel-4.1.2-48.el5 (x86_64)  libstdc++-devel-4.1.2 (x86_64)( x86_64)  passed
raclinux1     libstdc++-devel-4.1.2-48.el5 (x86_64)  libstdc++-devel-4.1.2 (x86_64)( x86_64)  passed
Result: Package existence check passed for "libstdc++-devel-4.1.2 (x86_64)( x86_64)"

Check: Package existence for "sysstat-7.0.2( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     sysstat-7.0.2-3.el5       sysstat-7.0.2( x86_64)    passed
raclinux1     sysstat-7.0.2-3.el5       sysstat-7.0.2( x86_64)    passed
Result: Package existence check passed for "sysstat-7.0.2( x86_64)"

Check: Package existence for "ksh-20060214( x86_64)"
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     ksh-20100202-1.el5        ksh-20060214( x86_64)     passed
raclinux1     ksh-20100202-1.el5        ksh-20060214( x86_64)     passed
Result: Package existence check passed for "ksh-20060214( x86_64)"

Checking for multiple users with UID value 0
Result: Check for multiple users with UID value 0 passed

Check: Current group ID
Result: Current group ID check passed

Starting Clock synchronization checks using Network Time Protocol(NTP)...

NTP Configuration file check started...
Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle Cluster Time Synchronization Service(CTSS) can be used instead of NTP for time synchronization on the cluster nodes
No NTP Daemons or Services were found to be running

Result: Clock synchronization check using Network Time Protocol(NTP) passed

Checking Core file name pattern consistency...
Core file name pattern consistency check passed.

Checking to make sure user "oracle" is not in "root" group
Node Name     Status                    Comment
------------  ------------------------  ------------------------
raclinux2     does not exist            passed
raclinux1     does not exist            passed
Result: User "oracle" is not part of "root" group. Check passed

Check default user file creation mask
Node Name     Available                 Required                  Comment
------------  ------------------------  ------------------------  ----------
raclinux2     0022                      0022                      passed
raclinux1     0022                      0022                      passed
Result: Default user file creation mask check passed
Checking consistency of file "/etc/resolv.conf" across nodes

Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined
File "/etc/resolv.conf" does not have both domain and search entries defined
Checking if domain entry in file "/etc/resolv.conf" is consistent across the nodes...
domain entry in file "/etc/resolv.conf" is consistent across nodes
Checking if search entry in file "/etc/resolv.conf" is consistent across the nodes...
search entry in file "/etc/resolv.conf" is consistent across nodes
Checking DNS response time for an unreachable node
Node Name                             Status
------------------------------------  ------------------------
raclinux2                             passed
raclinux1                             passed
The DNS response time for an unreachable node is within acceptable limit on all nodes

File "/etc/resolv.conf" is consistent across nodes

Check: Time zone consistency
Result: Time zone consistency check passed

Starting check for Huge Pages Existence ...

Check for Huge Pages Existence passed

Starting check for Hardware Clock synchronization at shutdown ...

Check for Hardware Clock synchronization at shutdown passed

Pre-check for cluster services setup was unsuccessful.
Checks did not pass for the following node(s):
raclinux1 : 10.0.2.15
[oracle@raclinux1 grid]$

October 3, 2010 Posted by | oracle | 13 Comments

Oracle RAC and Oracle ONE NODE RAC 11.2.0 and Transparent Application Failover (TAF)

Oracle RAC and Oracle ONE NODE RAC 11.2.0 and Transparent Application Failover (TAF)

In this article we will look at Transparent Application Failover (TAF) setup with RAC. The TAF concept is tested with Oracle RAC and will use it to test with Oracle ONE NODE RAC. We will setup a tnsnames.ora entry for TAF and verify the TAF failover while migrating with Omotion the instance to another node. Managing Oracle ONE NODE RAC was a subject of an earlier article. The tnanames.ora entry RUPTAF is in the ANNEX. We will run a query as shown in the ANNEX in testtaf.sql and monitor the fail over while the ONE NODE RAC instance is moved to another node of the cluster. Before and after the query execution we will check the failover_method , failover_type and failed_over from v$session. We will connect to RUP database (instance RUP_1 on raclinux2) and will use Omotion to move it to raclinux1 node.

  1. How is defined RUPTAF

RUPTAF=

  (DESCRIPTION =

  (ENABLE=BROKEN)

  (LOAD_BALANCE = OFF)

  (FAILOVER = ON)

    (ADDRESS = (PROTOCOL = TCP)(HOST = rac-scan)(PORT = 1521))

    (ADDRESS = (PROTOCOL = TCP)(HOST = raclinux1-vip)(PORT = 1521))

    (ADDRESS = (PROTOCOL = TCP)(HOST = raclinux2-vip)(PORT = 1521))

    (CONNECT_DATA =

      (SERVER = DEDICATED)

      (SERVICE_NAME = RUP)

      (FAILOVER_MODE =

         (TYPE=SELECT)

         (METHOD=BASIC)

         (BACKUP=RUP)

      )

    )

  )

2.   Setup RAC ONE NODE
 

We looked at managing Oracle ONE NODE RAC here. We will setup Oracle RAC ONE NODE database and will verify it.


[oracle@raclinux2 ~]$ raconeinit

Candidate Databases on this cluster:

 #      Database        RAC One Node    Fix Required

===     ========        ============    ============

[1]         RAC0             NO              N/A

[2]         RONE             NO              N/A

[3]          RUP             NO              N/A

Enter the database to initialize [1]: 3

Database RUP is now running on server raclinux2

Candidate servers that may be used for this DB: raclinux1 

Enter the names of additional candidate servers where this DB may run (space delimited): raclinux1

Please wait, this may take a few minutes to finish.......

Database configuration modified.

[oracle@raclinux2 ~]$

[oracle@raclinux2 ~]$ raconestatus

RAC One Node databases on this cluster:

  Database UP Fix Required        Current Server                    Candidate Server Names

  ======== == ============ ==============================  ========================================

       RUP  Y       N                           raclinux2                       raclinux2 raclinux1  

Available Free Servers: 

[oracle@raclinux2 ~]$

3.    Start a SQL statement and migrate the database with Omotion as in step 4


[oracle@raclinux2 admin]$ sqlplus system/sys1@ruptaf

SQL*Plus: Release 11.2.0.1.0 Production on Thu Sep 30 13:47:32 2010

Copyright (c) 1982, 2009, Oracle.  All rights reserved.

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production

With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,

Data Mining and Real Application Testing options

SQL> @/u03/testtaf.sql

 SID   SERIAL# FAILOVER_TYPE FAILOVER_METHOD FAILED_OVER

---- --------- ------------- --------------- -----------

  49       685 SELECT        BASIC           NO

INSTANCE_NAME

----------------

RUP_1

  COUNT(*)

----------

    623183

 SID   SERIAL# FAILOVER_TYPE FAILOVER_METHOD FAILED_OVER

---- --------- ------------- --------------- -----------

  49         2 SELECT        BASIC           YES

INSTANCE_NAME

----------------

RUP_2

  COUNT(*)

----------

    623183

SQL>

4.     Migrate with Omotion the RUP database while the SQL query in step 3 is running


[oracle@raclinux2 ~]$ Omotion -v

RAC One Node databases on this cluster:

 #      Database                    Server                      Fix Required

===     ========        ==============================          ============

[1]          RUP                             raclinux2                N

Enter number of the database to migrate [1]: 1

Specify maximum time in minutes for migration to complete (max 30) [30]:

RUP Database is administrator managed .

RUP database is running in RUP server pool.

Current Running instance: RUP_1

Current Active Server       : raclinux2

Available Target Server(s) :

 #            Server            Available

===     ==================      =========

[1]              raclinux1          Y

Enter number of the target node [1]: 1

Omotion Started...

Starting target instance on raclinux1...

Migrating sessions...

Stopping source instance on raclinux2...

Omotion Completed...

=== Current Status ===

Database RUP is running on node raclinux1

[oracle@raclinux2 ~]$

[oracle@raclinux2 ~]$ Omotion

RAC One Node databases on this cluster:

 #      Database                    Server                      Fix Required

===     ========        ==============================          ============

[1]          RUP                             raclinux1                N

Enter number of the database to migrate [1]: 1

Specify maximum time in minutes for migration to complete (max 30) [30]: 30

Available Target Server(s) :

 #            Server            Available

===     ==================      =========

[1]              raclinux2          Y

Enter number of the target node [1]: 1

Omotion Started...

Starting target instance on raclinux2...

Migrating sessions...

Stopping source instance on raclinux1...

Omotion Completed...

=== Current Status ===

Database RUP is running on node raclinux2

[oracle@raclinux2 ~]$

Summary

We configured a TAF tnsnames.ora entry and used Omotion to move the RUP database to another node of the cluster. Using the defined RUPTAF connect string we confirmed that the session fails over to the second instance started by Omotion using the defined failover attributes.

Annex

The RUPTAF tnsnames.ora entry and the test script follows.


# in tnsnames.ora

RUPTAF=

  (DESCRIPTION =

  (ENABLE=BROKEN)

  (LOAD_BALANCE = OFF)

  (FAILOVER = ON)

    (ADDRESS = (PROTOCOL = TCP)(HOST = rac-scan)(PORT = 1521))

    (ADDRESS = (PROTOCOL = TCP)(HOST = raclinux1-vip)(PORT = 1521))

    (ADDRESS = (PROTOCOL = TCP)(HOST = raclinux2-vip)(PORT = 1521))

    (CONNECT_DATA =

      (SERVER = DEDICATED)

      (SERVICE_NAME = RUP)

      (FAILOVER_MODE =

         (TYPE=SELECT)

         (METHOD=BASIC)

         (BACKUP=RUP)

      )

    )

  )

[oracle@raclinux2 admin]$ cat /u03/testtaf.sql

        col sid format 999

        col serial# format 99999999

        col failover_type format a13

        col failover_method format a15

        col failed_over format a11

        select sid, serial#, failover_type, failover_method, failed_over from v$session where username ='SYSTEM';

        select instance_name from v$instance;

        select count(*) from

        (

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source

        );

        col sid format 999

        col serial# format 99999999

        col failover_type format a13

        col failover_method format a15

        col failed_over format a11

        select sid, serial#, failover_type, failover_method, failed_over from v$session where username ='SYSTEM';

        select instance_name from v$instance;

        select count(*) from

        (

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source union

         select * from dba_source

        );

[oracle@raclinux2 admin]$

October 3, 2010 Posted by | oracle | 1 Comment

Multiple OCRs and vote disks on ASM in Oracle 11gR2

Multiple OCRs and vote disks on ASM in Oracle 11gR2

Edited: 3-August-2012

Oracle Clusterware used to provide installation option for multiple locations for the OCR and vote disks prior to 11gR2. In Oracle 11gR2 ASM disk groups are used to store the OCR and vote disks. While we can use the mirroring capabilities of ASM disk groups we still can manually add additional OCR disks in Oracle 11gR2 on ASM disk groups to provide redundancy and High Availability. Here in this post we will look at adding additional OCR disks to new ASM disks groups and moving the vote disk to a disk group with high redundancy.

Initially we have Oracle GI installed on a disk group DATA with external redundancy. We created a disk group dgdup1 high redundancy with 5 disks and a disk group dgdup2 with external redundancy.

Make sure that Oracle GI is running


[root@raclinux2 ~]# cd /u01/app/11.2.0.2/grid

[root@raclinux2 grid]# cd bin

[root@raclinux2 bin]# ./crsctl check cluster -all

**************************************************************

raclinux1:

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

**************************************************************

raclinux2:

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

**************************************************************

[root@raclinux2 bin]#

Vote disks

Let’s move the vote disk to a high redundancy group.

 


[root@raclinux2 bin]#

[root@raclinux2 bin]# ./crsctl query css votedisk

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

1. ONLINE   7b7f9d9ae9484f2cbf7e62c164aa221b (/dev/oracleasm/disks/DISK1) [DATA]

Located 1 voting disk(s).

[root@raclinux2 bin]# ./crsctl replace  votedisk +dgdup1

Successful addition of voting disk 786515d3e2cc4fa7bfc5fd0b6e87cfeb.

Successful addition of voting disk afe5c0e3da484f62bfcc36b1c0eb4aa4.

Successful addition of voting disk 1ec83edcf92b4f55bfdc9711c49e0ddd.

Successful addition of voting disk 97278bb3f36f4f84bf5965682efe87d2.

Successful addition of voting disk 46021fd53e394fb8bf0f476f1fa210dc.

Successful deletion of voting disk 7b7f9d9ae9484f2cbf7e62c164aa221b.

Successfully replaced voting disk group with +dgdup1.

CRS-4266: Voting file(s) successfully replaced

[root@raclinux2 bin]# ./crsctl query css votedisk

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

1. ONLINE   786515d3e2cc4fa7bfc5fd0b6e87cfeb (/dev/oracleasm/disks/DISK11) [DGDUP1]

2. ONLINE   afe5c0e3da484f62bfcc36b1c0eb4aa4 (/dev/oracleasm/disks/DISK12) [DGDUP1]

3. ONLINE   1ec83edcf92b4f55bfdc9711c49e0ddd (/dev/oracleasm/disks/DISK13) [DGDUP1]

4. ONLINE   97278bb3f36f4f84bf5965682efe87d2 (/dev/oracleasm/disks/DISK14) [DGDUP1]

5. ONLINE   46021fd53e394fb8bf0f476f1fa210dc (/dev/oracleasm/disks/DISK15) [DGDUP1]

Located 5 voting disk(s).

[root@raclinux2 bin]#

[root@raclinux2 bin]# ./crsctl add css votedisk +data

CRS-4671: This command is not supported for ASM diskgroups.

CRS-4000: Command Add failed, or completed with errors.

[root@raclinux2 bin]# ./crsctl add css votedisk /u03/vote_acfs.dsk

CRS-4258: Addition and deletion of voting files are not allowed because the voting files are on ASM

[root@raclinux2 bin]#

As seen from above we can move a vote disk to a high redundancy disk group dgdup1 and benefit from the High Redundancy of the group. We cannot use the ‘crsctl add css votedisk’ to add a vote disk on ASM disk group or ACFS file system.
OCR disks

While we can benefit from the redundancy that the disk group storing the OCR provides we still can manually add OCR to different disk groups.

 


[root@raclinux2 bin]# cat /etc/oracle/ocr.loc

#Device/file  getting replaced by device +dgdup2

ocrconfig_loc=+DATA

local_only=false

[root@raclinux2 bin]# ./ocrcheck

Status of Oracle Cluster Registry is as follows :

Version                  :          3

Total space (kbytes)     :     262120

Used space (kbytes)      :       3380

Available space (kbytes) :     258740

ID                       : 1332773503

Device/File Name         :      +DATA

Device/File integrity check succeeded

Device/File not configured

Device/File not configured

Device/File not configured

Device/File not configured

Cluster registry integrity check succeeded

Logical corruption check succeeded

[root@raclinux2 bin]#

[root@raclinux2 bin]# ./ocrconfig -h

Name:

ocrconfig - Configuration tool for Oracle Cluster/Local Registry.

Synopsis:

ocrconfig [option]

option:

[-local] -export

- Export OCR/OLR contents to a file

[-local] -import          - Import OCR/OLR contents from a file

[-local] -upgrade [ []]

- Upgrade OCR from previous version

-downgrade [-version ]

- Downgrade OCR to the specified version

[-local] -backuploc        - Configure OCR/OLR backup location

[-local] -showbackup [auto|manual]  - Show OCR/OLR backup information

[-local] -manualbackup              - Perform OCR/OLR backup

[-local] -restore         - Restore OCR/OLR from physical backup

-replace -replacement

- Replace a OCR device/file <filename1> with <filename2>

-add                      - Add a new OCR device/file

-delete                   - Remove a OCR device/file

-overwrite                          - Overwrite OCR configuration on disk

-repair -add | -delete | -replace -replacement

- Repair OCR configuration on the local node

-help                               - Print out this help information

Note:

* A log file will be created in

$ORACLE_HOME/log//client/ocrconfig_.log. Please ensure

you have file creation privileges in the above directory before

running this tool.

* Only -local -showbackup [manual] is supported.

* Use option '-local' to indicate that the operation is to be performed on the Oracle Local Registry.

[root@raclinux2 bin]#

[root@raclinux2 bin]#

[root@raclinux2 bin]# ./ocrconfig -add +dgdup2

[root@raclinux2 bin]# ./ocrconfig -add +dgdup1

[root@raclinux2 bin]# ./ocrcheck

Status of Oracle Cluster Registry is as follows :

Version                  :          3

Total space (kbytes)     :     262120

Used space (kbytes)      :       3380

Available space (kbytes) :     258740

ID                       : 1332773503

Device/File Name         :      +DATA

Device/File integrity check succeeded

Device/File Name         :    +dgdup2

Device/File integrity check succeeded

Device/File Name         :    +dgdup1

Device/File integrity check succeeded

Device/File not configured

Device/File not configured

Cluster registry integrity check succeeded

Logical corruption check succeeded

[root@raclinux2 bin]#

[root@raclinux2 bin]# cat /etc/oracle/ocr.loc

#Device/file  getting replaced by device +dgdup1

ocrconfig_loc=+DATA

ocrmirrorconfig_loc=+dgdup2

ocrconfig_loc3=+dgdup1

local_only=false[root@raclinux2 bin]#

Summary:

While we benefit from the redundancy a disk group provides we can add multiple OCR on a different disk groups. We can move the VOTE disk to a disk group with high redundancy.

To be precise vote disk in ASM has the following specifics.

No file in ASM spans a disk group including a vote file corresponding to the vote disks. Difference is that vote file is not mirrored and stripped like any other files (data, redo, control, OCR etc…) and has a fixed assignment to a failure group in a disk. Vote disk can be accessed even if ASM is not up whereas another file cannot be accessed if ASM is not up and running.

You cannot mix vote files on ASM and vote files on non-ASM. Instead you can dedicate either one ASM DG for all you cluster vote disk files or you can use non-ASM but never both except for initial migration to 11.2 when previous versions were on non-ASM storage.

For vote files you need a special number of failure groups in a disk groups as indicated below

  1. For External redundancy DG you need 1 failure group for one Vote disk file
  2. For Normal redundancy DG you need 3 failure groups for 3 vote disk file
  3. For High redundancy DG you need 5 failure groups for 5 vote disk files


October 3, 2010 Posted by | oracle | 16 Comments