Guenadi N Jilevski's Oracle BLOG

Oracle RAC, DG, EBS, DR and HA DBA BLOG

Build two node Oracle RAC 11gR2 11.2.0.3 with GNS (DNS, DHCP) and HAIP

Build two node Oracle RAC 11gR2 11.2.0.3 with GNS (DNS, DHCP) and HAIP

Revision 1.0 : 19th April 2012 : DISABLE SELINUX in order to successfully create ASM disks using ASMlib: See Annex 1

In the article you will have a look at how to use some Oracle VirtualBox features to build two node Oracle 11gR2 (11.2.0.3) RAC system on Oracle Enterprise Linux (OEL 6.1). The setup will implement a role separation with different users for Oracle RDBMS and Oracle GI that is, user oracle and grid respectively in order to split the responsibilities between DBAs and storage administrators. The article will show you how to configure DHCP and a sample DNS setup for GNS deployment. You will have a glimpse at deploying HAIP feature allowing up to four private interconnect interfaces.

An overview to Oracle Virtualization solutions can be seen here. You can see how to use Oracle VM VirtualBox to build a two node Solaris cluster here. For information related to building a RAC 11gR2 cluster on OEL without GNS click here.

In the article you will see how to configure Linux in an Oracle VM VirtualBox Virtual machines, install Oracle GI, Oracle RDBMS and will create a policy managed database and service.

The following software will be used:

  1. Oracle 11gR2 (11.2.0.3) for Linux (x86-64). Patch 10404530. Download from MOS here.
  2. Oracle Enterprise Linux OEL 6.1(x86-64). Download from here.
  3. Oracle VM VirtualBox 4.1.2. Download from here.

Three virtual machines will be created and used.

  1. OEL61A for RAC node oel61a
  2. OEL61B for RAC node oel61b
  3. OEL61 for DNS and DHCP server

Ideally a DNS server should be on a dedicated physical server not a part of the cluster. Due to limited resources in this article DNS server will be configured to meet the prerequisites for GI and RDBMS installation for later node addition.

Two virtual machines, OEL61A and OEL61B, will be configured for RAC nodes each with:

  • 4GB RAM
  • 300GB bootable disk (Disk space will be dynamically allocated not a fixed size pre-allocation)
  • NIC – bridged for public interface in RAC with address 192.168.2.21/22 (first IP 192.168.2.21 on oel61a and second IP 192.168.2.22 on node oel61b). These are public interface in RAC.
  • NIC – bridged for private interface in RAC with address 10.10.2.21/22 (first IP 10.10.2.21 on oel61a and second IP 10.10.2.22 on node oel61b). These are private interface in RAC.
  • NIC – bridged for private interface in RAC with address 10.10.5.21/22 (first IP 10.10.5.21 on oel61a and second IP 10.10.5.22 on node oel61b). These are private interface in RAC.
  • NIC – bridged for private interface in RAC with address 10.10.10.21/22 (first IP 10.10.10.21 on oel61a and second IP 10.10.10.22 on node oel61b). These are private interface in RAC.
  • 5 10GB attached shared disks for the ASM storage. (Normal Redundancy ASM disk groups will be deployed).

Virtual machine OEL61 will be configured as follows (I will use it for add node later on):

  • 4GB RAM
  • 300GB bootable disk (Disk space will be dynamically allocated not a fixed size pre-allocation)
  • NIC – bridged for public interface in RAC with address 192.168.2.11
  • NIC – bridged for private interface in RAC with address 10.10.2.11
  • NIC – bridged for private interface in RAC with address 10.10.5.11
  • NIC – bridged for private interface in RAC with address 10.10.10.11

The interfaces’ IP addresses will be as show in the table 1 below.

OEL61 – DNS server and for later add node process. OEL61A RAC node oel61a OEL61B RAC node oel61a
eth0 10.10.2.11 10.10.2.21 10.10.2.22
eth1 192.168.2.11 192.168.2.21 192.168.2.22
eth2 10.10.10.11 10.10.10.21 10.10.10.22
eth3 10.10.5.11 10.10.5.21 10.10.5.22

The following MOS notes were used:

  1. 11gR2 Grid Infrastructure Redundant Interconnect and ora.cluster_interconnect.haip [ID 1210883.1]
  1. DNS and DHCP Setup Example for Grid Infrastructure GNS [ID 946452.1]

The article will cover the following topics

  1. Create an OEL61A VM with OEL 6.1 as guest OS for node oel61a.
  2. Configure the OEL61A VM to meet the prerequisites for GI and RAC 11.2.0.3 deployment.
  3. Clone OEL61A to OEL61B.
  4. Clone OEL61A to OEL61.
  5. Set up DNS and DHCP server on OEL61.
  6. Install GI 11.2.0.3 on oel61a and oel61b.
  7. Install RAC RDBMS 11.2.0.3 on oel61a and oel61b.
  8. Create a policy managed database RACDB oel61a and oel61b.
  9. Verify database creation and create a service.

To continue reading download the article from here or read from here.

October 5, 2011 - Posted by | oracle

31 Comments »

  1. […] the article I will reuse the OEL61 VM created here to install OEM 12c and will outline the steps to follow if you start from a new OEL 6.1 […]

    Pingback by Install Oracle Enterprise Manager (OEM) Cloud Control 12c on OEL 6.1 « Guenadi N Jilevski's Oracle BLOG | October 9, 2011 | Reply

  2. Hello Webmaster, I noticed that https://gjilevski.wordpress.com/2011/10/05/build-two-node-oracle-rac-11gr2-11-2-0-3-with-gns-dns-dhcp-and-haip/ is ranking pretty low for some keywords, this may be due to the new Google Panda update, or it could be due to a variety of other factors. I’m sure you already know about On-page SEO, where Google cares highly about proper formatting of various H1/H2/H3 tags, having your main keyword appear in the beginning of your post and having your post end with the keyword, along with having keyword related alt tags and very relevant LSI. However, you do not seem to have the proper Keywords or relevant Keywords in your posts and in the website. Right now you need a tool or plugin that will allow you to check on Keyword insights, search trends and check for backlink analysis and to find out your Keyword competition. To find a Keyword Plugin that combines both Keyword Research and has the ability as a Rank Checker is what WordPress Seo Keyword, please check out our 5 minute video.

    Comment by Charlott Schnure | October 15, 2011 | Reply

  3. I love your Blog, it’s nice when you can tell somebody actuallly puts effort into a blog, and gives the blogs value.

    Comment by Cancer Institute | October 17, 2011 | Reply

  4. Pretty nice post. I just stumbled upon your weblog and wished to say that I’ve really enjoyed browsing your blog posts. After all I will be subscribing to your rss feed and I hope you write again very soon!

    Comment by Bodybuilding.com Coupon Code | October 21, 2011 | Reply

  5. I love your blog, you should add an RSS feed feature so I can get automatic notifications of new blogs. If you set one up please email me! i will bookmark you for now. Again Excellent Blog!

    Comment by Current Coupon Codes | October 21, 2011 | Reply

  6. I love your blog, you should add an RSS feed feature so I can get automatic notifications of new blogs. If you set one up please email me! i will bookmark you for now. Again Excellent Blog!

    Comment by Diet To Go Coupon Code | October 23, 2011 | Reply

  7. […] are two ways for sub-domain delegation implementation. For examples click here and here. In the article both methods were tested. The DNS IP is 192.168.2.11 and GNS VIP is […]

    Pingback by Oracle GNS and converting Grid Infrastructure from static DNS SCAN/VIP to dynamic GNS provided SCAN/VIP « Guenadi N Jilevski's Oracle BLOG | November 11, 2011 | Reply

  8. Great goods from you, man. Build two node Oracle RAC 11gR2 11.2.0.3 with GNS (DNS, DHCP) and HAIP Guenadi N Jilevski's Oracle BLOG I’ve understand your stuff previous to and you’re just too fantastic. I really like what you’ve acquired here, certainly like what you’re stating and the way in which you say it. You make it entertaining and you still care for to keep it smart. I can’t wait to read far more from you. This is really a great Build two node Oracle RAC 11gR2 11.2.0.3 with GNS (DNS, DHCP) and HAIP Guenadi N Jilevski's Oracle BLOG informations.

    Comment by Android Apps | November 29, 2011 | Reply

  9. Fantastic goods from you, man. Build two node Oracle RAC 11gR2 11.2.0.3 with GNS (DNS, DHCP) and HAIP Guenadi N Jilevski's Oracle BLOG I have understand your stuff previous to and you’re just too fantastic. I actually like what you’ve acquired here, certainly like what you are saying and the way in which you say it. You make it enjoyable and you still care for to keep it sensible. I cant wait to read much more from you. This is actually a wonderful Build two node Oracle RAC 11gR2 11.2.0.3 with GNS (DNS, DHCP) and HAIP Guenadi N Jilevski's Oracle BLOG informations.

    Comment by LA Weight Loss | December 1, 2011 | Reply

  10. Ok, configured the three nodes and all is well…err I thought. The DHCP/DNS network ip was visible internally. You see a problem in change the mask to a different series as long as I am consistent throughout all the arpas? All the eth-x conn will have to be modified as well. This way I will notconflict while using it @work…thoughts???

    Comment by Kevin | March 14, 2012 | Reply

    • Hi,

      I do not see a reason why you could not change the netmask. All you need to do is change it consistently in all places that you use for reference such as:

      1. /etc/dhcp.conf
      2. ethX configuration

      Regards,

      Comment by gjilevski | March 14, 2012 | Reply

    • Hi,

      Pay attention and adhere to the concept of GNS and adjust the setup to you environment.

      1. Subdomain delagated to the cluster
      2. GNS VIP in DNS
      3. IP forwarding to the subdomain
      4. Public nodes in DNS

      Make sure that GI and RDBMS prerequistes are met. Install GI.

      Verify that GI is installed properly and GNS name resolution works and names, SCAN name and VIP names are resolved and cluvfy succedded successfly.

      Regards,

      Comment by gjilevski | March 14, 2012 | Reply

  11. Thanks for your response. Frankly, I was little surprised there was an issue at all given the initial config on the first box cloned was ‘closed’. I did try to ‘open’ it up b/c I had some installs
    that would have been easier if I could connect to the yum repos. Although this didn’t seem to work, I must have left the server open somewhere. I will check the /etc/dhcp.conf (thx). I may have a few questions on your last post but I will try to forge ahead but as far as I can tell. If
    I change the 198.xx.xx.xx. to another mask as long as I am consistent, I should be ok. I believe
    the key to this issue is the dhcp.conf…I will have to look when unconnected. G…this is great
    stuff I have learned alot…

    Comment by Kevin | March 14, 2012 | Reply

    • Hi,

      For IPs you should make sure that you have

      1. Same subnet for public nodes and DHCP assigned on all nodes (VIP, SCAN) and GNS VIP.
      2. Same subnet for each interconnect. If more than one interconnect is used than same subnet for each set accross all nodes for for the interconnect.

      Regards,

      Comment by gjilevski | March 14, 2012 | Reply

  12. You are correct. I added
    options timeout:2
    to /etc/resolv.conf

    Comment by Patrick R | April 2, 2012 | Reply

    • Hi,

      Awesome!
      In my case if a name was registered in DNS response time was good. Only entries not registered in DNS used to timeout.

      Regards,

      Comment by gjilevski | April 2, 2012 | Reply

  13. I have this setup up and running ok.

    I would like to be able to access this database from a different computer in the house via my main house router. Any ideas?

    Comment by Patrick R | April 2, 2012 | Reply

    • Hi,

      Look at Vbox networking for a general understanding of the configurations required.

      1. http://www.virtualbox.org/manual/ch06.html
      2. https://gjilevski.wordpress.com/2011/05/12/virtualization-using-oracle-linux-6-oel6-in-oracle-virtualbox/

      Regards,

      Comment by gjilevski | April 2, 2012 | Reply

      • Maybe I should phrase it differently. For the example setup you presented, is the192.168.2.x a subnet for a router in your network?

        Comment by Patrick R | April 2, 2012

      • Hi,

        Yes 192.168.2.X is a router subnet on the host computer running Vbox. See that 192.168.2.1 is the IP addres of the router on the host OS (Windows)

        C:\Users\User>ipconfig /all

        Windows IP Configuration

        Host Name . . . . . . . . . . . . : userpc
        Primary Dns Suffix . . . . . . . : gj.com
        Node Type . . . . . . . . . . . . : Hybrid
        IP Routing Enabled. . . . . . . . : No
        WINS Proxy Enabled. . . . . . . . : No
        DNS Suffix Search List. . . . . . : gj.com

        Ethernet adapter Local Area Connection 3:

        Connection-specific DNS Suffix . :
        Description . . . . . . . . . . . : Realtek PCIe GBE Family Controller
        Physical Address. . . . . . . . . : 00-24-1D-1F-51-FE
        DHCP Enabled. . . . . . . . . . . : Yes
        Autoconfiguration Enabled . . . . : Yes
        IPv4 Address. . . . . . . . . . . : 192.168.2.103(Preferred)
        Subnet Mask . . . . . . . . . . . : 255.255.255.0
        Lease Obtained. . . . . . . . . . : Monday, April 02, 2012 1:38:57 PM
        Lease Expires . . . . . . . . . . : Wednesday, March 26, 2042 1:38:56 PM
        Default Gateway . . . . . . . . . : 192.168.2.1
        DHCP Server . . . . . . . . . . . : 192.168.2.1
        DNS Servers . . . . . . . . . . . : 192.168.2.1
        NetBIOS over Tcpip. . . . . . . . : Enabled

        Ethernet adapter Local Area Connection 7:

        Connection-specific DNS Suffix . :
        Description . . . . . . . . . . . : Microsoft Loopback Adapter
        Physical Address. . . . . . . . . : 02-00-4C-4F-4F-50
        DHCP Enabled. . . . . . . . . . . : No
        Autoconfiguration Enabled . . . . : Yes
        Autoconfiguration IPv4 Address. . : 169.254.6.65(Preferred)
        Subnet Mask . . . . . . . . . . . : 255.255.0.0
        Default Gateway . . . . . . . . . :
        DNS Servers . . . . . . . . . . . : 169.254.6.1
        NetBIOS over Tcpip. . . . . . . . : Enabled

        Ethernet adapter Local Area Connection 6:

        Connection-specific DNS Suffix . :
        Description . . . . . . . . . . . : Realtek RTL8139/810x Family Fast Ethernet
        NIC #4
        Physical Address. . . . . . . . . : 00-1F-1F-0D-DD-83
        DHCP Enabled. . . . . . . . . . . : No
        Autoconfiguration Enabled . . . . : Yes
        IPv4 Address. . . . . . . . . . . : 196.168.1.5(Preferred)
        Subnet Mask . . . . . . . . . . . : 255.255.255.0
        Default Gateway . . . . . . . . . :
        NetBIOS over Tcpip. . . . . . . . : Enabled

        Ethernet adapter Local Area Connection 4:

        Connection-specific DNS Suffix . :
        Description . . . . . . . . . . . : Generic Marvell Yukon Chipset based Ether
        net Controller
        Physical Address. . . . . . . . . : 00-00-5A-11-05-31
        DHCP Enabled. . . . . . . . . . . : No
        Autoconfiguration Enabled . . . . : Yes
        IPv4 Address. . . . . . . . . . . : 192.168.1.3(Preferred)
        Subnet Mask . . . . . . . . . . . : 255.255.255.0
        Default Gateway . . . . . . . . . :
        NetBIOS over Tcpip. . . . . . . . : Enabled

        Ethernet adapter VMware Network Adapter VMnet1:

        Connection-specific DNS Suffix . :
        Description . . . . . . . . . . . : VMware Virtual Ethernet Adapter for VMnet
        1
        Physical Address. . . . . . . . . : 00-50-56-C0-00-01
        DHCP Enabled. . . . . . . . . . . : No
        Autoconfiguration Enabled . . . . : Yes
        IPv4 Address. . . . . . . . . . . : 192.168.154.1(Preferred)
        Subnet Mask . . . . . . . . . . . : 255.255.255.0
        Default Gateway . . . . . . . . . :
        NetBIOS over Tcpip. . . . . . . . : Enabled

        Ethernet adapter VMware Network Adapter VMnet8:

        Connection-specific DNS Suffix . :
        Description . . . . . . . . . . . : VMware Virtual Ethernet Adapter for VMnet
        8
        Physical Address. . . . . . . . . : 00-50-56-C0-00-08
        DHCP Enabled. . . . . . . . . . . : No
        Autoconfiguration Enabled . . . . : Yes
        IPv4 Address. . . . . . . . . . . : 192.168.204.1(Preferred)
        Subnet Mask . . . . . . . . . . . : 255.255.255.0
        Default Gateway . . . . . . . . . :
        NetBIOS over Tcpip. . . . . . . . : Enabled

        Ethernet adapter VirtualBox Host-Only Network:

        Connection-specific DNS Suffix . :
        Description . . . . . . . . . . . : VirtualBox Host-Only Ethernet Adapter
        Physical Address. . . . . . . . . : 08-00-27-00-20-71
        DHCP Enabled. . . . . . . . . . . : No
        Autoconfiguration Enabled . . . . : Yes
        IPv4 Address. . . . . . . . . . . : 192.168.56.1(Preferred)
        Subnet Mask . . . . . . . . . . . : 255.255.255.0
        Default Gateway . . . . . . . . . :
        NetBIOS over Tcpip. . . . . . . . : Enabled

        C:\Users\User>

        For any computer on your network to access a DB in Vbox you need to look at either NAT or a bridged connection.

        Regards,

        Comment by gjilevski | April 2, 2012

  14. Cool post. Hopin’ for more. 🙂

    Comment by Aurelia Sansburn | April 24, 2012 | Reply

  15. Wow, superb blog layout! How long have you been blogging for? you made blogging look easy. The overall look of your web site is great, let alone the content!. Thanks For Your article about Build two node Oracle RAC 11gR2 11.2.0.3 with GNS (DNS, DHCP) and HAIP Guenadi N Jilevski's Oracle BLOG .

    Comment by motivational quotes | April 24, 2012 | Reply

  16. Hello…Thank You . It helped me a lot to install 11gR2 Rac database sucessfully

    Comment by Aravind | July 18, 2012 | Reply

  17. Its very nice blog……… keep moving a head. i have question regarding the domain name ( gi.com) I am trying to setup my Rac at home …….. how can I do to resolve dot com domain name I don’t have one.

    Comment by rajab | August 21, 2012 | Reply

    • Hi,

      Assuming that you need a domain for non-commercial testing purposes you can create your own provided is on an internal network, otherwise check with your ISP or Google for domain registration.

      Regards,

      Comment by gjilevski | August 22, 2012 | Reply

  18. Its very nice blog

    Comment by sukanya | March 26, 2013 | Reply

  19. […] information how to build a two node Oracle RAC 11gR2 11.2.0.3 with GNS (DNS, DHCP) and HAIP look here. For information how to upgrade Oracle RAC cluster 11.2.0.3 on OEL 6.1 to Oracle RAC cluster 12c on […]

    Pingback by Build two node Oracle RAC 12c (12.1.0.1) cluster on OEL 6.5 using Oracle VM Virtual Box « Guenadi N Jilevski's Oracle BLOG | May 26, 2014 | Reply

  20. […] information how to build a two node Oracle RAC 11gR2 11.2.0.3 with GNS (DNS, DHCP) and HAIP look here. For information how to upgrade Oracle RAC cluster 11.2.0.3 on OEL 6.1 to Oracle RAC cluster 12c on […]

    Pingback by Build two node Oracle RAC 12c (12.1.0.1) cluster on OEL 6.5 using Oracle VM Virtual Box – Download « Guenadi N Jilevski's Oracle BLOG | May 26, 2014 | Reply

  21. Hi are using WordPress for your site platform?
    I’m new to the blog world but I’m trying to get started and create my
    own. Do you require any coding knowledge to make your
    own blog? Any help would be really appreciated!

    Comment by Raquel | September 23, 2014 | Reply

    • Hi,

      I am using wordpress.com and it does not require any coding knowledge.

      Best Regards,

      Comment by gjilevski | September 23, 2014 | Reply

  22. są skłonne opowiedzieć suma próśb ślubnych, sumarycznie z miłosnymi, jeśli przypuszczają iż wybranie się na nie sprowadzi im wiadomą
    zaleta. Istnieją bardziej nieczułe także skoro
    właściwie zatem mogę zapuszkować – bezwyjątkowe. W 4 casusach
    na 5 rubasznie nabywce zatrzymaniem pełnomocnictw do
    zarobionego dobrobytu.

    Comment by ąśźżęłą | March 25, 2015 | Reply


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: