Post 51 of series - Install Oracle RAC 12c on Vmware with Windows 7 64-bit as host OS and Linux CentOS or RHEL 6 as guest OS (Part 4, Setup Database Machine for RAC 12c install (rac20))

Hundreds of thousands and millions do not equal even one hair of Yours, O my Beloved. You are the King of kings; I cannot even describe Your Glorious Praises

Index of all the posts of Gurpartap Singh's Blog

Login as root and install following package:

[root@rac20 ~]# yum install scsi-target-utils -y
Loaded plugins: fastestmirror, security
Loading mirror speeds from cached hostfile
 * base: centos.mirror.freedomvoice.com
 * extras: mirrordenver.fdcservers.net
 * updates: mirror.thelinuxfix.com
base                                                                                                                                                                                              | 3.7 kB     00:00
extras                                                                                                                                                                                            | 3.4 kB     00:00
ol6_UEK_latest                                                                                                                                                                                    | 1.2 kB     00:00
ol6_latest                                                                                                                                                                                        | 1.4 kB     00:00
ol6_latest/primary                                                                                                                                                                                |  31 MB     00:36
ol6_latest                                                                                                                                                                                                   21852/21852
updates                                                                                                                                                                                           | 3.4 kB     00:00
updates/primary_db                                                                                                                                                                                | 3.8 MB     00:03
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package scsi-target-utils.x86_64 0:1.0.24-2.el6 will be updated
---> Package scsi-target-utils.x86_64 0:1.0.24-3.el6_4 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

=========================================================================================================================================================================================================================
 Package                                                  Arch                                          Version                                                  Repository                                         Size
=========================================================================================================================================================================================================================
Updating:
 scsi-target-utils                                        x86_64                                        1.0.24-3.el6_4                                           ol6_latest                                        172 k

Transaction Summary
=========================================================================================================================================================================================================================
Upgrade       1 Package(s)

Total download size: 172 k
Downloading Packages:
scsi-target-utils-1.0.24-3.el6_4.x86_64.rpm                                                                                                                                                       | 172 kB     00:00
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Updating   : scsi-target-utils-1.0.24-3.el6_4.x86_64                                                                                                                                                               1/2
  Cleanup    : scsi-target-utils-1.0.24-2.el6.x86_64                                                                                                                                                                 2/2
  Verifying  : scsi-target-utils-1.0.24-3.el6_4.x86_64                                                                                                                                                               1/2
  Verifying  : scsi-target-utils-1.0.24-2.el6.x86_64                                                                                                                                                                 2/2

Updated:
  scsi-target-utils.x86_64 0:1.0.24-3.el6_4

Complete!
[root@rac20 ~]#



Also install :

[root@rac20 ~]# yum install iscsi-initiator-utils  -y
Loaded plugins: fastestmirror, security
Loading mirror speeds from cached hostfile
 * base: centos.mirror.freedomvoice.com
 * extras: mirrordenver.fdcservers.net
 * updates: mirror.thelinuxfix.com
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package iscsi-initiator-utils.x86_64 0:6.2.0.873-2.0.2.el6 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=========================================================================================================================================================================================================================
 Package                                                    Arch                                        Version                                                    Repository                                       Size
=========================================================================================================================================================================================================================
Installing:
 iscsi-initiator-utils                                      x86_64                                      6.2.0.873-2.0.2.el6                                        ol6_latest                                      677 k

Transaction Summary
=========================================================================================================================================================================================================================
Install       1 Package(s)

Total download size: 677 k
Installed size: 2.3 M
Downloading Packages:
iscsi-initiator-utils-6.2.0.873-2.0.2.el6.x86_64.rpm                                                                                                                                              | 677 kB     00:00
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing : iscsi-initiator-utils-6.2.0.873-2.0.2.el6.x86_64                                                                                                                                                      1/1
  Verifying  : iscsi-initiator-utils-6.2.0.873-2.0.2.el6.x86_64                                                                                                                                                      1/1

Installed:
  iscsi-initiator-utils.x86_64 0:6.2.0.873-2.0.2.el6

Complete!
[root@rac20 ~]#




Execute following as root, it will configure the iscsi to pick server san1.rac.meditate.com at each start-up:

service iscsi start
iscsiadm -m discovery -t sendtargets -p san1.rac.meditate.com

Output is as:

[root@rac20 ~]# service iscsi start

[root@rac20 ~]# iscsiadm -m discovery -t sendtargets -p san1.rac.meditate.com

Starting iscsid:                                           [  OK  ]

10.10.1.116:3260,1 iqm.mgmt.volumes-san

[root@rac20 ~]#

Later if you ever want to add more servers for SAN to the configuration, you can use the same command given above. But if you want to remove some ip/name from the configuration use something like the one given below:

To disable running service:
iscsiadm --m node --portal 10.10.1.156:3260 -u

To delete the old ip:
iscsiadm -m node -o delete --portal 10.10.1.156:3260

Note - sdb to sdx are the iscsi disks and if you don't see them reboot the machine and try discovery again and you should be able to see these luns.

Execute following as root so that iscsi service starts on every reboot.

chkconfig --level 345 iscsi on

Output is as follows :

[root@rac20 ~]# chkconfig --level 345 iscsi on

[root@rac20 ~]#

Now create the following directories and chnage their ownership.

mkdir /u01 /u02 /software

chown oracle:oinstall /u01 /u02 /software

Output is as:

[root@rac20 ~]# mkdir /u01 /u02 /software

[root@rac20 ~]# chown oracle:oinstall /u01 /u02 /software

[root@rac20 ~]#

Now do the following change :

create file "/etc/resolv.conf_shld_be" and the contents should be:

[root@rac10 ~]# cat /etc/resolv.conf_shld_be

# Generated by NetworkManager

nameserver 192.168.1.117

search rac.meditate.com

[root@rac10 ~]#

edit file "/etc/rc.d/rc.local" and the following in the end on this file:

#Command to fix the permissions of the luns

service iptables stop

chown oracle:oinstall /dev/sd[b-x]

# Command to fix scan ip

rm -rf /etc/resolv.conf

cp /etc/resolv.conf_shld_be /etc/resolv.conf

Cat on this file should look like following:

[root@rac20 ~]# cat  /etc/rc.d/rc.local

#!/bin/sh

#

# This script will be executed *after* all the other init scripts.

# You can put your own initialization stuff in here if you don't

# want to do the full Sys V style init stuff.

touch /var/lock/subsys/local

#Command to fix the permissions of the luns

service iptables stop

chown oracle:oinstall /dev/sd[b-x]

# Command to fix scan ip

rm -rf /etc/resolv.conf

cp /etc/resolv.conf_shld_be /etc/resolv.conf

[root@rac20 ~]#

Now bounce the machine using command "reboot" as user root.

Now as root execute "ls -l /dev/sd*" and you should see the following luns:

[root@rac20 ~]# ls -l /dev/sd*

brw-rw---- 1 root   disk      8,   0 Jul 18 15:20 /dev/sda

brw-rw---- 1 root   disk      8,   1 Jul 18 15:20 /dev/sda1

brw-rw---- 1 root   disk      8,   2 Jul 18 15:20 /dev/sda2

brw-rw---- 1 oracle oinstall  8,  16 Jul 18 15:21 /dev/sdb

brw-rw---- 1 oracle oinstall  8,  32 Jul 18 15:21 /dev/sdc

brw-rw---- 1 oracle oinstall  8,  48 Jul 18 15:21 /dev/sdd

brw-rw---- 1 oracle oinstall  8,  64 Jul 18 15:21 /dev/sde

brw-rw---- 1 oracle oinstall  8,  80 Jul 18 15:21 /dev/sdf

brw-rw---- 1 oracle oinstall  8,  96 Jul 18 15:21 /dev/sdg

brw-rw---- 1 oracle oinstall  8, 112 Jul 18 15:21 /dev/sdh

brw-rw---- 1 oracle oinstall  8, 128 Jul 18 15:21 /dev/sdi

brw-rw---- 1 oracle oinstall  8, 144 Jul 18 15:21 /dev/sdj

brw-rw---- 1 oracle oinstall  8, 160 Jul 18 15:21 /dev/sdk

brw-rw---- 1 oracle oinstall  8, 176 Jul 18 15:21 /dev/sdl

brw-rw---- 1 oracle oinstall  8, 192 Jul 18 15:21 /dev/sdm

brw-rw---- 1 oracle oinstall  8, 208 Jul 18 15:21 /dev/sdn

brw-rw---- 1 oracle oinstall  8, 224 Jul 18 15:21 /dev/sdo

brw-rw---- 1 oracle oinstall  8, 240 Jul 18 15:21 /dev/sdp

brw-rw---- 1 oracle oinstall 65,   0 Jul 18 15:21 /dev/sdq

brw-rw---- 1 oracle oinstall 65,  16 Jul 18 15:21 /dev/sdr

brw-rw---- 1 oracle oinstall 65,  32 Jul 18 15:21 /dev/sds

brw-rw---- 1 oracle oinstall 65,  48 Jul 18 15:21 /dev/sdt

brw-rw---- 1 oracle oinstall 65,  64 Jul 18 15:21 /dev/sdu

brw-rw---- 1 oracle oinstall 65,  80 Jul 18 15:21 /dev/sdv

brw-rw---- 1 oracle oinstall 65,  96 Jul 18 15:21 /dev/sdw

brw-rw---- 1 oracle oinstall 65, 112 Jul 18 15:21 /dev/sdx

brw-rw---- 1 root   disk     65, 128 Jul 18 15:21 /dev/sdy

[root@rac20 ~]#

Lets create ASM disks as:

Create a new file:

"/etc/scsi_id.config"

and here should be its contents:

options=-g

So cat on the file looks like:

[root@rac20 ~]# cat /etc/scsi_id.config

options=-g

[root@rac20 ~]#

Now execute hte following commands as root and geet their names.

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdb

1IET_00010001

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdc

1IET_00010002

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdd

1IET_00010003

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sde

1IET_00010004

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdf

1IET_00010005

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdg

1IET_00010006

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdh

1IET_00010007

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdi

1IET_00010008

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdj

1IET_00010009

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdk

1IET_0001000a

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdl

1IET_0001000b

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdm

1IET_0001000c

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdn

1IET_0001000d

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdo

1IET_0001000e

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdp

1IET_0001000f

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdq

1IET_00010010

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdr

1IET_00010011

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sds

1IET_00010012

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdt

1IET_00010013

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdu

1IET_00010014

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdv

1IET_00010015

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdw

1IET_00010016

[root@rac20 ~]# /sbin/scsi_id -g -u -d /dev/sdx

1IET_00010017

[root@rac20 ~]#

Using these values, edit the "/etc/udev/rules.d/99-oracle-asmdevices.rules" file adding the following entries. All parameters for a single entry must be on the same line.

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010001", NAME="asm-grid-disk1", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010002", NAME="asm-grid-disk2", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010003", NAME="asm-grid-disk3", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010004", NAME="asm-grid-disk4", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010005", NAME="asm-grid-disk5", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010006", NAME="asm-grid-disk6", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010007", NAME="asm-grid-disk7", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010008", NAME="asm-grid-disk8", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010009", NAME="asm-grid-disk9", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000a", NAME="asm-grid-disk10", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000b", NAME="asm-grid-disk11", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000c", NAME="asm-grid-disk12", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000d", NAME="asm-grid-disk13", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000e", NAME="asm-grid-disk14", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000f", NAME="asm-grid-disk15", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010010", NAME="asm-grid-disk16", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010011", NAME="asm-grid-disk17", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010012", NAME="asm-grid-disk18", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010013", NAME="asm-grid-disk19", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010014", NAME="asm-grid-disk20", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010015", NAME="asm-grid-disk21", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010016", NAME="asm-grid-disk22", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010017", NAME="asm-grid-disk23", OWNER="oracle", GROUP="oinstall", MODE="0660"

Here is the cat on this file:

cat /etc/udev/rules.d/99-oracle-asmdevices.rules

[root@rac20 ~]# cat /etc/udev/rules.d/99-oracle-asmdevices.rules

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010001", NAME="asm-grid-disk1", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010002", NAME="asm-grid-disk2", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010003", NAME="asm-grid-disk3", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010004", NAME="asm-grid-disk4", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010005", NAME="asm-grid-disk5", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010006", NAME="asm-grid-disk6", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010007", NAME="asm-grid-disk7", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010008", NAME="asm-grid-disk8", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010009", NAME="asm-grid-disk9", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000a", NAME="asm-grid-disk10", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000b", NAME="asm-grid-disk11", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000c", NAME="asm-grid-disk12", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000d", NAME="asm-grid-disk13", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000e", NAME="asm-grid-disk14", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_0001000f", NAME="asm-grid-disk15", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010010", NAME="asm-grid-disk16", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010011", NAME="asm-grid-disk17", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010012", NAME="asm-grid-disk18", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010013", NAME="asm-grid-disk19", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010014", NAME="asm-grid-disk20", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010015", NAME="asm-grid-disk21", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010016", NAME="asm-grid-disk22", OWNER="oracle", GROUP="oinstall", MODE="0660"

KERNEL=="sd?1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent", RESULT=="1IET_00010017", NAME="asm-grid-disk23", OWNER="oracle", GROUP="oinstall", MODE="0660"

[root@rac20 ~]#

Now lets format these disks as follows:

[root@rac20 ~]# fdisk /dev/sdb

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel with disk identifier 0xbd32b267.

Changes will remain in memory only, until you decide to write them.

After that, of course, the previous content won't be recoverable.

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

WARNING: DOS-compatible mode is deprecated. It's strongly recommended to

         switch off the mode (command 'c') and change display units to

         sectors (command 'u').

Command (m for help): n

Command action

   e   extended

   p   primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-1009, default 1):

Using default value 1

Last cylinder, +cylinders or +size{K,M,G} (1-1009, default 1009):

Using default value 1009

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.

[root@rac20 ~]# fdisk /dev/sdc

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel with disk identifier 0x42c932cb.

Changes will remain in memory only, until you decide to write them.

After that, of course, the previous content won't be recoverable.

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

WARNING: DOS-compatible mode is deprecated. It's strongly recommended to

         switch off the mode (command 'c') and change display units to

         sectors (command 'u').

Command (m for help): n

Command action

   e   extended

   p   primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-1009, default 1):

Using default value 1

Last cylinder, +cylinders or +size{K,M,G} (1-1009, default 1009):

Using default value 1009

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.

[root@rac20 ~]#

In the same way fomat all these disks.

/dev/sd[d-x]

Options are:

n,p,1,enter,enter,w

Once done execute following as root:

/sbin/udevadm control --reload-rules

/sbin/start_udev

and then execute the following command as root and you should see all the ASM disks:

ls -al /dev/asm*

The disks should now be visible and have the correct ownership using the following command. If they are not visible, your UDEV configuration is incorrect and must be fixed before you proceed.

[root@rac20 ~]# ls -al /dev/asm*

brw-rw---- 1 oracle oinstall  8,  17 Jul 18 17:50 /dev/asm-grid-disk1

brw-rw---- 1 oracle oinstall  8, 161 Jul 18 17:53 /dev/asm-grid-disk10

brw-rw---- 1 oracle oinstall  8, 177 Jul 18 17:53 /dev/asm-grid-disk11

brw-rw---- 1 oracle oinstall  8, 193 Jul 18 17:53 /dev/asm-grid-disk12

brw-rw---- 1 oracle oinstall  8, 209 Jul 18 17:54 /dev/asm-grid-disk13

brw-rw---- 1 oracle oinstall  8, 225 Jul 18 17:54 /dev/asm-grid-disk14

brw-rw---- 1 oracle oinstall  8, 241 Jul 18 17:54 /dev/asm-grid-disk15

brw-rw---- 1 oracle oinstall 65,   1 Jul 18 17:55 /dev/asm-grid-disk16

brw-rw---- 1 oracle oinstall 65,  17 Jul 18 17:55 /dev/asm-grid-disk17

brw-rw---- 1 oracle oinstall 65,  33 Jul 18 17:55 /dev/asm-grid-disk18

brw-rw---- 1 oracle oinstall 65,  49 Jul 18 17:55 /dev/asm-grid-disk19

brw-rw---- 1 oracle oinstall  8,  33 Jul 18 17:50 /dev/asm-grid-disk2

brw-rw---- 1 oracle oinstall 65,  65 Jul 18 17:55 /dev/asm-grid-disk20

brw-rw---- 1 oracle oinstall 65,  81 Jul 18 17:56 /dev/asm-grid-disk21

brw-rw---- 1 oracle oinstall 65,  97 Jul 18 17:56 /dev/asm-grid-disk22

brw-rw---- 1 oracle oinstall 65, 113 Jul 18 17:56 /dev/asm-grid-disk23

brw-rw---- 1 oracle oinstall  8,  49 Jul 18 17:52 /dev/asm-grid-disk3

brw-rw---- 1 oracle oinstall  8,  65 Jul 18 17:52 /dev/asm-grid-disk4

brw-rw---- 1 oracle oinstall  8,  81 Jul 18 17:52 /dev/asm-grid-disk5

brw-rw---- 1 oracle oinstall  8,  97 Jul 18 17:52 /dev/asm-grid-disk6

brw-rw---- 1 oracle oinstall  8, 113 Jul 18 17:52 /dev/asm-grid-disk7

brw-rw---- 1 oracle oinstall  8, 129 Jul 18 17:53 /dev/asm-grid-disk8

brw-rw---- 1 oracle oinstall  8, 145 Jul 18 17:53 /dev/asm-grid-disk9

[root@rac20 ~]#

The shared disks are now configured for the grid infrastructure.

Now reboot the machine and check the disks look good by executing the following command:

ls -al /dev/asm*

Now shutdown the machine using command "shutdown -h now".

Now on console edit the machine configuration and allocate 1536 MB to this machine instead of 2GB as for RAC install I was able to install grid infrastructure and rac software with only 1.5GB

and take its backup copy and name it "rac20_ready"

Then create 3 more copies as and name then "rac21", "rac22" and "rac23"

On all the machines in thier configuration file like we did earlier update entry 

Change following:

scsi0:0.fileName = "C:\VM\rac_12c\rac20\bbm.vmdk"

to

scsi0:0.fileName = "C:\VM\rac_12c\rac21\bbm.vmdk"

to

scsi0:0.fileName = "C:\VM\rac_12c\rac22\bbm.vmdk"

to

scsi0:0.fileName = "C:\VM\rac_12c\rac23\bbm.vmdk"

respectively

rm -f /etc/udev/rules.d/70-persistent-net.rules

vi /etc/sysconfig/network

and update the hostname from rac20.rac.meditate.com to rac21.rac.meditate.com, rac22.rac.meditate.com, rac23.rac.meditate.com respectively 

vi /etc/sysconfig/network-scripts/ifcfg-eth0

update ip here in all the machines

vi /etc/sysconfig/network-scripts/ifcfg-eth1

update ip here in all the machines

vi /etc/sysconfig/network-scripts/ifcfg-eth2

update ip here in all the machines

vi /etc/sysconfig/network-scripts/ifcfg-eth3

update ip here in all the machines

vi /etc/resolv.conf_shld_be

update ip to hostmachine's ip respectively e.g. 192.168.1.117/118/119/120 on all the machines

Now copy the oracle software using WinSCP as user oracle to rac20 machine under /software

Now login to rac20 as oracle and 

cd to where you copied the software and unzip it. 

 cd /software/12c_database_and_grid_infrastructure

 unzip V38500-01_1of2.zip

 unzip V38500-01_2of2.zip

 unzip V38501-01_1of2.zip

 unzip V38501-01_2of2.zip

 after this ls -lart looks like :

 [oracle@rac20 12c_database_and_grid_infrastructure]$ ls -lart

 total 4325924

 drwxr-xr-x 7 oracle oinstall       4096 Jun 10 05:14 database

 drwxr-xr-x 7 oracle oinstall       4096 Jun 10 05:15 grid

 -rw-r--r-- 1 oracle oinstall  201673595 Jun 25 22:43 V38501-01_2of2.zip

 -rw-r--r-- 1 oracle oinstall 1116527103 Jun 25 23:17 V38500-01_2of2.zip

 -rw-r--r-- 1 oracle oinstall 1361028723 Jun 25 23:22 V38500-01_1of2.zip

 -rw-r--r-- 1 oracle oinstall 1750478910 Jun 25 23:35 V38501-01_1of2.zip

 drwxr-xr-x 3 oracle oinstall       4096 Jul 18 23:48 ..

 drwxr-xr-x 4 oracle oinstall       4096 Jul 19 00:00 .

 [oracle@rac20 12c_database_and_grid_infrastructure]$

Now to save space remove the zip files by executing:

rm V38501-01_2of2.zip V38500-01_2of2.zip V38500-01_1of2.zip V38501-01_1of2.zip

Finally it looks like following:

[oracle@rac20 12c_database_and_grid_infrastructure]$ ls -lart

total 16

drwxr-xr-x 7 oracle oinstall 4096 Jun 10 05:14 database

drwxr-xr-x 7 oracle oinstall 4096 Jun 10 05:15 grid

drwxr-xr-x 3 oracle oinstall 4096 Jul 18 23:48 ..

drwxr-xr-x 4 oracle oinstall 4096 Jul 19 00:05 .

[oracle@rac20 12c_database_and_grid_infrastructure]$

Now "shutdown -h now" all the machines if you want and have space take backup of "rac20","rac21","rac22","rac23"

Let my feet walk on Your Path, and let my eyes behold the Blessed Vision of Your Darshan. With my ears, I will listen to Your Sermon, if the Guru becomes merciful to me.