They alone remember Him, upon whom God bestows His Grace.
Index of all the posts of Gurpartap Singh's Blog
I had a bad experience while downgrading grid infrastructure from 11.2.0.2 to 11.2.0.1
I had a 7 node cluster with multiple databases and only 2 disk groups. One data and one recv.
Data diskgroup had OCR and vote disk. When executed deinstall on last node with last node option it deletes OCR and Vote disk and past of it is to clean up the header of the disk having OCR and VOTE disk. Since headers of the disk were cleaned as the past of deinstall script with last node option, I was not able to mount DATA diskgrup and so lost all the data and had to restore all the databases. Then came to know that the best practice is to have OCR and Vote disk
in different diskgroup. Here are the steps to move or migrate OCR and vote disk to new diskgroup in 11gr2 grid infrastructure.
All the following steps can be done while all databases are online. I created a new diskgroup +OCR1 using asmca. You can create this from comandline also. It can be 1GB or 2GB lun only. This diskggroup is mounted on all the 3 nodes.
Document I used is following:
http://download.oracle.com/docs/cd/E18283_01/rac.112/e16794.pdf
Page 61,65:
Here we go:
oracle : rac1.rac.meditate.com : @crs : /u02/app/11.2.0.1/grid
$ su -
Password:
[root@rac1 ~]# /u02/app/11.2.0.1/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3200
Available space (kbytes) : 258920
ID : 174947145
Device/File Name : +DATA1
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[root@rac1 ~]#
[root@rac1 ~]# /u02/app/11.2.0.1/grid/bin/ocrconfig -add +OCR1
Logs:
2011-02-07 22:19:12.726
[crsd(7242)]CRS-1007:The OCR/OCR mirror location was replaced by +OCR1.
[root@rac1 ~]# /u02/app/11.2.0.1/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3200
Available space (kbytes) : 258920
ID : 174947145
Device/File Name : +DATA1
Device/File integrity check succeeded
Device/File Name : +OCR1
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[root@rac1 ~]#
[root@rac1 ~]# /u02/app/11.2.0.1/grid/bin/ocrconfig -delete +DATA1
2011-02-07 22:21:17.963
[crsd(7242)]CRS-1010:The OCR mirror location +DATA1 was removed.
[root@rac1 ~]# /u02/app/11.2.0.1/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3200
Available space (kbytes) : 258920
ID : 174947145
Device/File Name : +OCR1
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[root@rac1 ~]#
Logs on node 2:
2011-02-07 22:19:15.521
[crsd(6789)]CRS-1007:The OCR/OCR mirror location was replaced by +OCR1.
2011-02-07 22:21:18.611
[crsd(6789)]CRS-1010:The OCR mirror location +DATA1 was removed.
Logs on node 3:
2011-02-07 22:19:16.395
[crsd(6914)]CRS-1007:The OCR/OCR mirror location was replaced by +OCR1.
2011-02-07 22:20:09.459
[ctssd(6539)]CRS-2408:The clock on host rac3 has been updated by the Cluster Time Synchronization Service to be synchronous with the mean cluster time.
2011-02-07 22:20:25.467
[ctssd(6539)]CRS-2408:The clock on host rac3 has been updated by the Cluster Time Synchronization Service to be synchronous with the mean cluster time.
2011-02-07 22:21:18.967
[crsd(6914)]CRS-1010:The OCR mirror location +DATA1 was removed.
--------------------------------------------------
page 65:
If there were multiple OCR locations then following command cold be used:
ocrconfig -replace current_OCR_location -replacement new_OCR_location
=============================================================================
http://download.oracle.com/docs/cd/E18283_01/rac.112/e16794.pdf
Page 279:
Moving vote disk:
[root@rac1 ~]# /u02/app/11.2.0.1/grid/bin/crsctl query css votedisk
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE 44d575b60a4b4fb5bf3cf8b51d001778 (/dev/sdc) [DATA1]
Located 1 voting disk(s).
[root@rac1 ~]# /u02/app/11.2.0.1/grid/bin/crsctl replace votedisk +OCR1
Successful addition of voting disk 28657f1692a04fd3bf80dd7451fc1817.
Successful deletion of voting disk 44d575b60a4b4fb5bf3cf8b51d001778.
Successfully replaced voting disk group with +OCR1.
CRS-4266: Voting file(s) successfully replaced
In cluster alert log:
rac1:
2011-02-07 22:39:47.924
[cssd(6548)]CRS-1605:CSSD voting file is online: /dev/sdl; details in /u02/app/11.2.0.1/grid/log/rac1/cssd/ocssd.log.
2011-02-07 22:39:49.104
[cssd(6548)]CRS-1626:A Configuration change request completed successfully
2011-02-07 22:39:49.608
[cssd(6548)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 rac3 .
rac2:
2011-02-07 22:39:12.120
[ctssd(6300)]CRS-2408:The clock on host rac2 has been updated by the Cluster Time Synchronization Service to be synchronous with the mean cluster time.
2011-02-07 22:39:48.614
[cssd(6166)]CRS-1605:CSSD voting file is online: /dev/sdl; details in /u02/app/11.2.0.1/grid/log/rac2/cssd/ocssd.log.
2011-02-07 22:39:49.186
[cssd(6166)]CRS-1626:A Configuration change request completed successfully
2011-02-07 22:39:49.608
[cssd(6166)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 rac3 .
2011-02-07 22:43:04.315
[ctssd(6300)]CRS-2408:The clock on host rac2 has been updated by the Cluster Time Synchronization Service to be synchronous with the mean cluster time.
2011-02-07 22:43:20.321
[ctssd(6300)]CRS-2408:The clock on host rac2 has been updated by the Cluster Time Synchronization Service to be synchronous with the mean cluster time.
rac3:
2011-02-07 22:39:48.621
[cssd(6444)]CRS-1605:CSSD voting file is online: /dev/sdl; details in /u02/app/11.2.0.1/grid/log/rac3/cssd/ocssd.log.
2011-02-07 22:39:49.100
[cssd(6444)]CRS-1626:A Configuration change request completed successfully
2011-02-07 22:39:49.604
[cssd(6444)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 rac3 .
[root@rac1 ~]# /u02/app/11.2.0.1/grid/bin/crsctl query css votedisk
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE 28657f1692a04fd3bf80dd7451fc1817 (/dev/sdl) [OCR1]
Located 1 voting disk(s).
[root@rac1 ~]#
------------------------------------
crsctl add css votedisk
------------------------------------
File Universal Id (FUID) obtained from (crsctl query css votedisk)
crsctl delete css votedisk 28657f1692a04fd3bf80dd7451fc1817
Remembering the Lord, His devotees are famous and radiant. Remembering the Lord, the Vedas were composed. Remembering the Lord, we become Siddhas, celibates and givers. Remembering the Lord, the lowly become known in all four directions. For the remembrance of the Lord, the whole world was established. Remember, remember in meditation the Lord, the Creator, the Cause of causes. For the remembrance of the Lord, He created the whole creation. In the remembrance of the Lord, He Himself is Formless. By His Grace, He Himself bestows understanding.
No comments:
Post a Comment