ocr_vote disk损坏恢复

时间：2021-07-10 00:19:41

1. 检查votedisk和 ocr备份
[root@rh6rac1 bin]./ocrconfig -showbackup
rh6rac1     2019/03/19 16:57:40     /oracle/grid/cdata/rh6rac-cluster/backup00.ocr

rh6rac1     2019/03/19 12:57:40     /oracle/grid/cdata/rh6rac-cluster/backup01.ocr

rh6rac1     2019/03/19 08:57:40     /oracle/grid/cdata/rh6rac-cluster/backup02.ocr

rh6rac1     2019/03/18 00:57:38     /oracle/grid/cdata/rh6rac-cluster/day.ocr

rh6rac2     2019/03/13 04:13:03     /oracle/grid/cdata/rh6rac-cluster/week.ocr

[root@rh6rac1 bin]# ./crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   4621da78f6cb4f45bfc427515ba7d5fc (/dev/asm-diskb) [OCRVOTE]
Located 1 voting disk(s).

2. 彻底关闭所有节点上的clusterware ,OHASD
[root@rh6rac1 bin]#./crsctl stop has -f

使用dd 命令 破坏ocr和votedisk所在diskgroup
dd if=/dev/zero of=/dev/asm-diskb bs=1024k count=1

[root@rh6rac1 bin]# ./crsctl start has
CRS-4123: Oracle High Availability Services has been started.

root@rh6rac1 bin]# ./crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
CRS-4534: Cannot communicate with Event Manager

alertrh6rac1.log
[/oracle/grid/bin/orarootagent.bin(3725)]CRS-5822:Agent '/oracle/grid/bin/orarootagent_root' disconnected from server. Details at (:CRSAGF00117
:) {0:5:903} in /oracle/grid/log/rh6rac1/agent/crsd/orarootagent_root//orarootagent_root.log.2019-03-19 17:10:20.811:
[ctssd(3174)]CRS-2405:The Cluster Time Synchronization Service on host rh6rac1 is shutdown by user
2019-03-19 17:10:20.830:
[mdnsd(2820)]CRS-5602:mDNS service stopping by request.
[client(15431)]CRS-10001:19-Mar-19 17:10 ACFS-9290: Waiting for ASM to shutdown.
2019-03-19 17:10:31.655:
[cssd(2915)]CRS-1603:CSSD on node rh6rac1 shutdown by user.
2019-03-19 17:10:31.762:
[ohasd(2230)]CRS-2767:Resource state recovery not attempted for 'ora.cssdmonitor' as its target state is OFFLINE
2019-03-19 17:10:31.857:
[cssd(2915)]CRS-1660:The CSS daemon shutdown has completed
2019-03-19 17:10:35.402:
[gpnpd(2841)]CRS-2329:GPNPD on node rh6rac1 shutdown.
2019-03-19 17:12:07.003:
[ohasd(16139)]CRS-2112:The OLR service started on node rh6rac1.
2019-03-19 17:12:07.013:
[ohasd(16139)]CRS-1301:Oracle High Availability Service started on node rh6rac1.
2019-03-19 17:12:07.014:
[ohasd(16139)]CRS-8017:location: /etc/oracle/lastgasp has 2 reboot advisory log files, 0 were announced and 0 errors occurred
2019-03-19 17:12:10.417:
[/oracle/grid/bin/orarootagent.bin(16241)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
2019-03-19 17:12:14.840:
[gpnpd(16359)]CRS-2328:GPNPD started on node rh6rac1.
2019-03-19 17:12:17.341:
[cssd(16429)]CRS-1713:CSSD daemon is started in clustered mode
2019-03-19 17:12:19.093:
[ohasd(16139)]CRS-2767:Resource state recovery not attempted for 'ora.diskmon' as its target state is OFFLINE
2019-03-19 17:12:25.937:
[cssd(16429)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /oracle/grid/log/rh6r
ac1/cssd/ocssd.log2019-03-19 17:12:40.950:
[cssd(16429)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /oracle/grid/log/rh6r
ac1/cssd/ocssd.log2019-03-19 17:12:55.959:
[cssd(16429)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /oracle/grid/log/rh6r
ac1/cssd/ocssd.log2019-03-19 17:13:10.968:
[cssd(16429)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /oracle/grid/log/rh6r
ac1/cssd/ocssd.log2019-03-19 17:13:25.976:
[cssd(16429)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /oracle/grid/log/rh6r
ac1/cssd/ocssd.log

ocssd.log：
2019-03-19 17:14:56.025: [    CSSD][1181738752]clssnmReadDiscoveryProfile: voting file discovery string(/dev/asm*)
2019-03-19 17:14:56.025: [    CSSD][1181738752]clssnmvDDiscThread: using discovery string /dev/asm* for initial discovery
2019-03-19 17:14:56.025: [   SKGFD][1181738752]Discovery with str:/dev/asm*:

2019-03-19 17:14:56.025: [   SKGFD][1181738752]UFS discovery with :/dev/asm*:

2019-03-19 17:14:56.025: [   SKGFD][1181738752]Execute glob on the string /dev/asm*
2019-03-19 17:14:56.025: [   SKGFD][1181738752]running stat on disk:/dev/asm-diske
2019-03-19 17:14:56.026: [   SKGFD][1181738752]running stat on disk:/dev/asm-diskd
2019-03-19 17:14:56.026: [   SKGFD][1181738752]running stat on disk:/dev/asm-diskc
2019-03-19 17:14:56.027: [   SKGFD][1181738752]running stat on disk:/dev/asm-diskb
2019-03-19 17:14:56.027: [   SKGFD][1181738752]Fetching UFS disk :/dev/asm-diskb:

2019-03-19 17:14:56.027: [   SKGFD][1181738752]Fetching UFS disk :/dev/asm-diskc:

2019-03-19 17:14:56.027: [   SKGFD][1181738752]Fetching UFS disk :/dev/asm-diskd:

2019-03-19 17:14:56.027: [   SKGFD][1181738752]Fetching UFS disk :/dev/asm-diske:

2019-03-19 17:14:56.027: [   SKGFD][1181738752]OSS discovery with :/dev/asm*:

2019-03-19 17:14:56.027: [   SKGFD][1181738752]Handle 0x7fe334136b60 from lib :UFS:: for disk :/dev/asm-diskb:

2019-03-19 17:14:56.027: [   SKGFD][1181738752]Handle 0x7fe334130f60 from lib :UFS:: for disk :/dev/asm-diskc:

2019-03-19 17:14:56.028: [   SKGFD][1181738752]Handle 0x7fe334131790 from lib :UFS:: for disk :/dev/asm-diskd:

2019-03-19 17:14:56.028: [   SKGFD][1181738752]Handle 0x7fe33413f4a0 from lib :UFS:: for disk :/dev/asm-diske:

2019-03-19 17:14:56.028: [   SKGFD][1181738752]Lib :UFS:: closing handle 0x7fe334136b60 for disk :/dev/asm-diskb:

2019-03-19 17:14:56.028: [   SKGFD][1181738752]Lib :UFS:: closing handle 0x7fe334130f60 for disk :/dev/asm-diskc:

2019-03-19 17:14:56.028: [   SKGFD][1181738752]Lib :UFS:: closing handle 0x7fe334131790 for disk :/dev/asm-diskd:

2019-03-19 17:14:56.028: [   SKGFD][1181738752]Lib :UFS:: closing handle 0x7fe33413f4a0 for disk :/dev/asm-diske:

2019-03-19 17:14:56.028: [    CSSD][1181738752]clssnmvDiskVerify: Successful discovery of 0 disks
2019-03-19 17:14:56.028: [    CSSD][1181738752]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
2019-03-19 17:14:56.028: [    CSSD][1181738752]clssnmvFindInitialConfigs: No voting files found
2019-03-19 17:14:56.028: [    CSSD][1181738752](:CSSNM00070:)clssnmCompleteInitVFDiscovery: Voting file not found. Retrying discovery in 15 sec
onds

正式的恢复ocr和votedisk所在diskgroup的步骤如下：
清除grid所有进程。
1. 以-excl -nocrs 方式启动cluster，这将可以启动ASM实例 但不启动CRS

[root@rh6rac1 bin]# ./crsctl start crs -excl -nocrs
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.mdnsd' on 'rh6rac1'
CRS-2676: Start of 'ora.mdnsd' on 'rh6rac1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rh6rac1'
CRS-2676: Start of 'ora.gpnpd' on 'rh6rac1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rh6rac1'
CRS-2672: Attempting to start 'ora.gipcd' on 'rh6rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'rh6rac1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'rh6rac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rh6rac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'rh6rac1'
CRS-2676: Start of 'ora.diskmon' on 'rh6rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'rh6rac1' succeeded
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'rh6rac1'
CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'rh6rac1'
CRS-2672: Attempting to start 'ora.ctssd' on 'rh6rac1'
CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'rh6rac1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rh6rac1'
CRS-2676: Start of 'ora.drivers.acfs' on 'rh6rac1' succeeded
CRS-2676: Start of 'ora.ctssd' on 'rh6rac1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rh6rac1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rh6rac1'
CRS-2676: Start of 'ora.asm' on 'rh6rac1' succeeded

2.重建原ocr和votedisk所在diskgroup,注意compatible.asm必须是11.2
[root@rh6rac1 bin]# su - grid
[grid@rh6rac1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.4.0 Production on Tue Mar 19 17:29:39 2019

Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> create diskgroup OCRVOTE external redundancy disk '/dev/asm-diskb' ATTRIBUTE 'compatible.rdbms' = '11.2', 'compatible.asm' = '11.2';

Diskgroup created.

3.从ocr backup中恢复ocr并做ocrcheck检验:
[root@rh6rac1 bin]# ./ocrconfig -restore /oracle/grid/cdata/rh6rac-cluster/backup00.ocr
[root@rh6rac1 bin]#
[root@rh6rac1 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
     Version                  :          3
     Total space (kbytes)     :     262120
     Used space (kbytes)      :       3084
     Available space (kbytes) :     259036
     ID                       :  276343585
     Device/File Name         :   +OCRVOTE
                                    Device/File integrity check succeeded

Device/File not configured

Device/File not configured

Device/File not configured

Device/File not configured

Cluster registry integrity check succeeded

Logical corruption check succeeded
    
4. 准备恢复votedisk ，可能会遇到下面的错误:
[root@rh6rac1 bin]# ./crsctl replace votedisk  +OCRVOTE
CRS-4602: Failed 27 to add voting file 942480699ad84f50bfbd253181a05ad1.
Failed to replace voting disk group with +OCRVOTE.
CRS-4000: Command Replace failed, or completed with errors.
需要重新配置一下ASM的参数，并重启ASM:
SQL> alter system set asm_diskstring='/dev/asm*';

System altered.
SQL> create pfile from memory;

File created.

SQL> startup force mount
ORA-32004: obsolete or deprecated parameter(s) specified for ASM instance
ASM instance started

Total System Global Area 1135747072 bytes
Fixed Size            2260728 bytes
Variable Size         1108320520 bytes
ASM Cache           25165824 bytes
ASM diskgroups mounted
ASM diskgroups volume enabled

[root@rh6rac1 bin]# ./crsctl replace votedisk  +OCRVOTE
Successful addition of voting disk 59835fcfdc874f55bfccc60a6be79ca4.
Successfully replaced voting disk group with +OCRVOTE.
CRS-4266: Voting file(s) successfully replaced

5. 重启has服务，检验cluster是否正常：
[root@rh6rac1 bin]# ./crsctl stop has -f
[root@rh6rac1 bin]# ./crsctl start has
CRS-4123: Oracle High Availability Services has been started.

[root@rh6rac1 bin]# ./crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

[root@rh6rac1 bin]# ./crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   59835fcfdc874f55bfccc60a6be79ca4 (/dev/asm-diskb) [OCRVOTE]
Located 1 voting disk(s).

查看crs状态
./crsctl status res -t

ocr_vote disk损坏恢复的更多相关文章

  1. RAC 11gR2模拟OCR和Votedisk损坏恢复过程

    1)破坏前的ocr和votedisk信息检查 检查ocr自动备份 [root@rac1 ~]# ocrconfig -showbackup rac2 2013/10/13 09:45:30 /u01/ ...

  2. oracle redo日志文件损坏恢复

    参考:How to Recover from Loss Of Online Redo Log And ORA-312 And ORA-313 (Doc ID 117481.1) 在线重做日志文件丢失后 ...

  3. SqlServer索引页损坏恢复

    问题背景 运维操作失误,在没有正常关闭sqlserver的情况下,将服务器关闭了,重启后某些表损坏(应该是某些页损坏了,没有损坏的页还能访问到数据,但是访问损坏了的页就有问题),目前数据库只有4.20 ...

  4. oracle 操作实例(一)----redolog 损坏恢复

    一,实验前的准备 数据库全备保证自己没成功还能补救一下 vim full.sh export ORACLE_BASE=/u01/app/oracle export ORACLE_HOME=$ORACL ...

  5. 记数据库数据文件损坏恢复ORA-00376+ORA-01110

    现象:业务平台无法登陆,日志报错为ORACLE的错误. 查看oracle日志的报错, ORA-00376: file 5 cannot be read at this time ORA-01110: ...

  6. ORACLE 11.2.0.4 OCR VOTING DISK 模拟恢复场景

    ① 备份   ocrconfig -export 文件名   或者   ocrconfig -manualbackup   或者   找到备份      ocrconfig -local -showb ...

  7. Suse系统磁盘文件损坏恢复

    进入救援(failSafe)模式检测问题,发现是因为/dev/sda4分区出现文件系统损坏.   /dev/sda4: UNEXPECTED INCONSISTENCY: run fsck manua ...

  8. 11g r2 模拟OCR和voting disk不可用，完整恢复过程，以及一些注意事项

    环境:RHEL5.8 RAC 11.2.0.3.0 1:查看ORC和voting disk信息: In 11g Release 2 your voting disk data is automatic ...

  9. 11G RAC 中 OCR 及Voting Disk 相关操作

    一.启动oracle clusterware先决条件:Oracle High Availability Services daemon(OHASD)运行在所有集群节点上1.启动整个Oracle Clu ...

随机推荐

  1. fedora终端快捷键

    在name框中填写这个快捷键的名称,比如open terminal(打开终端窗口) 在command框中填写执行这个快捷键的shell命令,此处可填写gnome-terminal

  2. trident 序列号问题

    在使用Storm的trident做流计算开发时,遇到一个诡异的问题: 我继承IPartitionedTridentSpout或者IOpaquePartitionedTridentSpout接口做事务型 ...

  3. 解决 iOS webkit 使用CSS动画时闪烁的问题

    -webkit-backface-visibility: hidden;

  4. 关于.netFramework概述

    这几天学了不少东西,想来还是应该总结一下,一来自己回顾一下,二来也怕自己忘记,在文章中,有很多东西就是借鉴别人的blog,笔者在这里对他们的无私奉献表示感谢.笔者的语言组织能力有限,如果在文章中出现什 ...

  5. 微信小程序访问豆瓣api403问题解决方发法

    微信小程序访问豆瓣api403问题解决方法一览:通过豆瓣api可以获取很多电影.书籍等的数据信息.昨晚上用微信小程序请求豆瓣api,竟然被豆瓣拒绝了.(豆瓣设置了小程序的访问权限):下面就跟着小编一起 ...

  6. 点分治模板（洛谷P4178 Tree）（树分治，树的重心，容斥原理）

    推荐YCB的总结 推荐你谷ysn等巨佬的详细题解 大致流程-- dfs求出当前树的重心 对当前树内经过重心的路径统计答案(一条路径由两条由重心到其它点的子路径合并而成) 容斥减去不合法情况(两条子路径 ...

  7. 让div获取焦点

    DIV获取焦点有两种方法: tabindex="0" contenteditable="true" ①:设置div为可编辑状态,则可点击获取焦点,同时div的内 ...

  8. OC UITextField只允许输入两位小数

    //只能输入两位小数 - (BOOL)textField:(UITextField *)textField shouldChangeCharactersInRange:(NSRange)range r ...

  9. 雪花算法(snowflake)delphi版

    雪花算法简单描述: + 最高位是符号位,始终为0,不可用. + 41位的时间序列,精确到毫秒级,41位的长度可以使用69年.时间位还有一个很重要的作用是可以根据时间进行排序. + 10位的机器标识,1 ...

  10. day39

    今日内容: 1.对于表,库,记录的基本操作 2.数据库引擎的了解 3.表的详细 4.数据类型的掌握 1.回顾昨日对于表,库,记录的基本操作 库 增: create database mydb2; 删: ...

相关文章