测试库盘符变更导致集群无法启动的临时解决办法 -m6米乐安卓版下载

启动集群报错

2022-05-17 21:27:19.909 [cssdmonitor(31896)]crs-8500: oracle clusterware cssdmonitor process is starting with operating system process id 31896
2022-05-17 21:27:19.961 [cssdagent(31902)]crs-8500: oracle clusterware cssdagent process is starting with operating system process id 31902
2022-05-17 21:27:21.376 [cssdagent(31995)]crs-8500: oracle clusterware cssdagent process is starting with operating system process id 31995
2022-05-17 21:27:26.349 [ocssd(32014)]crs-8500: oracle clusterware ocssd process is starting with operating system process id 32014
2022-05-17 21:27:27.450 [ocssd(32014)]crs-1713: cssd daemon is started in hub mode
2022-05-17 21:27:27.634 [ocssd(32014)]crs-1637: unable to locate configured voting file with id 6f82aa99-0aad4f63-bf4afada-327bc34e; details at (:cssnm00020:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc 
2022-05-17 21:27:27.635 [ocssd(32014)]crs-1637: unable to locate configured voting file with id 13fa2481-284d4f7b-bfaf8e77-2dd203ea; details at (:cssnm00020:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-17 21:27:27.635 [ocssd(32014)]crs-1637: unable to locate configured voting file with id 1381ba73-db3d4fb7-bf76c4cf-93143522; details at (:cssnm00020:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-17 21:27:27.636 [ocssd(32014)]crs-1637: unable to locate configured voting file with id 71c65157-fa374fcf-bfe8a8d4-3819f33c; details at (:cssnm00020:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-17 21:27:27.636 [ocssd(32014)]crs-1705: found 1 configured voting files but 3 voting files are required, terminating to ensure data integrity; details at (:cssnm00021:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-17 21:27:28.638 [ocssd(32014)]crs-1656: the css daemon is terminating due to a fatal error; details at (:csssc00012:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-17 21:27:28.677 [ocssd(32014)]crs-1652: starting clean up of crsd resources.
2022-05-17 21:27:28.684 [ocssd(32014)]crs-1653: the clean up of the crsd resources failed.
2022-05-17t21:27:30.709540 08:00
errors in file /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc  (incident=345):
crs-8503 [] [] [] [] [] [] [] [] [] [] [] []
incident details in: /u01/app/19c/grid/diag/crs/nxdbcs01/crs/incident/incdir_345/ocssd_i345.trc

表决盘挂载不了

[root@nxdbcs01 ~]# crsctl query css votedisk
unable to communicate with the cluster synchronization services daemon.
[root@nxdbcs01 ~]# ocrcheck -config
oracle cluster registry configuration is :
         device/file name         :        ocr

2022-05-07 00:26:16.264 :   skgfd:2104772352: handle 0x7fc2240f8370 from lib :ufs:: for disk :/dev/asm_data01:
2022-05-07 00:26:16.266 :    clsf:2104772352:  warning: voting disk: /dev/asm_data01 is hard mounted
2022-05-07 00:26:16.266 :   skgfd:2104772352: lib :ufs:: closing handle 0x7fc2240f8370 for disk :/dev/asm_data01:
2022-05-07 00:26:16.266 :    cssd:2104772352: [     info] clssnmvdiskverify: discovered a potential voting file
2022-05-07 00:26:16.267 :   skgfd:2104772352: handle 0x7fc2240f7ed0 from lib :ufs:: for disk :/dev/asm_data01:
2022-05-07 00:26:16.267 :    clsf:2104772352: opened hdl:0x7fc2240f7e80 for dev:/dev/asm_data01:
2022-05-07 00:26:16.277 :    cssd:2104772352: [     info] clssnmvdiskcreate: name /dev/asm_data01 blocksz 512
2022-05-07 00:26:16.279 :    cssd:2104772352: [     info] clssnmvdiskcreate: clguidoff_volinfo =44, siteoff_volinfo = 77
2022-05-07 00:26:16.280 :    cssd:2104772352: [     info] clssnmvdiskcreate: site guid during discovery = 00112233445566778899aabbccddeeff
2022-05-07 00:26:16.280 :    cssd:2104772352: [     info] clssnmvdiskverify: successful discovery for disk /dev/asm_data01, uid 6ec58cde-24bb4fd8-bfa91e25-5e44661a, sid 00112233-44556677-8899aabb-ccddeeff, pending cin 0:1648651938:0, committed cin 0:1648651938:0
2022-05-07 00:26:16.280 :    clsf:2104772352: closing handle:0x7fc2240f7e80
2022-05-07 00:26:16.281 :   skgfd:2104772352: lib :ufs:: closing handle 0x7fc2240f7ed0 for disk :/dev/asm_data01:
2022-05-07 00:26:16.281 :    cssd:2104772352: [     info] clssnmvdiskverify: successful discovery of 1 disks
2022-05-07 00:26:16.281 :    cssd:2104772352: [     info] clssnmcompleteinitvfdiscovery: completing initial voting file discovery
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmvcopycfg: cinhdrsize = 60 , nmcfg size = 60,
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmcompletevfdiscovery: completing voting file discovery
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmvfindconfiguredvfs: changing state for vdisk 0x7fc2240fa3b0, /dev/asm_data01to pending config
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmvdiskstatechange: state from discovered to pending disk /dev/asm_data01
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmvconfigurevfs: changing state for vdisk 0x7fc2240fa3b0, /dev/asm_data01to configured
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmvdiskstatechange: state from pending to configured disk /dev/asm_data01
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmvfmajority: in site 00112233-44556677-8899aabb-ccddeeff : insufficient voting files found, found 1 of 5 configured, needed 3 vf's
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmvverifycommittedconfigvfs : no majority for site 00112233-44556677-8899aabb-ccddeeff, configured vfs 5  acessible vfs 1, min needed 3 
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmvverifycommittedconfigvfs: configured sites = 1, incative sites = 1, mininum sites required = 1
2022-05-07 00:26:16.282 :    cssd:2104772352: [     info] clssnmvverifycommittedconfigvfs: insufficient voting files found, found 1 of 5 configured, needed 3 voting files
2022-05-07 00:26:16.288 :    cssd:2104772352: [     info] (:cssnm00020:)clssnmvverifycommittedconfigvfs: voting file 1, id 6f82aa99-0aad4f63-bf4afada-327bc34e not found
2022-05-07 00:26:16.297 :    cssd:2104772352: [     info] (:cssnm00020:)clssnmvverifycommittedconfigvfs: voting file 2, id 13fa2481-284d4f7b-bfaf8e77-2dd203ea not found
2022-05-07 00:26:16.303 :    cssd:2104772352: [     info] (:cssnm00020:)clssnmvverifycommittedconfigvfs: voting file 3, id 1381ba73-db3d4fb7-bf76c4cf-93143522 not found
2022-05-07 00:26:16.309 :    cssd:2104772352: [     info] (:cssnm00020:)clssnmvverifycommittedconfigvfs: voting file 4, id 71c65157-fa374fcf-bfe8a8d4-3819f33c not found
2022-05-07 00:26:16.315 :    cssd:2104772352: assert clssnm1.c 5095
2022-05-07 00:26:16.315 :    cssd:2104772352: (:cssnm00021:)clssnmcheckquorum: found 1 voting files, but 3 are required.  terminating due to insufficient configured voting files

2022-05-16 19:55:18.702 [ocssd(3797)]crs-1637: unable to locate configured voting file with id 6f82aa99-0aad4f63-bf4afada-327bc34e; details at (:cssnm00020:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-16 19:55:18.702 [ocssd(3797)]crs-1637: unable to locate configured voting file with id 13fa2481-284d4f7b-bfaf8e77-2dd203ea; details at (:cssnm00020:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-16 19:55:18.703 [ocssd(3797)]crs-1637: unable to locate configured voting file with id 1381ba73-db3d4fb7-bf76c4cf-93143522; details at (:cssnm00020:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-16 19:55:18.703 [ocssd(3797)]crs-1637: unable to locate configured voting file with id 71c65157-fa374fcf-bfe8a8d4-3819f33c; details at (:cssnm00020:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-16 19:55:18.704 [ocssd(3797)]crs-1705: found 1 configured voting files but 3 voting files are required, terminating to ensure data integrity; details at (:cssnm00021:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-16 19:55:19.705 [ocssd(3797)]crs-1656: the css daemon is terminating due to a fatal error; details at (:csssc00012:) in /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc
2022-05-16 19:55:19.744 [ocssd(3797)]crs-1652: starting clean up of crsd resources.
2022-05-16 19:55:19.750 [ocssd(3797)]crs-1653: the clean up of the crsd resources failed.
2022-05-16 19:55:21.767 [ocssd(3797)]crs-8503: oracle clusterware process ocssd with operating system process id 3797 experienced fatal signal or exception code 6.
2022-05-16t19:55:21.799860 08:00
errors in file /u01/app/19c/grid/diag/crs/nxdbcs01/crs/trace/ocssd.trc  (incident=25):
crs-8503 [] [] [] [] [] [] [] [] [] [] [] []

集群日志显示服务加载ocr所在磁盘组

检查udev.rules,发现主机重启后盘符发生了变化，因为是单快盘分区做的，uuid相同，没法使用uuid，那么只能临时修改rules盘符。
再次启动
此时asm可以启动，但是显示没有磁盘组，检查asmdisk_string参数发现没有问题。
show parameter spfile可以看到spfile位置，create pfile报错
检查asm日志

ote: diskgroup used for ocr backup is:ocr
note: diskgroups listed in asm_diskgroup are
         data01
2022-05-18t07:59:57.606087 08:00
note: asm instance  asm1 is discoverable by local clients on node nxdbcs01
2022-05-18t07:59:57.623534 08:00
note: cache registered group data01 1/0x00646e62
note: cache began mount (first) of group data01 1/0x00646e62
note: cache registered group ocr 2/0x00746e63
note: cache began mount (first) of group ocr 2/0x00746e63
warning: detected duplicate paths to the same disk:
  '/dev/sdd1' and
  '/dev/asm_data01'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdd1' and
  '/dev/asm_data01'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc7' and
  '/dev/asm_ocr05'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc7' and
  '/dev/asm_ocr05'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc6' and
  '/dev/asm_ocr04'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc6' and
  '/dev/asm_ocr04'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc5' and
  '/dev/asm_ocr03'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc5' and
  '/dev/asm_ocr03'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc2' and
  '/dev/asm_ocr02'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc2' and
  '/dev/asm_ocr02'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc1' and
  '/dev/asm_ocr01'
more trace information dumped to '/u01/app/19c/grid/diag/asm/ asm/ asm1/trace/ asm1_ora_26839.trc'
warning: detected duplicate paths to the same disk:
  '/dev/sdc1' and
  '/dev/asm_ocr01'

重复盘符问题，很常见，什么原因导致的呢，

临时解决办法，先去掉一个盘符呗
删除/etc/udev/rules/oracle.rules

/sbin/udevadm control --reload-rules
/sbin/udevadm trigger --type=devices --action=change

alter diskgroup all mount;

成功

临时解决办法可行，具体原因以后再说，睡觉