暂无图片
19C RAC crs启动失败
我来答
分享
lucas
2022-11-16
19C RAC crs启动失败

[root@xdrac1 ~]# /u01/app/19.3.0/grid/bin/crsctl start cluster -all


CRS-4705: Start of Clusterware failed on node xdrac1.
CRS-4000: Command Start failed, or completed with errors.

[root@xdrac1 ~]# /u01/app/19.3.0/grid/bin/crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE OFFLINE STABLE
ora.cluster_interconnect.haip
1 ONLINE OFFLINE STABLE
ora.crf
1 ONLINE ONLINE xdrac1 STABLE
ora.crsd
1 ONLINE OFFLINE STABLE
ora.cssd
1 ONLINE OFFLINE INTERCONNECT FAILURE
,STABLE
ora.cssdmonitor
1 ONLINE ONLINE xdrac1 STABLE
ora.ctssd
1 ONLINE OFFLINE STABLE
ora.diskmon
1 ONLINE OFFLINE STABLE
ora.evmd
1 ONLINE INTERMEDIATE xdrac1 STABLE
ora.gipcd
1 ONLINE UNKNOWN xdrac1 STABLE
ora.gpnpd
1 ONLINE ONLINE xdrac1 STABLE
ora.mdnsd
1 ONLINE ONLINE xdrac1 STABLE
ora.storage
1 ONLINE OFFLINE STABLE
--------------------------------------------------------------------------------


[root@xdrac1 ~]# /u01/app/19.3.0/grid/bin/ocrcheck
PROT-602: Failed to retrieve data from the cluster registry
PROC-26: Error while accessing the physical storage Storage layer error [Insufficient quorum to open OCR devices] [0]

[root@xdrac1 ~]# /u01/app/19.3.0/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
CRS-4534: Cannot communicate with Event Manager

[root@xdrac1 alert]# /u01/app/19.3.0/grid/bin/crsctl start crs
CRS-4640: Oracle High Availability Services is already active
CRS-4000: Command Start failed, or completed with errors.


错误日志:


<txt>2022-11-16 13:26:34.513 [ORAROOTAGENT(9824)]CRS-5017: The resource action "ora.storage start" encountered the following error:
2022-11-16 13:26:34.513+agent's abort action pending. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc".
</txt>
2022-11-16 13:30:00.532 : CLSCRED:3013592832: (:CLSCRED1079:)clsCredOcrKeyExists: Obj dom : SYSTEM.credentials.domains.root.ASM.Self.39a7d12e8faffff2ff83a14cebd84616.root not found
2022-11-16 13:30:00.532 : USRTHRD:3013592832: [ INFO] {0:2:3237} [ora.storage] 9066 Error 4 opening dom root in 0x7f53b8034d30


2022-11-16 13:37:42.115 [ORAROOTAGENT(9824)]CRS-5017: The resource action "ora.storage start" encountered the following error:
2022-11-16 13:37:42.115+agent's abort action pending. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc".
2022-11-16 13:37:42.117 [OHASD(9718)]CRS-2757: Command 'Start' timed out waiting for response from the resource 'ora.storage'. Details at (:CRSPE00221:) {0:2:3237} in /u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd.trc.
2022-11-16 13:37:44.147 [OHASD(9718)]CRS-2795: Shutdown of Oracle High Availability Services-managed resources on 'xdrac1' has failed
2022-11-16 13:37:44.148 [OHASD(9718)]CRS-2878: Failed to restart resource 'ora.storage'

CRSAGF00113:) {0:2:3237} in /u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc.
2022-11-16 13:37:42.115 [ORAROOTAGENT(9824)]CRS-5017: The resource action "ora.storage start" encountered the following error:
2022-11-16 13:37:42.115+agent's abort action pending. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc".
2022-11-16 13:37:42.117 [OHASD(9718)]CRS-2757: Command 'Start' timed out waiting for response from the resource 'ora.storage'. Details at (:CRSPE00221:) {0:2:3237} in /u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd.trc.
2022-11-16 13:37:44.147 [OHASD(9718)]CRS-2795: Shutdown of Oracle High Availability Services-managed resources on 'xdrac1' has failed
2022-11-16 13:37:44.148 [OHASD(9718)]CRS-2878: Failed to restart resource 'ora.storage'

我来答
添加附件
收藏
分享
问题补充
14条回答
默认
最新
lucas
2022-11-16
升级问题到: 紧急故障
暂无图片 评论
暂无图片 有用 0
打赏 0
哇哈哈
2022-11-16

/u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc

暂无图片 评论
暂无图片 有用 1
打赏 0
lucas
2022-11-16



暂无图片 评论
暂无图片 有用 0
打赏 0
lucas
2022-11-16
暂无图片 评论
暂无图片 有用 0
打赏 0
lucas
2022-11-16
上传附件:alert.log
暂无图片 评论
暂无图片 有用 0
打赏 0
哇哈哈
2022-11-16
昨天中午1点,网络故障,节点1被驱逐,网络恢复了吗
lucas
题主
2022-11-16
网络目前是正常的,已经恢复了
哇哈哈
2022-11-16
把OHAS重启crsctl stop crs -f然后再crsctl start crs /////或者重启OS
刘贵宾
2022-11-16

确认一下两节点$GRID_HOME/bin下文件目录权限及属组

暂无图片 评论
暂无图片 有用 4
打赏 0
刘贵宾
答主
2022-11-16
getfacl
lucas
2022-11-16
上传附件:getfacl_gridhome_bin.txt
暂无图片 评论
暂无图片 有用 0
打赏 0
lucas
2022-11-16


暂无图片 评论
暂无图片 有用 0
打赏 0
刘贵宾
2022-11-16

asmcmd进去看一下磁盘是否已挂载

sqlplus '/as sysasm'

startup试试

暂无图片 评论
暂无图片 有用 4
打赏 0
lucas
题主
2022-11-16
启动报错 [grid@xdrac1 ~]$ sqlplus / as sysasm SQL*Plus: Release 19.0.0.0.0 - Production on Wed Nov 16 16:07:35 2022 Version 19.3.0.0.0 Copyright (c) 1982, 2019, Oracle. All rights reserved. Connected to an idle instance. SQL> startup ORA-01078: failure in processing system parameters ORA-29701: unable to connect to Cluster Synchronization Service ORA-29701: unable to connect to Cluster Synchronization Service
刘贵宾
2022-11-16

重启过服务器么?

暂无图片 评论
暂无图片 有用 3
打赏 0
lucas
题主
2022-11-16
服务器还没有重启过
刘贵宾
答主
2022-11-16
我觉得可以重启一个节点的服务器试试
lucas
2022-11-17
上传附件:ocssd.rar
暂无图片 评论
暂无图片 有用 0
打赏 0
lucas
2022-11-17
上传附件:gipcd.rar
暂无图片 评论
暂无图片 有用 0
打赏 0
lucas
2022-11-17


现在重启主机后能恢复,但运行一段时间后又会出现之前的情况,如何彻底解决该节点服务自动down

暂无图片 评论
暂无图片 有用 0
打赏 0
哇哈哈
2022-11-17
网不行吗?
刘贵宾
2022-11-17

检查一下和磁盘存储之间的的连接情况,看看网线和硬件

暂无图片 评论
暂无图片 有用 3
打赏 0
回答交流
Markdown


请输入正文
提交
问题信息
请登录之后查看
附件列表
请登录之后查看
邀请回答
暂无人订阅该标签,敬请期待~~
暂无图片墨值悬赏