暂无图片
19C RAC crs启动失败
我来答
分享
lucas
2022-11-16
19C RAC crs启动失败

[root@xdrac1 ~]# /u01/app/19.3.0/grid/bin/crsctl start cluster -all


CRS-4705: Start of Clusterware failed on node xdrac1.
CRS-4000: Command Start failed, or completed with errors.

[root@xdrac1 ~]# /u01/app/19.3.0/grid/bin/crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE OFFLINE STABLE
ora.cluster_interconnect.haip
1 ONLINE OFFLINE STABLE
ora.crf
1 ONLINE ONLINE xdrac1 STABLE
ora.crsd
1 ONLINE OFFLINE STABLE
ora.cssd
1 ONLINE OFFLINE INTERCONNECT FAILURE
,STABLE
ora.cssdmonitor
1 ONLINE ONLINE xdrac1 STABLE
ora.ctssd
1 ONLINE OFFLINE STABLE
ora.diskmon
1 ONLINE OFFLINE STABLE
ora.evmd
1 ONLINE INTERMEDIATE xdrac1 STABLE
ora.gipcd
1 ONLINE UNKNOWN xdrac1 STABLE
ora.gpnpd
1 ONLINE ONLINE xdrac1 STABLE
ora.mdnsd
1 ONLINE ONLINE xdrac1 STABLE
ora.storage
1 ONLINE OFFLINE STABLE
--------------------------------------------------------------------------------


[root@xdrac1 ~]# /u01/app/19.3.0/grid/bin/ocrcheck
PROT-602: Failed to retrieve data from the cluster registry
PROC-26: Error while accessing the physical storage Storage layer error [Insufficient quorum to open OCR devices] [0]

[root@xdrac1 ~]# /u01/app/19.3.0/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
CRS-4534: Cannot communicate with Event Manager

[root@xdrac1 alert]# /u01/app/19.3.0/grid/bin/crsctl start crs
CRS-4640: Oracle High Availability Services is already active
CRS-4000: Command Start failed, or completed with errors.


错误日志:


<txt>2022-11-16 13:26:34.513 [ORAROOTAGENT(9824)]CRS-5017: The resource action "ora.storage start" encountered the following error:
2022-11-16 13:26:34.513+agent's abort action pending. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc".
</txt>
2022-11-16 13:30:00.532 : CLSCRED:3013592832: (:CLSCRED1079:)clsCredOcrKeyExists: Obj dom : SYSTEM.credentials.domains.root.ASM.Self.39a7d12e8faffff2ff83a14cebd84616.root not found
2022-11-16 13:30:00.532 : USRTHRD:3013592832: [ INFO] {0:2:3237} [ora.storage] 9066 Error 4 opening dom root in 0x7f53b8034d30


2022-11-16 13:37:42.115 [ORAROOTAGENT(9824)]CRS-5017: The resource action "ora.storage start" encountered the following error:
2022-11-16 13:37:42.115+agent's abort action pending. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc".
2022-11-16 13:37:42.117 [OHASD(9718)]CRS-2757: Command 'Start' timed out waiting for response from the resource 'ora.storage'. Details at (:CRSPE00221:) {0:2:3237} in /u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd.trc.
2022-11-16 13:37:44.147 [OHASD(9718)]CRS-2795: Shutdown of Oracle High Availability Services-managed resources on 'xdrac1' has failed
2022-11-16 13:37:44.148 [OHASD(9718)]CRS-2878: Failed to restart resource 'ora.storage'

CRSAGF00113:) {0:2:3237} in /u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc.
2022-11-16 13:37:42.115 [ORAROOTAGENT(9824)]CRS-5017: The resource action "ora.storage start" encountered the following error:
2022-11-16 13:37:42.115+agent's abort action pending. For details refer to "(:CLSN00107:)" in "/u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc".
2022-11-16 13:37:42.117 [OHASD(9718)]CRS-2757: Command 'Start' timed out waiting for response from the resource 'ora.storage'. Details at (:CRSPE00221:) {0:2:3237} in /u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd.trc.
2022-11-16 13:37:44.147 [OHASD(9718)]CRS-2795: Shutdown of Oracle High Availability Services-managed resources on 'xdrac1' has failed
2022-11-16 13:37:44.148 [OHASD(9718)]CRS-2878: Failed to restart resource 'ora.storage'

我来答
添加附件
收藏
分享
问题补充
14条回答
默认
最新
lucas
升级问题到: 紧急故障
暂无图片 评论
暂无图片 有用 0
打赏 0
哇哈哈

/u01/app/grid/diag/crs/xdrac1/crs/trace/ohasd_orarootagent_root.trc

暂无图片 评论
暂无图片 有用 1
打赏 0
lucas



暂无图片 评论
暂无图片 有用 0
打赏 0
lucas
暂无图片 评论
暂无图片 有用 0
打赏 0
lucas
上传附件:alert.log
暂无图片 评论
暂无图片 有用 0
打赏 0
哇哈哈
2022-11-16
昨天中午1点,网络故障,节点1被驱逐,网络恢复了吗
lucas
题主
2022-11-16
网络目前是正常的,已经恢复了
哇哈哈
2022-11-16
把OHAS重启crsctl stop crs -f然后再crsctl start crs /////或者重启OS
刘贵宾

确认一下两节点$GRID_HOME/bin下文件目录权限及属组

暂无图片 评论
暂无图片 有用 4
打赏 0
刘贵宾
答主
2022-11-16
getfacl
lucas
上传附件:getfacl_gridhome_bin.txt
暂无图片 评论
暂无图片 有用 0
打赏 0
lucas


暂无图片 评论
暂无图片 有用 0
打赏 0
刘贵宾

asmcmd进去看一下磁盘是否已挂载

sqlplus '/as sysasm'

startup试试

暂无图片 评论
暂无图片 有用 4
打赏 0
lucas
题主
2022-11-16
启动报错 [grid@xdrac1 ~]$ sqlplus / as sysasm SQL*Plus: Release 19.0.0.0.0 - Production on Wed Nov 16 16:07:35 2022 Version 19.3.0.0.0 Copyright (c) 1982, 2019, Oracle. All rights reserved. Connected to an idle instance. SQL> startup ORA-01078: failure in processing system parameters ORA-29701: unable to connect to Cluster Synchronization Service ORA-29701: unable to connect to Cluster Synchronization Service
刘贵宾

重启过服务器么?

暂无图片 评论
暂无图片 有用 3
打赏 0
lucas
题主
2022-11-16
服务器还没有重启过
刘贵宾
答主
2022-11-16
我觉得可以重启一个节点的服务器试试
lucas
上传附件:ocssd.rar
暂无图片 评论
暂无图片 有用 0
打赏 0
lucas
上传附件:gipcd.rar
暂无图片 评论
暂无图片 有用 0
打赏 0
lucas


现在重启主机后能恢复,但运行一段时间后又会出现之前的情况,如何彻底解决该节点服务自动down

暂无图片 评论
暂无图片 有用 0
打赏 0
哇哈哈
2022-11-17
网不行吗?
刘贵宾

检查一下和磁盘存储之间的的连接情况,看看网线和硬件

暂无图片 评论
暂无图片 有用 3
打赏 0
回答交流
Markdown


请输入正文
提交
相关推荐
当RAC环境中,本地FG进程要从远程实例master node的申请数据块时,是与远程哪个进程直接通信的?
回答 2
已采纳
lms进程吧
oracle 集群crs起不来
回答 11
遇到这样的问题,需要查看asm状态,需要查看集群日志,oracle执行文件的权限,磁盘权限等等
ORA-12514:listener could not resolve SERVICE_NAME given in connect descriptor
回答 7
1、理论上scanip加实例名的方式,连数据库是没有问题的2、测试也是没问题的3、确认你的plsql使用了正确的tnsnames.ora4、确认你的plsql使用了正确的ora客户端
oracle 监控rac数据同步状态
回答 5
12cr2 rac ora-29740 ora-3136
回答 1
有个项目也遇到类似的问题,也是12C环境OracleLinux7.9RAC12.2.0.1版本的提示连接超时,网上只能找到10g出现类似问题解决办法,10g主要是长连接没有释放,最终没有找到解决办法。
ORA-12012 ORA-04063 ORA-06508 ORA-06512
回答 1
看报错是job调用的package有问题,检查一下package,如果没用可以注释掉!如果job都没用的话,直接禁用吧
RAC 是否需要设置filesystemio_options的参数
回答 2
但是我看论坛上有个帖子说是不设置这个参数,https://www.modb.pro/doc/42402
grid执行asmcmd报错。
回答 2
试试sqlplus能不能进去。看看异常节点的root、grid环境变量和正常节点的环境变量。
Oracle rac登录不上
回答 2
suoracleenv|grepORACLE看看输出结果。
Oracle RAC 怎么修改时钟同步NTP为CTSS?
回答 1
停掉ntp,把ntp的配置文件也mv掉