복사되었습니다!
OS 환경 : Oracle Linux 9.6 (64bit)
DB 환경 : Oracle Database 19.32.0.0
에러 : CRS-2807: Resource 'ora.LISTENER.lsnr' failed to start automatically.
2 노드 rac에서 1번노드 grid 재기동시 발생하는 에러
2번노드는 이미 내려가 있고 1번 노드만 먼저 기동함
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
|
# crsctl start crs -wait
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.mdnsd' on 'oel19db1'
CRS-2672: Attempting to start 'ora.evmd' on 'oel19db1'
CRS-2676: Start of 'ora.mdnsd' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.evmd' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'oel19db1'
CRS-2676: Start of 'ora.gpnpd' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'oel19db1'
CRS-2676: Start of 'ora.gipcd' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'oel19db1'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oel19db1'
CRS-2676: Start of 'ora.crf' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'oel19db1'
CRS-2672: Attempting to start 'ora.diskmon' on 'oel19db1'
CRS-2676: Start of 'ora.diskmon' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.cssd' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'oel19db1'
CRS-2672: Attempting to start 'ora.ctssd' on 'oel19db1'
CRS-2676: Start of 'ora.ctssd' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'oel19db1'
CRS-2676: Start of 'ora.asm' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'oel19db1'
CRS-2676: Start of 'ora.storage' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'oel19db1'
CRS-2676: Start of 'ora.crsd' on 'oel19db1' succeeded
CRS-6023: Starting Oracle Cluster Ready Services-managed resources
CRS-6017: Processing resource auto-start for servers: oel19db1
CRS-2672: Attempting to start 'ora.oel19db1.vip' on 'oel19db1'
CRS-2672: Attempting to start 'ora.scan1.vip' on 'oel19db1'
CRS-2672: Attempting to start 'ora.oel19db2.vip' on 'oel19db1'
CRS-2672: Attempting to start 'ora.ons' on 'oel19db1'
CRS-2672: Attempting to start 'ora.chad' on 'oel19db1'
CRS-2672: Attempting to start 'ora.cvu' on 'oel19db1'
CRS-2676: Start of 'ora.cvu' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.DATA.dg' on 'oel19db1'
CRS-2672: Attempting to start 'ora.RECO.dg' on 'oel19db1'
CRS-2676: Start of 'ora.chad' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.ons' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.DATA.dg' on 'oel19db1' succeeded
CRS-5005: IP Address: 192.168.137.150 is either not configured or already in use in the network.
CRS-5005: IP Address: 192.168.137.100 is either not configured or already in use in the network.
CRS-2674: Start of 'ora.oel19db1.vip' on 'oel19db1' failed
CRS-2672: Attempting to start 'ora.oel19db1.vip' on 'oel19db1'
CRS-5005: IP Address: 192.168.137.200 is either not configured or already in use in the network.
CRS-2674: Start of 'ora.oel19db2.vip' on 'oel19db1' failed
CRS-2674: Start of 'ora.scan1.vip' on 'oel19db1' failed
CRS-2672: Attempting to start 'ora.scan1.vip' on 'oel19db1'
CRS-2676: Start of 'ora.RECO.dg' on 'oel19db1' succeeded
CRS-5005: IP Address: 192.168.137.100 is either not configured or already in use in the network.
CRS-2674: Start of 'ora.oel19db1.vip' on 'oel19db1' failed
CRS-5005: IP Address: 192.168.137.150 is either not configured or already in use in the network.
CRS-2674: Start of 'ora.scan1.vip' on 'oel19db1' failed
CRS-2672: Attempting to start 'ora.oel19db1.vip' on 'oel19db1'
CRS-2672: Attempting to start 'ora.scan1.vip' on 'oel19db1'
CRS-5005: IP Address: 192.168.137.100 is either not configured or already in use in the network.
CRS-2674: Start of 'ora.oel19db1.vip' on 'oel19db1' failed
CRS-5005: IP Address: 192.168.137.150 is either not configured or already in use in the network.
CRS-2674: Start of 'ora.scan1.vip' on 'oel19db1' failed
CRS-2672: Attempting to start 'ora.oradb.db' on 'oel19db1'
CRS-2676: Start of 'ora.oradb.db' on 'oel19db1' succeeded
===== Summary of resource auto-start failures follows =====
CRS-2807: Resource 'ora.LISTENER.lsnr' failed to start automatically.
CRS-2807: Resource 'ora.LISTENER_SCAN1.lsnr' failed to start automatically.
CRS-2807: Resource 'ora.oel19db1.vip' failed to start automatically.
CRS-2807: Resource 'ora.oel19db2.vip' failed to start automatically.
CRS-2807: Resource 'ora.scan1.vip' failed to start automatically.
CRS-6016: Resource auto-start has completed for server oel19db1
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
|
리스너 등 에러가 일부 발생 했지만 기동은 됨
grid 상태 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
|
# crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE OFFLINE oel19db1 STABLE
ora.chad
ONLINE ONLINE oel19db1 STABLE
ora.net1.network
ONLINE ONLINE oel19db1 STABLE
ora.ons
ONLINE ONLINE oel19db1 STABLE
ora.proxy_advm
OFFLINE OFFLINE oel19db1 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE OFFLINE STABLE
ora.OCR_VOTE.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.RECO.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE oel19db1 Started,STABLE
2 ONLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE oel19db1 STABLE
ora.oel19db1.vip
1 ONLINE OFFLINE STABLE
ora.oel19db2.vip
1 ONLINE OFFLINE STABLE
ora.oradb.db
1 ONLINE ONLINE oel19db1 Open,HOME=/app/oracl
e/product/19c,STABLE
2 ONLINE OFFLINE STABLE
ora.scan1.vip
1 ONLINE OFFLINE STABLE
--------------------------------------------------------------------------------
|
네트워크 관련 부분만 offline 이고 나머지는 정상적으로 기동됨
해결 방법 : 다른 노드에서 사용중인 ip 제거
2번 노드 확인
|
1
2
|
# ps -ef|grep d.bin
root 1110181 1044082 0 15:56 pts/1 00:00:00 grep --color=auto d.bin
|
grid 프로세스는 안떠있음
1번 노드에서 먼저 vip ip인 192.168.137.100로 ping 시도
|
1
2
3
4
5
6
7
8
9
|
# ping -c 3 192.168.137.100
PING 192.168.137.100 (192.168.137.100) 56(84) bytes of data.
64 bytes from 192.168.137.100: icmp_seq=1 ttl=64 time=0.253 ms
64 bytes from 192.168.137.100: icmp_seq=2 ttl=64 time=0.242 ms
64 bytes from 192.168.137.100: icmp_seq=3 ttl=64 time=0.177 ms
--- 192.168.137.100 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2072ms
rtt min/avg/max/mdev = 0.177/0.224/0.253/0.033 ms
|
현재 ping은 감, 어딘가에 이 ip가 실행중이라는 말임
참고로 vm 네트워크는 외부와 연결되어 있지 않아 다른곳에서 이 ip를 설정했어도 영향이 없음
1번 노드에서 ip addr 명령을 수행해 vip ip인 192.168.137.100 확인
|
1
|
# ip addr | grep 192.168.137.100
|
안나옴
2번 노드에서 ip addr 명령 확인(2번 노드)
|
1
2
3
4
|
# ip -br addr
lo UNKNOWN 127.0.0.1/8 ::1/128
ens192 UP 192.168.137.20/24 192.168.137.200/24 192.168.137.150/24 192.168.137.100/24 fe80::ddc4:f605:dcc3:c3f2/64
ens224 UP 10.10.20.20/24 fe80::b14a:1652:8626:b326/64
|
ens192에 192.168.137.200(2번 vip), 192.168.137.150(scan ip), 192.168.137.100(1번 vip)이 표시됨
ip addr del 명령으로 해당 ip 제거
|
1
2
3
|
# ip addr del 192.168.137.100/24 dev ens192
# ip addr del 192.168.137.150/24 dev ens192
# ip addr del 192.168.137.200/24 dev ens192
|
재확인
|
1
2
3
4
|
# ip -br addr
lo UNKNOWN 127.0.0.1/8 ::1/128
ens192 UP 192.168.137.20/24 fe80::ddc4:f605:dcc3:c3f2/64
ens224 UP 10.10.20.20/24 fe80::b14a:1652:8626:b326/64
|
이제 안나옴
1번 노드 crs 중지 후 재기동
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
|
# crsctl stop crs -f
# crsctl start crs -wait
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.mdnsd' on 'oel19db1'
CRS-2672: Attempting to start 'ora.evmd' on 'oel19db1'
CRS-2676: Start of 'ora.mdnsd' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.evmd' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'oel19db1'
CRS-2676: Start of 'ora.gpnpd' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'oel19db1'
CRS-2676: Start of 'ora.gipcd' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'oel19db1'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oel19db1'
CRS-2676: Start of 'ora.cssdmonitor' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'oel19db1'
CRS-2672: Attempting to start 'ora.diskmon' on 'oel19db1'
CRS-2676: Start of 'ora.crf' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.diskmon' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'oel19db1'
CRS-2676: Start of 'ora.crf' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'oel19db1'
CRS-2676: Start of 'ora.crf' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'oel19db1'
CRS-2676: Start of 'ora.crf' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.cssd' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'oel19db1'
CRS-2672: Attempting to start 'ora.ctssd' on 'oel19db1'
CRS-2676: Start of 'ora.ctssd' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'oel19db1'
CRS-2676: Start of 'ora.asm' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'oel19db1'
CRS-2676: Start of 'ora.storage' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'oel19db1'
CRS-2676: Start of 'ora.crsd' on 'oel19db1' succeeded
CRS-6023: Starting Oracle Cluster Ready Services-managed resources
CRS-6017: Processing resource auto-start for servers: oel19db1
CRS-2672: Attempting to start 'ora.scan1.vip' on 'oel19db1'
CRS-2672: Attempting to start 'ora.oel19db1.vip' on 'oel19db1'
CRS-2672: Attempting to start 'ora.ons' on 'oel19db1'
CRS-2672: Attempting to start 'ora.chad' on 'oel19db1'
CRS-2672: Attempting to start 'ora.cvu' on 'oel19db1'
CRS-2672: Attempting to start 'ora.oel19db2.vip' on 'oel19db1'
CRS-2676: Start of 'ora.cvu' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.DATA.dg' on 'oel19db1'
CRS-2672: Attempting to start 'ora.RECO.dg' on 'oel19db1'
CRS-2676: Start of 'ora.oel19db1.vip' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER.lsnr' on 'oel19db1'
CRS-2676: Start of 'ora.oel19db2.vip' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.chad' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.scan1.vip' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'oel19db1'
CRS-2676: Start of 'ora.LISTENER.lsnr' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.ons' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.DATA.dg' on 'oel19db1' succeeded
CRS-2672: Attempting to start 'ora.oradb.db' on 'oel19db1'
CRS-2676: Start of 'ora.RECO.dg' on 'oel19db1' succeeded
CRS-2676: Start of 'ora.oradb.db' on 'oel19db1' succeeded
CRS-6016: Resource auto-start has completed for server oel19db1
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
|
에러 없이 정상 기동됨
grid 상태 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
|
# crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE oel19db1 STABLE
ora.chad
ONLINE ONLINE oel19db1 STABLE
ora.net1.network
ONLINE ONLINE oel19db1 STABLE
ora.ons
ONLINE ONLINE oel19db1 STABLE
ora.proxy_advm
OFFLINE OFFLINE oel19db1 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE oel19db1 STABLE
ora.OCR_VOTE.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.RECO.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE oel19db1 Started,STABLE
2 ONLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE oel19db1 STABLE
ora.oel19db1.vip
1 ONLINE ONLINE oel19db1 STABLE
ora.oel19db2.vip
1 ONLINE INTERMEDIATE oel19db1 FAILED OVER,STABLE
ora.oradb.db
1 ONLINE ONLINE oel19db1 Open,HOME=/app/oracl
e/product/19c,STABLE
2 ONLINE OFFLINE STABLE
ora.scan1.vip
1 ONLINE ONLINE oel19db1 STABLE
--------------------------------------------------------------------------------
|
vip, scan, 리스너 등이 정상적으로 기동됨
원인 : ip 충돌 문제
ocr 장애를 발생시키고 2번 노드를 crsctl stop crs -f 옵션을 이용해 중지 시키면서
ip를 제대로 반환하지 못한것으로 보임
참조 :
'ORACLE > Trouble Shooting' 카테고리의 다른 글
| CLSCRED0101:clsCredDomInitRootDom: Using user given storage context for repository access. (0) | 2026.10.16 |
|---|---|
| [INS-30132] Initial setup required for the execution of installer validations failed on nodes: oel19db2 (0) | 2026.10.10 |
| load pubkey "/home/oracle/.ssh/id_rsa": Invalid key length (0) | 2026.10.07 |
| [INS-30508] Invalid ASM disks. (0) | 2026.10.01 |
| Unable to instantiate disk "DATA01" (0) | 2026.09.19 |