OS환경 : Oracle Linux 8.5 (64bit)
DB 환경 : Oracle Database 19.12.0.0 RAC
방법 : 오라클 19c RAC /etc /opt 등 파일이 제거된 경우 조치방안
오라클 19c ASM RAC 환경에서 GRID엔진 경로는 변경이나 문제가 없지만
OS 이슈등 특정 이유로 인해 오라클이 사용하는 /etc 밑의 데이터나 /opt 밑의 데이터들이 제거된 경우
RAC를 정상적으로 기동할 수 없음
이때 조치방안을 설명함
테스트 전 상태 확인
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
|
# crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE oel19db1 STABLE
ONLINE ONLINE oel19db2 STABLE
ora.chad
ONLINE ONLINE oel19db1 STABLE
ONLINE ONLINE oel19db2 STABLE
ora.net1.network
ONLINE ONLINE oel19db1 STABLE
ONLINE ONLINE oel19db2 STABLE
ora.ons
ONLINE ONLINE oel19db1 STABLE
ONLINE ONLINE oel19db2 STABLE
ora.proxy_advm
OFFLINE OFFLINE oel19db1 STABLE
OFFLINE OFFLINE oel19db2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE ONLINE oel19db2 STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE ONLINE oel19db2 STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE oel19db2 STABLE
ora.OCR_VOTE.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE ONLINE oel19db2 STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE oel19db1 Started,STABLE
2 ONLINE ONLINE oel19db2 Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE ONLINE oel19db2 STABLE
ora.cvu
1 ONLINE ONLINE oel19db2 STABLE
ora.oel19db1.vip
1 ONLINE ONLINE oel19db1 STABLE
ora.oel19db2.vip
1 ONLINE ONLINE oel19db2 STABLE
ora.oradb.db
1 ONLINE ONLINE oel19db1 Open,HOME=/oracle/ap
p/oracle/product/19c
,STABLE
2 ONLINE ONLINE oel19db2 Open,HOME=/oracle/ap
p/oracle/product/19c
,STABLE
ora.qosmserver
1 ONLINE ONLINE oel19db2 STABLE
ora.scan1.vip
1 ONLINE ONLINE oel19db2 STABLE
--------------------------------------------------------------------------------
|
모두 정상
테스트 전 /etc /opt 에 oracle 관련 파일 확인
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
|
# cd /etc/
# ls -al ora*
-rw-r--r-- 1 root root 16 Dec 29 08:18 oracle.ahf.loc
-rw-r--r-- 1 root root 32 Nov 16 03:29 oracle-release
-rw-rw-r-- 1 oracle dba 741 Dec 29 09:20 oratab
oracle:
total 4132
drwxr-xr-x 6 root dba 151 Dec 29 09:20 .
drwxr-xr-x. 151 root root 8192 Dec 31 23:13 ..
drwxrwx--- 2 root dba 64 Dec 29 09:21 lastgasp
drwxrwxrwt 2 root dba 6 Dec 29 09:20 maps
-rw-r--r-- 1 root dba 81 Dec 29 09:20 ocr.loc
-rw-r--r-- 1 root root 0 Dec 29 09:20 ocr.loc.orig
-rw-r--r-- 1 root dba 100 Dec 29 09:20 olr.loc
-rw-r--r-- 1 root root 0 Dec 29 09:20 olr.loc.orig
drwxrwxr-x 5 root dba 44 Dec 29 09:20 oprocd
drwxr-xr-x 3 root dba 22 Dec 29 09:20 scls_scr
-rws--x--- 1 root dba 4207056 Dec 29 09:20 setasmgid
# cd /etc/oracle
# cat ocr.loc
ocrconfig_loc=+OCR_VOTE/oel19db/OCRFILE/registry.255.1086015727
local_only=FALSE
# cat olr.loc
olrconfig_loc=/oracle/app/oracle/crsdata/oel19db1/olr/oel19db1_19.olr
crs_home=/oracle/app/grid/19c
# cd /opt
# ls -al ora*
oracle:
total 0
drwxr-xr-x. 3 root root 20 Oct 15 09:38 .
drwxr-xr-x. 5 root root 54 Oct 9 22:33 ..
drwxr-xr-x. 3 root root 16 Oct 15 09:38 extapi
oracle.ahf:
total 220
drwxr-xr-x 13 root root 214 Dec 27 21:02 .
drwxr-xr-x. 5 root root 54 Oct 9 22:33 ..
drwxr-xr-x 5 root root 43 Jun 29 2021 ahf
drwxr-x--x 2 root root 6 Oct 15 14:59 analyzer
drwxr-xr-x 2 root root 60 Oct 15 15:00 bin
drwxr-xr-x 3 root root 17 Dec 27 21:02 chm
drwxr-xr-x 7 root root 64 Dec 27 21:02 common
-rw-r--r-- 1 root root 1078 Dec 27 21:02 install.properties
drwxr-x--x 6 root root 198 Dec 27 21:02 jre
drwxr-xr-x 7 root root 251 Dec 27 21:02 orachk
-rwxrw-r-- 1 root dba 6300 Oct 15 15:07 prwinit.ora
-rwxr-xr-x 1 root root 210519 Oct 15 15:07 prw.sh
drwxr-xr-x 2 root root 22 Oct 15 15:07 PRW_SYS_oel19db1
drwxr-xr-x 6 root root 206 Dec 27 21:02 python
drwx------ 2 root root 57 Dec 27 21:02 rpms
drwxr-x--x 10 root root 225 Dec 27 21:08 tfa
|
장애 발생(grid 종료 후 /etc/ /opt 에 oracle 관련 파일 제거)(양쪽 노드)
1
2
3
|
# crsctl stop crs
# rm -rf /etc/ora*
# rm -rf /opt/ora*
|
grid 기동 시도
1
2
3
|
# crsctl start crs
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Start failed, or completed with errors.
|
기동되지 않음
장애 조치
deconfig 진행(1번 노드)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
|
# $GRID_HOME/perl/bin/perl $GRID_HOME/crs/install/rootcrs.pl -deconfig -force -verbose
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/app/oracle/crsdata/oel19db1/crsconfig/crsdeconfig_oel19db1_2022-01-06_04-41-18PM.log
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:41:24 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Check failed, or completed with errors.
2022/01/06 16:41:34 CLSRSC-463: The deconfiguration or downgrade script could not stop current Oracle Clusterware stack.
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 16:41:45 CLSRSC-557: Oracle Clusterware stack on this node has been successfully deconfigured. There were some errors which can be ignored.
|
정상적으로 deconfig됨
deconfig 진행(2번 노드)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
|
# $GRID_HOME/perl/bin/perl $GRID_HOME/crs/install/rootcrs.pl -deconfig -force -verbose -keepdg -lastnode
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/app/oracle/crsdata/oel19db2/crsconfig/crsdeconfig_oel19db2_2022-01-06_04-42-25PM.log
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop cvu -f'
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove cvu -f'
2022/01/06 16:42:32 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg4.log' does not exist
2022/01/06 16:42:32 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg4.log' does not exist
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop scan_listener -f'
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove scan_listener -y -f'
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop scan -f'
2022/01/06 16:42:32 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg7.log' does not exist
2022/01/06 16:42:32 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg7.log' does not exist
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:33 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove scan -y -f'
2022/01/06 16:42:33 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg8.log' does not exist
2022/01/06 16:42:33 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg8.log' does not exist
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:33 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Check failed, or completed with errors.
2022/01/06 16:42:33 CLSRSC-191: Failed to stop Oracle Clusterware stack
Died at /oracle/app/grid/19c/crs/install/crsdeconfig.pm line 479.
|
1번 노드 deconfig 와는 다르게 메세지에 에러가 많이 발생함
에러가 발생하지 않고 Oracle Clusterware stack on this node has been successfully deconfigured.가 나오면
바로 다음단계 진행
2번 노드 lastnode 명령 빼고 deconfig 재진행
1
2
3
4
5
6
7
8
9
10
11
12
13
14
|
# $GRID_HOME/perl/bin/perl $GRID_HOME/crs/install/rootcrs.pl -deconfig -force -verbose -keepdg
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/app/oracle/crsdata/oel19db2/crsconfig/crsdeconfig_oel19db2_2022-01-06_04-46-49PM.log
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:46:55 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Check failed, or completed with errors.
2022/01/06 16:47:06 CLSRSC-463: The deconfiguration or downgrade script could not stop current Oracle Clusterware stack.
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 16:47:17 CLSRSC-557: Oracle Clusterware stack on this node has been successfully deconfigured. There were some errors which can be ignored.
|
정상적으로 deconfig됨
*rootcrs.sh 를 이용해도되지만
rootcrs.sh 를 사용할 경우 이후 root.sh 를 양쪽 노드에서 실행해도 crsctl stat res -t 로 봤을때
DATA diskgroup 리소스와 db 리소스가 미등록되어있음( 오라클 19c RAC Grid 문제 시 재설치 가이드 https://positivemh.tistory.com/802 )의[asmca로 DATA diskgroup mount] 부분과 [db 리소스 등록] 까지 해줘야 정상적으로 사용이 가능함
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
|
1번 노드
# $GRID_HOME/crs/install/rootcrs.sh -deconfig -force -keepdg
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/app/oracle/crsdata/oel19db1/crsconfig/crsdeconfig_oel19db1_2022-01-06_09-54-14PM.log
PRCR-1070 : Failed to check if resource ora.net1.network is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.helper is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.ons is registered
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:54:20 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 21:54:41 CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node
2번 노드
# $GRID_HOME/crs/install/rootcrs.sh -deconfig -force -keepdg -lastnode
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/app/oracle/crsdata/oel19db2/crsconfig/crsdeconfig_oel19db2_2022-01-06_09-55-23PM.log
PRCR-1070 : Failed to check if resource ora.cvu is registered
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:55:31 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop cvu -f'
PRCR-1070 : Failed to check if resource ora.cvu is registered
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:55:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove cvu -f'
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:55:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop scan_listener -f'
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:55:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove scan_listener -y -f'
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:55:33 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop scan -f'
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:55:33 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove scan -y -f'
PRCR-1070 : Failed to check if resource ora.net1.network is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.helper is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.ons is registered
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:55:34 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
CRS-2673: Attempting to stop 'ora.crsd' on 'oel19db2'
CRS-2677: Stop of 'ora.crsd' on 'oel19db2' succeeded
ASM de-configuration trace file location: /oracle/app/oracle/cfgtoollogs/asmca/asmcadc_clean2022-01-06_09-57-35PM.log
ASM Clean Configuration START
ASM Clean Configuration END
ASM instance deleted successfully. Check /oracle/app/oracle/cfgtoollogs/asmca/asmcadc_clean2022-01-06_09-57-35PM.log for details.
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 21:59:14 CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node
2022/01/06 21:59:14 CLSRSC-559: Ensure that the GPnP profile data under the 'gpnp' directory in /oracle/app/grid/19c is deleted on each node before using the software in the current Grid Infrastructure home for reconfiguration.
|
root.sh 진행(deconfig 이후 config 작업)(1번 노드)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
|
# cd $GRID_HOME/
# sh root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /oracle/app/grid/19c
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/app/oracle/crsdata/oel19db1/crsconfig/rootcrs_oel19db1_2022-01-06_04-48-54PM.log
2022/01/06 16:48:57 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2022/01/06 16:48:58 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2022/01/06 16:48:58 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2022/01/06 16:48:59 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2022/01/06 16:48:59 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 16:49:00 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2022/01/06 16:49:00 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2022/01/06 16:49:02 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2022/01/06 16:49:02 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2022/01/06 16:49:06 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2022/01/06 16:49:06 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2022/01/06 16:49:08 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2022/01/06 16:49:08 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2022/01/06 16:49:24 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2022/01/06 16:49:24 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2022/01/06 16:49:43 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2022/01/06 16:49:45 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
2022/01/06 16:49:55 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2022/01/06 16:50:09 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2022/01/06 16:50:53 CLSRSC-343: Successfully started Oracle Clusterware stack
2022/01/06 16:50:53 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2022/01/06 16:51:04 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2022/01/06 16:51:08 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
|
Grid Configure가 정상적으로 succeeded 됨
grid 상태 확인(1번 노드)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
|
# crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE oel19db1 STABLE
ora.chad
OFFLINE OFFLINE oel19db1 STABLE
ora.net1.network
ONLINE ONLINE oel19db1 STABLE
ora.ons
ONLINE ONLINE oel19db1 STABLE
ora.proxy_advm
OFFLINE OFFLINE oel19db1 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE oel19db1 STABLE
ora.OCR_VOTE.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 OFFLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE oel19db1 Started,STABLE
2 ONLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE oel19db1 STABLE
ora.oel19db1.vip
1 ONLINE ONLINE oel19db1 STABLE
ora.oel19db2.vip
1 ONLINE INTERMEDIATE oel19db1 FAILED OVER,STABLE
ora.oradb.db
1 ONLINE ONLINE oel19db1 Open,HOME=/oracle/ap
p/oracle/product/19c
,STABLE
2 ONLINE OFFLINE STABLE
ora.qosmserver
1 ONLINE ONLINE oel19db1 STABLE
ora.scan1.vip
1 ONLINE ONLINE oel19db1 STABLE
--------------------------------------------------------------------------------
|
1번 노드는 정상적으로 올라옴
root.sh 진행(deconfig 이후 config 작업)(2번 노드)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
|
# cd $GRID_HOME/
# sh root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /oracle/app/grid/19c
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/app/oracle/crsdata/oel19db2/crsconfig/rootcrs_oel19db2_2022-01-06_04-55-01PM.log
2022/01/06 16:55:03 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2022/01/06 16:55:03 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2022/01/06 16:55:03 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2022/01/06 16:55:04 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2022/01/06 16:55:04 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 16:55:05 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2022/01/06 16:55:05 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2022/01/06 16:55:06 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2022/01/06 16:55:06 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2022/01/06 16:55:09 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2022/01/06 16:55:09 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2022/01/06 16:55:10 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2022/01/06 16:55:10 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2022/01/06 16:55:25 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2022/01/06 16:55:25 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2022/01/06 16:55:43 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2022/01/06 16:55:44 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
2022/01/06 16:55:53 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2022/01/06 16:56:19 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2022/01/06 16:56:30 CLSRSC-343: Successfully started Oracle Clusterware stack
2022/01/06 16:56:30 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2022/01/06 16:56:37 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2022/01/06 16:56:49 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
|
Grid Configure가 정상적으로 succeeded 됨
grid 상태 확인(2번 노드)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
|
# crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE oel19db1 STABLE
ONLINE ONLINE oel19db2 STABLE
ora.chad
OFFLINE OFFLINE oel19db1 STABLE
OFFLINE OFFLINE oel19db2 STABLE
ora.net1.network
ONLINE ONLINE oel19db1 STABLE
ONLINE ONLINE oel19db2 STABLE
ora.ons
ONLINE ONLINE oel19db1 STABLE
ONLINE ONLINE oel19db2 STABLE
ora.proxy_advm
OFFLINE OFFLINE oel19db1 STABLE
OFFLINE OFFLINE oel19db2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE ONLINE oel19db2 STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE ONLINE oel19db2 STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE oel19db1 STABLE
ora.OCR_VOTE.dg(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE ONLINE oel19db2 STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE oel19db1 Started,STABLE
2 ONLINE ONLINE oel19db2 Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE oel19db1 STABLE
2 ONLINE ONLINE oel19db2 STABLE
ora.cvu
1 ONLINE ONLINE oel19db1 STABLE
ora.oel19db1.vip
1 ONLINE ONLINE oel19db1 STABLE
ora.oel19db2.vip
1 ONLINE ONLINE oel19db2 STABLE
ora.oradb.db
1 ONLINE ONLINE oel19db1 Open,HOME=/oracle/ap
p/oracle/product/19c
,STABLE
2 ONLINE ONLINE oel19db2 Open,HOME=/oracle/ap
p/oracle/product/19c
,STABLE
ora.qosmserver
1 ONLINE ONLINE oel19db1 STABLE
ora.scan1.vip
1 ONLINE ONLINE oel19db1 STABLE
--------------------------------------------------------------------------------
|
1번, 2번 모두 정상화됨
OFFLINE 되어있는 ora.chad 기동
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
|
# srvctl start cha
# crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
.
.
ora.chad
ONLINE ONLINE oel19db1 STABLE
ONLINE ONLINE oel19db2 STABLE
.
.
|
ONLINE 됨
db 상태 확인
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
|
# su - oracle
$ sqlplus / as sysdba
SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 6 17:00:20 2022
Version 19.12.0.0.0
Copyright (c) 1982, 2021, Oracle. All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.12.0.0.0
SQL> select instance_name, version, status from gv$instance;
INSTANCE_NAME VERSION STATUS
---------------- ----------------- ------------
ORADB1 19.0.0.0.0 OPEN
ORADB2 19.0.0.0.0 OPEN
|
db 상태도 정상임
참조 : 1377349.1, 1354258.1, 2571719.1, 563048.1, 556834.1
https://docs.oracle.com/en/database/oracle/oracle-database/19/cwlin/unconfiguring-oracle-clusterware-without-removing-binaries.html#GUID-41C5E8EE-68F9-4849-B4B8-BD82D4A17A57
https://pat98.tistory.com/1068
https://www.krenger.ch/blog/asm-device-devxvdc1-is-already-labeled-for-asm-disk
https://positivemh.tistory.com/764
https://positivemh.tistory.com/802
'ORACLE > Rac' 카테고리의 다른 글
오라클 11g R2 RAC OS 커널 패치시 작업 가이드 (0) | 2022.01.15 |
---|---|
오라클 19c RAC Grid 문제 시 재설치 가이드 (0) | 2022.01.05 |
오라클 19c RAC ora.chad 리소스 offline 인 경우 조치방안 (0) | 2021.12.31 |
오라클 19c RAC sqlnet.ora SQLNET.AUTHENTICATION_SERVICES = (NONE) 설정 시 발생하는 문제 (0) | 2021.12.26 |
오라클 19c RAC OS 커널 패치시 작업 가이드 (0) | 2021.12.06 |