프린트 하기

OS환경 : Oracle Linux 8.5 (64bit)

 

DB 환경 : Oracle Database 19.12.0.0 RAC

 

방법 : 오라클 19c RAC /etc /opt 등 파일이 제거된 경우 조치방안

오라클 19c ASM RAC 환경에서 GRID엔진 경로는 변경이나 문제가 없지만

OS 이슈등 특정 이유로 인해 오라클이 사용하는 /etc 밑의 데이터나 /opt 밑의 데이터들이 제거된 경우

RAC를 정상적으로 기동할 수 없음

이때 조치방안을 설명함

 

 

테스트 전 상태 확인

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
# crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       oel19db1                 STABLE
               ONLINE  ONLINE       oel19db2                 STABLE
ora.chad
               ONLINE  ONLINE       oel19db1                 STABLE
               ONLINE  ONLINE       oel19db2                 STABLE
ora.net1.network
               ONLINE  ONLINE       oel19db1                 STABLE
               ONLINE  ONLINE       oel19db2                 STABLE
ora.ons
               ONLINE  ONLINE       oel19db1                 STABLE
               ONLINE  ONLINE       oel19db2                 STABLE
ora.proxy_advm
               OFFLINE OFFLINE      oel19db1                 STABLE
               OFFLINE OFFLINE      oel19db2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  ONLINE       oel19db2                 STABLE
ora.DATA.dg(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  ONLINE       oel19db2                 STABLE
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       oel19db2                 STABLE
ora.OCR_VOTE.dg(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  ONLINE       oel19db2                 STABLE
ora.asm(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 Started,STABLE
      2        ONLINE  ONLINE       oel19db2                 Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  ONLINE       oel19db2                 STABLE
ora.cvu
      1        ONLINE  ONLINE       oel19db2                 STABLE
ora.oel19db1.vip
      1        ONLINE  ONLINE       oel19db1                 STABLE
ora.oel19db2.vip
      1        ONLINE  ONLINE       oel19db2                 STABLE
ora.oradb.db
      1        ONLINE  ONLINE       oel19db1                 Open,HOME=/oracle/ap
                                                             p/oracle/product/19c
                                                             ,STABLE
      2        ONLINE  ONLINE       oel19db2                 Open,HOME=/oracle/ap
                                                             p/oracle/product/19c
                                                             ,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       oel19db2                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       oel19db2                 STABLE
--------------------------------------------------------------------------------

모두 정상

 

 

테스트 전 /etc /opt 에 oracle 관련 파일 확인

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
# cd /etc/
# ls -al ora*
-rw-r--r-- 1 root   root      16 Dec 29 08:18 oracle.ahf.loc
-rw-r--r-- 1 root   root      32 Nov 16 03:29 oracle-release
-rw-rw-r-- 1 oracle dba      741 Dec 29 09:20 oratab
 
oracle:
total 4132
drwxr-xr-x    6 root dba      151 Dec 29 09:20 .
drwxr-xr-x. 151 root root    8192 Dec 31 23:13 ..
drwxrwx---    2 root dba       64 Dec 29 09:21 lastgasp
drwxrwxrwt    2 root dba        6 Dec 29 09:20 maps
-rw-r--r--    1 root dba       81 Dec 29 09:20 ocr.loc
-rw-r--r--    1 root root       0 Dec 29 09:20 ocr.loc.orig
-rw-r--r--    1 root dba      100 Dec 29 09:20 olr.loc
-rw-r--r--    1 root root       0 Dec 29 09:20 olr.loc.orig
drwxrwxr-x    5 root dba       44 Dec 29 09:20 oprocd
drwxr-xr-x    3 root dba       22 Dec 29 09:20 scls_scr
-rws--x---    1 root dba  4207056 Dec 29 09:20 setasmgid
 
# cd /etc/oracle
# cat ocr.loc
ocrconfig_loc=+OCR_VOTE/oel19db/OCRFILE/registry.255.1086015727
local_only=FALSE
 
# cat olr.loc
olrconfig_loc=/oracle/app/oracle/crsdata/oel19db1/olr/oel19db1_19.olr
crs_home=/oracle/app/grid/19c
 
# cd /opt
# ls -al ora*
oracle:
total 0
drwxr-xr-x. 3 root root 20 Oct 15 09:38 .
drwxr-xr-x. 5 root root 54 Oct  9 22:33 ..
drwxr-xr-x. 3 root root 16 Oct 15 09:38 extapi
 
oracle.ahf:
total 220
drwxr-xr-x  13 root root    214 Dec 27 21:02 .
drwxr-xr-x.  5 root root     54 Oct  9 22:33 ..
drwxr-xr-x   5 root root     43 Jun 29  2021 ahf
drwxr-x--x   2 root root      6 Oct 15 14:59 analyzer
drwxr-xr-x   2 root root     60 Oct 15 15:00 bin
drwxr-xr-x   3 root root     17 Dec 27 21:02 chm
drwxr-xr-x   7 root root     64 Dec 27 21:02 common
-rw-r--r--   1 root root   1078 Dec 27 21:02 install.properties
drwxr-x--x   6 root root    198 Dec 27 21:02 jre
drwxr-xr-x   7 root root    251 Dec 27 21:02 orachk
-rwxrw-r--   1 root dba    6300 Oct 15 15:07 prwinit.ora
-rwxr-xr-x   1 root root 210519 Oct 15 15:07 prw.sh
drwxr-xr-x   2 root root     22 Oct 15 15:07 PRW_SYS_oel19db1
drwxr-xr-x   6 root root    206 Dec 27 21:02 python
drwx------   2 root root     57 Dec 27 21:02 rpms
drwxr-x--x  10 root root    225 Dec 27 21:08 tfa

 

 

장애 발생(grid 종료 후 /etc/ /opt 에 oracle 관련 파일 제거)(양쪽 노드)

1
2
3
# crsctl stop crs
# rm -rf /etc/ora*
# rm -rf /opt/ora*

 

 

grid 기동 시도

1
2
3
# crsctl start crs
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Start failed, or completed with errors.

기동되지 않음

 

 

장애 조치

deconfig 진행(1번 노드)

1
2
3
4
5
6
7
8
9
10
11
12
13
14
# $GRID_HOME/perl/bin/perl $GRID_HOME/crs/install/rootcrs.pl -deconfig -force -verbose
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
  /oracle/app/oracle/crsdata/oel19db1/crsconfig/crsdeconfig_oel19db1_2022-01-06_04-41-18PM.log
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:41:24 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Check failed, or completed with errors.
2022/01/06 16:41:34 CLSRSC-463: The deconfiguration or downgrade script could not stop current Oracle Clusterware stack.
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 16:41:45 CLSRSC-557: Oracle Clusterware stack on this node has been successfully deconfigured. There were some errors which can be ignored.

정상적으로 deconfig됨

 

 

deconfig 진행(2번 노드)

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
# $GRID_HOME/perl/bin/perl $GRID_HOME/crs/install/rootcrs.pl -deconfig -force -verbose -keepdg -lastnode
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
  /oracle/app/oracle/crsdata/oel19db2/crsconfig/crsdeconfig_oel19db2_2022-01-06_04-42-25PM.log
****Unable to retrieve Oracle Clusterware home.
 
Start Oracle Clusterware stack and try again.
 
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop cvu -f'
****Unable to retrieve Oracle Clusterware home.
 
Start Oracle Clusterware stack and try again.
 
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove cvu -f'
2022/01/06 16:42:32 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg4.log' does not exist
2022/01/06 16:42:32 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg4.log' does not exist
****Unable to retrieve Oracle Clusterware home.
 
Start Oracle Clusterware stack and try again.
 
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop scan_listener -f'
****Unable to retrieve Oracle Clusterware home.
 
Start Oracle Clusterware stack and try again.
 
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove scan_listener -y -f'
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop scan -f'
2022/01/06 16:42:32 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg7.log' does not exist
2022/01/06 16:42:32 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg7.log' does not exist
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:33 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove scan -y -f'
2022/01/06 16:42:33 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg8.log' does not exist
2022/01/06 16:42:33 CLSRSC-46: Error: '/oracle/app/oracle/crsdata/oel19db2/crsconfig/srvmcfg8.log' does not exist
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:42:33 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Check failed, or completed with errors.
2022/01/06 16:42:33 CLSRSC-191: Failed to stop Oracle Clusterware stack
Died at /oracle/app/grid/19c/crs/install/crsdeconfig.pm line 479.

1번 노드 deconfig 와는 다르게 메세지에 에러가 많이 발생함

에러가 발생하지 않고 Oracle Clusterware stack on this node has been successfully deconfigured.가 나오면

바로 다음단계 진행

 

 

2번 노드 lastnode 명령 빼고 deconfig 재진행

1
2
3
4
5
6
7
8
9
10
11
12
13
14
# $GRID_HOME/perl/bin/perl $GRID_HOME/crs/install/rootcrs.pl -deconfig -force -verbose -keepdg
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
  /oracle/app/oracle/crsdata/oel19db2/crsconfig/crsdeconfig_oel19db2_2022-01-06_04-46-49PM.log
****Unable to retrieve Oracle Clusterware home.
Start Oracle Clusterware stack and try again.
2022/01/06 16:46:55 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Check failed, or completed with errors.
2022/01/06 16:47:06 CLSRSC-463: The deconfiguration or downgrade script could not stop current Oracle Clusterware stack.
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 16:47:17 CLSRSC-557: Oracle Clusterware stack on this node has been successfully deconfigured. There were some errors which can be ignored.

정상적으로 deconfig됨

 

 

*rootcrs.sh 를 이용해도되지만 

rootcrs.sh 를 사용할 경우 이후 root.sh 를 양쪽 노드에서 실행해도 crsctl stat res -t 로 봤을때

DATA diskgroup 리소스와 db 리소스가 미등록되어있음( 오라클 19c RAC Grid 문제 시 재설치 가이드 https://positivemh.tistory.com/802 )의[asmca로 DATA diskgroup mount] 부분과 [db 리소스 등록] 까지 해줘야 정상적으로 사용이 가능함

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
1번 노드
# $GRID_HOME/crs/install/rootcrs.sh -deconfig -force -keepdg
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
  /oracle/app/oracle/crsdata/oel19db1/crsconfig/crsdeconfig_oel19db1_2022-01-06_09-54-14PM.log
PRCR-1070 : Failed to check if resource ora.net1.network is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.helper is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.ons is registered
CRS-0184 : Cannot communicate with the CRS daemon.
 
2022/01/06 21:54:20 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 21:54:41 CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node
 
2번 노드
# $GRID_HOME/crs/install/rootcrs.sh -deconfig -force -keepdg -lastnode
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
  /oracle/app/oracle/crsdata/oel19db2/crsconfig/crsdeconfig_oel19db2_2022-01-06_09-55-23PM.log
PRCR-1070 : Failed to check if resource ora.cvu is registered
 
CRS-0184 : Cannot communicate with the CRS daemon.
 
2022/01/06 21:55:31 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop cvu -f'
PRCR-1070 : Failed to check if resource ora.cvu is registered
 
CRS-0184 : Cannot communicate with the CRS daemon.
 
2022/01/06 21:55:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove cvu -f'
PRCR-1068 : Failed to query resources
 
CRS-0184 : Cannot communicate with the CRS daemon.
 
2022/01/06 21:55:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop scan_listener -f'
PRCR-1068 : Failed to query resources
 
CRS-0184 : Cannot communicate with the CRS daemon.
 
2022/01/06 21:55:32 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove scan_listener -y -f'
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:55:33 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl stop scan -f'
PRCR-1068 : Failed to query resources
CRS-0184 : Cannot communicate with the CRS daemon.
2022/01/06 21:55:33 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl remove scan -y -f'
PRCR-1070 : Failed to check if resource ora.net1.network is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.helper is registered
CRS-0184 : Cannot communicate with the CRS daemon.
PRCR-1070 : Failed to check if resource ora.ons is registered
CRS-0184 : Cannot communicate with the CRS daemon.
 
2022/01/06 21:55:34 CLSRSC-180: An error occurred while executing the command '/oracle/app/grid/19c/bin/srvctl config nodeapps'
CRS-2673: Attempting to stop 'ora.crsd' on 'oel19db2'
CRS-2677: Stop of 'ora.crsd' on 'oel19db2' succeeded
 
ASM de-configuration trace file location: /oracle/app/oracle/cfgtoollogs/asmca/asmcadc_clean2022-01-06_09-57-35PM.log
ASM Clean Configuration START
ASM Clean Configuration END
 
ASM instance deleted successfully. Check /oracle/app/oracle/cfgtoollogs/asmca/asmcadc_clean2022-01-06_09-57-35PM.log for details.
 
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 21:59:14 CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node
2022/01/06 21:59:14 CLSRSC-559: Ensure that the GPnP profile data under the 'gpnp' directory in /oracle/app/grid/19c is deleted on each node before using the software in the current Grid Infrastructure home for reconfiguration.

 

 

root.sh 진행(deconfig 이후 config 작업)(1번 노드)

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
# cd $GRID_HOME/
# sh root.sh
Performing root user operation.
 
The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /oracle/app/grid/19c
 
Enter the full pathname of the local bin directory: [/usr/local/bin]: 
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
 
 
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
  /oracle/app/oracle/crsdata/oel19db1/crsconfig/rootcrs_oel19db1_2022-01-06_04-48-54PM.log
2022/01/06 16:48:57 CLSRSC-594: Executing installation step 1 of 19'SetupTFA'.
2022/01/06 16:48:58 CLSRSC-594: Executing installation step 2 of 19'ValidateEnv'.
2022/01/06 16:48:58 CLSRSC-594: Executing installation step 3 of 19'CheckFirstNode'.
2022/01/06 16:48:59 CLSRSC-594: Executing installation step 4 of 19'GenSiteGUIDs'.
2022/01/06 16:48:59 CLSRSC-594: Executing installation step 5 of 19'SetupOSD'.
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 16:49:00 CLSRSC-594: Executing installation step 6 of 19'CheckCRSConfig'.
2022/01/06 16:49:00 CLSRSC-594: Executing installation step 7 of 19'SetupLocalGPNP'.
2022/01/06 16:49:02 CLSRSC-594: Executing installation step 8 of 19'CreateRootCert'.
2022/01/06 16:49:02 CLSRSC-594: Executing installation step 9 of 19'ConfigOLR'.
2022/01/06 16:49:06 CLSRSC-594: Executing installation step 10 of 19'ConfigCHMOS'.
2022/01/06 16:49:06 CLSRSC-594: Executing installation step 11 of 19'CreateOHASD'.
2022/01/06 16:49:08 CLSRSC-594: Executing installation step 12 of 19'ConfigOHASD'.
2022/01/06 16:49:08 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2022/01/06 16:49:24 CLSRSC-594: Executing installation step 13 of 19'InstallAFD'.
2022/01/06 16:49:24 CLSRSC-594: Executing installation step 14 of 19'InstallACFS'.
2022/01/06 16:49:43 CLSRSC-594: Executing installation step 15 of 19'InstallKA'.
2022/01/06 16:49:45 CLSRSC-594: Executing installation step 16 of 19'InitConfig'.
2022/01/06 16:49:55 CLSRSC-594: Executing installation step 17 of 19'StartCluster'.
2022/01/06 16:50:09 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2022/01/06 16:50:53 CLSRSC-343: Successfully started Oracle Clusterware stack
2022/01/06 16:50:53 CLSRSC-594: Executing installation step 18 of 19'ConfigNode'.
2022/01/06 16:51:04 CLSRSC-594: Executing installation step 19 of 19'PostConfig'.
2022/01/06 16:51:08 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

Grid Configure가 정상적으로 succeeded 됨

 

 

grid 상태 확인(1번 노드)

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
# crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       oel19db1                 STABLE
ora.chad
               OFFLINE OFFLINE      oel19db1                 STABLE
ora.net1.network
               ONLINE  ONLINE       oel19db1                 STABLE
ora.ons
               ONLINE  ONLINE       oel19db1                 STABLE
ora.proxy_advm
               OFFLINE OFFLINE      oel19db1                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  OFFLINE                               STABLE
ora.DATA.dg(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        OFFLINE OFFLINE                               STABLE
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       oel19db1                 STABLE
ora.OCR_VOTE.dg(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        OFFLINE OFFLINE                               STABLE
ora.asm(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 Started,STABLE
      2        ONLINE  OFFLINE                               STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       oel19db1                 STABLE
ora.oel19db1.vip
      1        ONLINE  ONLINE       oel19db1                 STABLE
ora.oel19db2.vip
      1        ONLINE  INTERMEDIATE oel19db1                 FAILED OVER,STABLE
ora.oradb.db
      1        ONLINE  ONLINE       oel19db1                 Open,HOME=/oracle/ap
                                                             p/oracle/product/19c
                                                             ,STABLE
      2        ONLINE  OFFLINE                               STABLE
ora.qosmserver
      1        ONLINE  ONLINE       oel19db1                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       oel19db1                 STABLE
--------------------------------------------------------------------------------

1번 노드는 정상적으로 올라옴

 

 

root.sh 진행(deconfig 이후 config 작업)(2번 노드)

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
# cd $GRID_HOME/
# sh root.sh
Performing root user operation.
 
The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /oracle/app/grid/19c
 
Enter the full pathname of the local bin directory: [/usr/local/bin]: 
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
 
 
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /oracle/app/grid/19c/crs/install/crsconfig_params
The log of current session can be found at:
  /oracle/app/oracle/crsdata/oel19db2/crsconfig/rootcrs_oel19db2_2022-01-06_04-55-01PM.log
2022/01/06 16:55:03 CLSRSC-594: Executing installation step 1 of 19'SetupTFA'.
2022/01/06 16:55:03 CLSRSC-594: Executing installation step 2 of 19'ValidateEnv'.
2022/01/06 16:55:03 CLSRSC-594: Executing installation step 3 of 19'CheckFirstNode'.
2022/01/06 16:55:04 CLSRSC-594: Executing installation step 4 of 19'GenSiteGUIDs'.
2022/01/06 16:55:04 CLSRSC-594: Executing installation step 5 of 19'SetupOSD'.
Redirecting to /bin/systemctl restart rsyslog.service
2022/01/06 16:55:05 CLSRSC-594: Executing installation step 6 of 19'CheckCRSConfig'.
2022/01/06 16:55:05 CLSRSC-594: Executing installation step 7 of 19'SetupLocalGPNP'.
2022/01/06 16:55:06 CLSRSC-594: Executing installation step 8 of 19'CreateRootCert'.
2022/01/06 16:55:06 CLSRSC-594: Executing installation step 9 of 19'ConfigOLR'.
2022/01/06 16:55:09 CLSRSC-594: Executing installation step 10 of 19'ConfigCHMOS'.
2022/01/06 16:55:09 CLSRSC-594: Executing installation step 11 of 19'CreateOHASD'.
2022/01/06 16:55:10 CLSRSC-594: Executing installation step 12 of 19'ConfigOHASD'.
2022/01/06 16:55:10 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2022/01/06 16:55:25 CLSRSC-594: Executing installation step 13 of 19'InstallAFD'.
2022/01/06 16:55:25 CLSRSC-594: Executing installation step 14 of 19'InstallACFS'.
2022/01/06 16:55:43 CLSRSC-594: Executing installation step 15 of 19'InstallKA'.
2022/01/06 16:55:44 CLSRSC-594: Executing installation step 16 of 19'InitConfig'.
2022/01/06 16:55:53 CLSRSC-594: Executing installation step 17 of 19'StartCluster'.
2022/01/06 16:56:19 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2022/01/06 16:56:30 CLSRSC-343: Successfully started Oracle Clusterware stack
2022/01/06 16:56:30 CLSRSC-594: Executing installation step 18 of 19'ConfigNode'.
2022/01/06 16:56:37 CLSRSC-594: Executing installation step 19 of 19'PostConfig'.
2022/01/06 16:56:49 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

Grid Configure가 정상적으로 succeeded 됨

 

 

grid 상태 확인(2번 노드)

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
# crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       oel19db1                 STABLE
               ONLINE  ONLINE       oel19db2                 STABLE
ora.chad
               OFFLINE OFFLINE      oel19db1                 STABLE
               OFFLINE OFFLINE      oel19db2                 STABLE
ora.net1.network
               ONLINE  ONLINE       oel19db1                 STABLE
               ONLINE  ONLINE       oel19db2                 STABLE
ora.ons
               ONLINE  ONLINE       oel19db1                 STABLE
               ONLINE  ONLINE       oel19db2                 STABLE
ora.proxy_advm
               OFFLINE OFFLINE      oel19db1                 STABLE
               OFFLINE OFFLINE      oel19db2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  ONLINE       oel19db2                 STABLE
ora.DATA.dg(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  ONLINE       oel19db2                 STABLE
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       oel19db1                 STABLE
ora.OCR_VOTE.dg(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  ONLINE       oel19db2                 STABLE
ora.asm(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 Started,STABLE
      2        ONLINE  ONLINE       oel19db2                 Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
      1        ONLINE  ONLINE       oel19db1                 STABLE
      2        ONLINE  ONLINE       oel19db2                 STABLE
ora.cvu
      1        ONLINE  ONLINE       oel19db1                 STABLE
ora.oel19db1.vip
      1        ONLINE  ONLINE       oel19db1                 STABLE
ora.oel19db2.vip
      1        ONLINE  ONLINE       oel19db2                 STABLE
ora.oradb.db
      1        ONLINE  ONLINE       oel19db1                 Open,HOME=/oracle/ap
                                                             p/oracle/product/19c
                                                             ,STABLE
      2        ONLINE  ONLINE       oel19db2                 Open,HOME=/oracle/ap
                                                             p/oracle/product/19c
                                                             ,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       oel19db1                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       oel19db1                 STABLE
--------------------------------------------------------------------------------

1번, 2번 모두 정상화됨

 

 

OFFLINE 되어있는 ora.chad 기동

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
# srvctl start cha
 
# crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
.
.
ora.chad
               ONLINE  ONLINE       oel19db1                 STABLE
               ONLINE  ONLINE       oel19db2                 STABLE
.
.

ONLINE 됨

 

 

db 상태 확인

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
# su - oracle
$ sqlplus / as sysdba
 
SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 6 17:00:20 2022
Version 19.12.0.0.0
 
Copyright (c) 19822021, Oracle.  All rights reserved.
 
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.12.0.0.0
 
SQL> select instance_name, version, status from gv$instance;
 
INSTANCE_NAME     VERSION       STATUS
---------------- ----------------- ------------
ORADB1         19.0.0.0.0       OPEN
ORADB2         19.0.0.0.0       OPEN

db 상태도 정상임

 

 

참조 : 1377349.1, 1354258.1, 2571719.1, 563048.1, 556834.1

https://docs.oracle.com/en/database/oracle/oracle-database/19/cwlin/unconfiguring-oracle-clusterware-without-removing-binaries.html#GUID-41C5E8EE-68F9-4849-B4B8-BD82D4A17A57
https://pat98.tistory.com/1068
https://www.krenger.ch/blog/asm-device-devxvdc1-is-already-labeled-for-asm-disk

https://positivemh.tistory.com/764

 

오라클 19c RAC 설치시 asmca GUI가 나오지 않을 때

OS환경 : Oracle Linux 8.4 (64bit) DB 환경 : Oracle Database 19.12.0.0 에러 : Oracle 19c RAC 설치시 asmca GUI가 나오지 않을 때 19c RAC 설치 시 Grid 는 정상적으로 GUI가 나와서 설치했지만 asmca..

positivemh.tistory.com

https://positivemh.tistory.com/802

 

오라클 19c RAC Grid 문제 시 재설치 가이드

OS환경 : Oracle Linux 8.5 (64bit) DB 환경 : Oracle Database 19.12.0.0 RAC 방법 : 오라클 19c RAC Grid 문제 시 재설치 가이드 [오라클 19c RAC /etc /opt 등 파일이 제거된 경우 조치방안 https://positivemh..

positivemh.tistory.com