OS 환경 : Oracle Linux 7.7 (64bit)
DB 환경 : Oracle Database 11.2.0.4
에러 : ORA-27091: unable to queue I/O
grid 설치시 root.sh 수행시 발생한 에러
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
|
# ./root.sh
Performing root user operation for Oracle 11g
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /oracle/app/grid/11g
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /oracle/app/grid/11g/crs/install/crsconfig_params
Creating trace directory
User ignored Prerequisites during installation
Installing Trace File Analyzer
OLR initialization - successful
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding Clusterware entries to oracle-ohasd.service
CRS-2672: Attempting to start 'ora.mdnsd' on 'ora11rac1'
CRS-2676: Start of 'ora.mdnsd' on 'ora11rac1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ora11rac1'
CRS-2676: Start of 'ora.gpnpd' on 'ora11rac1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ora11rac1'
CRS-2672: Attempting to start 'ora.gipcd' on 'ora11rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'ora11rac1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'ora11rac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ora11rac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'ora11rac1'
CRS-2676: Start of 'ora.diskmon' on 'ora11rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'ora11rac1' succeeded
ASM created and started successfully.
Disk Group OCRVOTE created successfully.
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Failed to create Oracle Cluster Registry configuration, rc 255
Oracle Grid Infrastructure Repository configuration failed at /oracle/app/grid/11g/crs/install/crsconfig_lib.pm line 6919.
/oracle/app/grid/11g/perl/bin/perl -I/oracle/app/grid/11g/perl/lib -I/oracle/app/grid/11g/crs/install /oracle/app/grid/11g/crs/install/rootcrs.pl execution failed
|
해결 방법 : oracleasm configure 재수행 및 oracleasm 디스크 재등록
oracleasm configure 시 owner를 oracle로 설정한 뒤 grid 유저로 grid를 설치한 상황임
oracleasm configure을 재실행해서 owner를 grid로 변경 후 oracleasm 등록된 디스크 제거후 재등록
완료 후 root.sh 재수행
현재 설정 확인
|
1
2
3
4
5
6
7
|
# oracleasm configure
ORACLEASM_UID=oracle
ORACLEASM_GID=dba
ORACLEASM_SCANBOOT=true
ORACLEASM_SCANORDER=""
ORACLEASM_SCANEXCLUDE=""
ORACLEASM_USE_LOGICAL_BLOCK_SIZE="false"
|
UID가 oracle로 되어있음
변경 및 재확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
|
# oracleasm configure -i
Configuring the Oracle ASM library driver.
This will configure the on-boot properties of the Oracle ASM library
driver. The following questions will determine whether the driver is
loaded on boot and what permissions it will have. The current values
will be shown in brackets ('[]'). Hitting <ENTER> without typing an
answer will keep that current value. Ctrl-C will abort.
Default user to own the driver interface [oracle]: grid
Default group to own the driver interface [dba]: dba
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
# oracleasm configure
ORACLEASM_UID=grid
ORACLEASM_GID=dba
ORACLEASM_SCANBOOT=true
ORACLEASM_SCANORDER=""
ORACLEASM_SCANEXCLUDE=""
ORACLEASM_USE_LOGICAL_BLOCK_SIZE="false"
|
정상적으로 변경됨
디스크 확인 후 oracleasm delete 후 create 재수행
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
|
# lsblk -o NAME,KNAME,FSTYPE,LABEL,SIZE,MOUNTPOINT
NAME KNAME FSTYPE LABEL SIZE MOUNTPOINT
sdd sdd 100G
└─sdd1 sdd1 LVM2_member 100G
└─11g_reco-RECO dm-3 oracleasm RECO01 99G
sdb sdb 20G
└─sdb1 sdb1 LVM2_member 20G
├─11g_ocrvote-OCRVOTE2 dm-4 oracleasm 2G
├─11g_ocrvote-OCRVOTE1 dm-2 oracleasm 2G
└─11g_ocrvote-OCRVOTE3 dm-5 oracleasm 2G
sr0 sr0 1024M
sdc sdc 30G
└─sdc1 sdc1 LVM2_member 30G
└─11g_data-DATA dm-6 oracleasm DATA01 29G
sda sda 100G
├─sda2 sda2 LVM2_member 88G
│ ├─ol-swap dm-1 swap 8G [SWAP]
│ └─ol-root dm-0 xfs 80G /
└─sda1 sda1 xfs 1G /boot
# dd if=/dev/zero of=/dev/mapper/11g_ocrvote-OCRVOTE1 bs=1M count=20
# dd if=/dev/zero of=/dev/mapper/11g_ocrvote-OCRVOTE2 bs=1M count=20
# dd if=/dev/zero of=/dev/mapper/11g_ocrvote-OCRVOTE3 bs=1M count=20
# oracleasm deletedisk OCR1
# oracleasm deletedisk OCR2
# oracleasm deletedisk OCR3
# oracleasm deletedisk DATA01
# oracleasm deletedisk RECO01
# oracleasm createdisk OCR1 /dev/11g_ocrvote/OCRVOTE1
# oracleasm createdisk OCR2 /dev/11g_ocrvote/OCRVOTE2
# oracleasm createdisk OCR3 /dev/11g_ocrvote/OCRVOTE3
# oracleasm createdisk DATA01 /dev/11g_data/DATA
# oracleasm createdisk RECO01 /dev/11g_reco/RECO
# oracleasm scandisks
# oracleasm listdisks
|
asm 경로 권한도 grid로 재부여
|
1
2
3
4
|
# chown -R grid:dba /dev/oracleasm
# chown -R grid:dba /dev/11g_ocrvote
# chown -R grid:dba /dev/11g_data
# chown -R grid:dba /dev/11g_reco
|
이후 root.sh 재수행
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 | # sh root.sh Performing root user operation for Oracle 11g The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /oracle/app/grid/11g Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Using configuration parameter file: /oracle/app/grid/11g/crs/install/crsconfig_params User ignored Prerequisites during installation Installing Trace File Analyzer CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ora11rac1' CRS-2676: Start of 'ora.cssdmonitor' on 'ora11rac1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'ora11rac1' CRS-2672: Attempting to start 'ora.diskmon' on 'ora11rac1' CRS-2676: Start of 'ora.diskmon' on 'ora11rac1' succeeded CRS-2676: Start of 'ora.cssd' on 'ora11rac1' succeeded ASM created and started successfully. Disk Group OCRVOTE mounted successfully. clscfg: -install mode specified Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. CRS-4256: Updating the profile Successful addition of voting disk 5607d7b0b2e44f00bf27fe2a05d8d27e. Successful addition of voting disk 5f85150c26ea4f28bf39527b96683e6c. Successful addition of voting disk ab8a0b7be01c4fcebf47f4a3ad87c1f3. Successfully replaced voting disk group with +OCRVOTE. CRS-4256: Updating the profile CRS-4266: Voting file(s) successfully replaced ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 5607d7b0b2e44f00bf27fe2a05d8d27e (ORCL:OCR1) [OCRVOTE] 2. ONLINE 5f85150c26ea4f28bf39527b96683e6c (ORCL:OCR2) [OCRVOTE] 3. ONLINE ab8a0b7be01c4fcebf47f4a3ad87c1f3 (ORCL:OCR3) [OCRVOTE] Located 3 voting disk(s). CRS-2672: Attempting to start 'ora.asm' on 'ora11rac1' CRS-2676: Start of 'ora.asm' on 'ora11rac1' succeeded CRS-2672: Attempting to start 'ora.OCRVOTE.dg' on 'ora11rac1' CRS-2676: Start of 'ora.OCRVOTE.dg' on 'ora11rac1' succeeded Configure Oracle Grid Infrastructure for a Cluster ... succeeded |
정상적으로 실행됨
원인 : asm 권한 문제
asm 권한 문제, 기존에 oracle 유저로만 설치하다가 grid 유저까지 만들어서 하려다보니 발생한 문제
참조 :
https://oracity.blog.ir/post/RAC-GRID-Root-sh-ORA-27091-ORA-15081-unable-to-queue-I-O