복사되었습니다!
OS 환경 : Oracle Linux 9.6 (64bit)
DB 환경 : Oracle Database 19.31.0.0
방법 : 오라클 19c Restart 환경 hostname 변경 후 ACFS 문제 해결
Restart 환경에서 hostname 변경 후 acfs 볼륨이 enable 불가한 현상을 발견함
본문에서는 이 경우 어떻게 조치해야 하는지를 설명함
디스크 그룹 확인
|
1
2
3
4
|
$ asmcmd
ASMCMD> lsdg
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED EXTERN N 512 512 4096 1048576 40959 12897 0 12897 0 N DATA/
|
acfs 볼륨 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
|
ASMCMD> volinfo -G DATA acfs_my_vol
Diskgroup Name: DATA
Volume Name: ACFS_MY_VOL
Volume Device: /dev/asm/acfs_my_vol-150
State: DISABLED
Size (MB): 1024
Resize Unit (MB): 64
Redundancy: UNPROT
Stripe Columns: 8
Stripe Width (K): 1024
Usage:
Mountpath:
|
State가 DISABLED 상태임
활성화 시도
|
1
2
3
|
$ asmcmd volenable -G DATA acfs_my_vol
ORA-15032: not all alterations performed
ORA-15480: error reported in the ASM volume driver (DBD ERROR: OCIStmtExecute)
|
안됨
해당 디바이스도 안보임
|
1
2
|
$ ls -lrt /dev/asm/acfs_my_vol-150
ls: cannot access '/dev/asm/acfs_my_vol-150': No such file or directory
|
확인
volenable 에러 발생 직후 dmesg 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
|
$ dmesg -T | tail -100
[Sat Aug 15 09:50:26 2026] A 23338 2 F asmdg.c line:637
[Sat Aug 15 09:50:26 2026] A 23338 2 F elapsed_secs:40 seq_num:11
[Sat Aug 15 09:50:26 2026] A 23338 3 F AsmIoctl_kfvdirAddVol
[Sat Aug 15 09:50:26 2026] A 23338 3 F asmcommon.c line:2457
[Sat Aug 15 09:50:26 2026] A 23338 3 F elapsed_secs:40 seq_num:1
[Sat Aug 15 09:55:43 2026] ADVMK-0022: An internal error occurred.
[Sat Aug 15 09:55:43 2026] OKSK-00007: Information has been saved in the file /var/log/Vokslog.2 . Include the contents of this file if reporting a problem to Oracle.
[Sat Aug 15 09:55:43 2026] [Oracle OKS] ASSERTION FAILURE: (AsmRoot.racMode != -1) /scratch/builds/dbintgci/dbintgci_usm_j38335/el9uek8_x86_64/usm/src/avd/driver/./asmdg.c:1691
[Sat Aug 15 09:55:43 2026] KsDumpStack: Stack call traceback
[Sat Aug 15 09:55:43 2026] CPU: 1 UID: 54321 PID: 26126 Comm: oracle_26126_+a Tainted: P S OE 6.12.0-1.23.3.2.el9uek.x86_64 #1
[Sat Aug 15 09:55:43 2026] Tainted: [P]=PROPRIETARY_MODULE, [S]=CPU_OUT_OF_SPEC, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
[Sat Aug 15 09:55:43 2026] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
[Sat Aug 15 09:55:43 2026] Call Trace:
[Sat Aug 15 09:55:43 2026] <TASK>
[Sat Aug 15 09:55:43 2026] dump_stack_lvl+0x5d/0x90
[Sat Aug 15 09:55:43 2026] KsDoAssertion+0x11e/0x180 [oracleoks]
[Sat Aug 15 09:55:43 2026] Asm_createVol+0x10f/0xba0 [oracleadvm]
[Sat Aug 15 09:55:43 2026] AsmDgStateVolAdd+0x248/0x660 [oracleadvm]
[Sat Aug 15 09:55:43 2026] AsmDgAction+0x149/0x210 [oracleadvm]
[Sat Aug 15 09:55:43 2026] AsmRootStateVolAdd+0x14a/0x5d0 [oracleadvm]
[Sat Aug 15 09:55:43 2026] AsmRootAction+0x342/0x420 [oracleadvm]
[Sat Aug 15 09:55:43 2026] AsmIoctl_kfvdirAddVol+0xf3/0x1f0 [oracleadvm]
[Sat Aug 15 09:55:43 2026] asmIoctl_int.isra.0+0x1ef/0x450 [oracleadvm]
[Sat Aug 15 09:55:43 2026] blkdev_ioctl+0xed/0x270
[Sat Aug 15 09:55:43 2026] __x64_sys_ioctl+0x9c/0xe0
[Sat Aug 15 09:55:43 2026] do_syscall_64+0x8c/0x1b0
[Sat Aug 15 09:55:43 2026] ? __count_memcg_events+0x6d/0x110
[Sat Aug 15 09:55:43 2026] ? count_memcg_events.constprop.0+0x26/0x50
[Sat Aug 15 09:55:43 2026] ? handle_mm_fault+0x223/0x330
[Sat Aug 15 09:55:43 2026] ? do_user_addr_fault+0x37c/0x630
[Sat Aug 15 09:55:43 2026] ? arch_exit_to_user_mode_prepare.isra.0+0x1e/0xd0
[Sat Aug 15 09:55:43 2026] entry_SYSCALL_64_after_hwframe+0x76/0x7e
[Sat Aug 15 09:55:43 2026] RIP: 0033:0x7f1ddc103a2b
[Sat Aug 15 09:55:43 2026] Code: ff ff ff 85 c0 79 9b 49 c7 c4 ff ff ff ff 5b 5d 4c 89 e0 41 5c c3 66 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d bd 53 0f 00 f7 d8 64 89 01 48
[Sat Aug 15 09:55:43 2026] RSP: 002b:00007fff6219ee18 EFLAGS: 00000206 ORIG_RAX: 0000000000000010
[Sat Aug 15 09:55:43 2026] RAX: ffffffffffffffda RBX: 00000000c1007664 RCX: 00007f1ddc103a2b
[Sat Aug 15 09:55:43 2026] RDX: 00007fff6219f0a0 RSI: 00000000c1007664 RDI: 000000000000000a
[Sat Aug 15 09:55:43 2026] RBP: 00007fff6219ee90 R08: 0000000000000064 R09: 00007fff6219f0a0
[Sat Aug 15 09:55:43 2026] R10: 00007f1ddc011d20 R11: 0000000000000206 R12: 0000000000000000
[Sat Aug 15 09:55:43 2026] R13: 0000000000000064 R14: 00007f1de0678a58 R15: 00007fff6219eeb8
[Sat Aug 15 09:55:43 2026] </TASK>
[Sat Aug 15 09:55:43 2026] A 4298131.769 HM: Assertion dump. Lines start "A 26126 "
[Sat Aug 15 09:55:43 2026] A 26126 4298131.769 HM assertion output
[Sat Aug 15 09:55:43 2026] A 26126 name:oracle_26126_+a pid:26126
[Sat Aug 15 09:55:43 2026] A 26126 tsd:0xffff97171f0ae828 l_OfsVolNum:-1
[Sat Aug 15 09:55:43 2026] A 26126 current_record_seq_cnt:29
[Sat Aug 15 09:55:43 2026] A 26126 total_elapsed_secs:39 hang_elapsed_secs:39
[Sat Aug 15 09:55:43 2026] A 26126 record_cnt:4 lock_cnt:1 func_cnt:3
[Sat Aug 15 09:55:43 2026] A 26126 last_rec_rem:LH_TrackOnly
[Sat Aug 15 09:55:43 2026] A 26126 Hang Manager stack dump for tid:0xffff971637f43700
[Sat Aug 15 09:55:43 2026] A 26126 0 F Asm_createVol
[Sat Aug 15 09:55:43 2026] A 26126 0 F asmdg.c line:1681
[Sat Aug 15 09:55:43 2026] A 26126 0 F elapsed_secs:39 seq_num:16
[Sat Aug 15 09:55:43 2026] A 26126 1 L LH_ADVM_volListLock type:303
[Sat Aug 15 09:55:43 2026] A 26126 1 L asmdg.c line:667
[Sat Aug 15 09:55:43 2026] A 26126 1 L LHV:LH_ADVM_volListLock:303 LHV2:LH_ADVM_volListLock:303
[Sat Aug 15 09:55:43 2026] A 26126 1 L id1:0xffff9717206439f8 id2:0x0000000000000000
[Sat Aug 15 09:55:43 2026] A 26126 1 L mode:0x44:LH_KSRWLOCK,LH_EXCLUSIVE
[Sat Aug 15 09:55:43 2026] A 26126 1 L state:held prev_tid:0xffff971637f43700
[Sat Aug 15 09:55:43 2026] A 26126 1 L blocked_ticks:0 held_ticks:39649
[Sat Aug 15 09:55:43 2026] A 26126 1 L elapsed_secs:39 seq_num:15
[Sat Aug 15 09:55:43 2026] A 26126 2 F AsmDgStateVolAdd
[Sat Aug 15 09:55:43 2026] A 26126 2 F asmdg.c line:637
[Sat Aug 15 09:55:43 2026] A 26126 2 F elapsed_secs:39 seq_num:11
[Sat Aug 15 09:55:43 2026] A 26126 3 F AsmIoctl_kfvdirAddVol
[Sat Aug 15 09:55:43 2026] A 26126 3 F asmcommon.c line:2457
[Sat Aug 15 09:55:43 2026] A 26126 3 F elapsed_secs:39 seq_num:1
|
ASSERTION FAILURE: (AsmRoot.racMode != -1) 메세지가 있음
racMode == -1이라는 건 ADVM 쪽에서 이 시스템이 RAC인지 Oracle Restart인지 판별하지 못한 상태라고함
현재 구성은 Restart 환경임
참고용 /var/log/Vokslog.2 로그
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
|
# cat /var/log/Vokslog.2
USM Version: 19.0.0.0.0 (19.31.0.0.0) - Driver Version: 19.31.0.0.0ACFSRU_LINUX.X64_260329 Node: chg19c
User Local Time offset = 32400 DST = 0 Log Base Time = 1782370812.264
K 4294867.341 insmod[4715] KsBlogAlert: binary logging not yet active.
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'AcfsHashScaleFactor' set to 100 (0x64)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'AcfsDeadlockTimeout' set to 900 (0x384)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'OksTcpKeepAlive' set to 1 (0x1)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'OksTcpKeepAliveIdleTime' set to 15 (0xf)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'OksTcpKeepAliveIntvl' set to 10 (0xa)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'OksTcpKeepAliveProbes' set to 18 (0x12)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'OksDlmRbldThCnt' set to 1 (0x1)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'OksChecksumMsg' set to 1 (0x1)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'AcfsHMTestIntervalSecs' set to 10 (0xa)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'AcfsHMTimeOutIntervalSecs' set to 20 (0x14)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'AcfsHMSyscallLogDurationSecs' set to 60 (0x3c)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'AcfsHMSilenceIntervalMins' set to 240 (0xf0)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'AcfsHMThreadEnable' set to 1 (0x1)
K 4294867.341 insmod[4715] KsTunableSetValue: Tunable 'AcfsHMBroadcastEnable' set to 1 (0x1)
K 4294867.345 2026-08-15 00:01:19.609UTC insmod[4715] kcss_rbld_register: Client Id 1 Num Steps 11 registered
V 4294867.488 insmod[4725] Asm_checkDriverVersion: AVD version 19.0.0.0.0
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'deadlock_timer' set to 20 (0x14)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'resilver_power' set to 8 (0x8)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'resilver_regio' set to 32 (0x20)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'viosUsed' set to 32 (0x20)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'offload_cpus_start' set to 2 (0x2)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'offload_bios_start' set to 16 (0x10)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'offload_rd_threads' set to 16 (0x10)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'offload_wr_threads' set to 16 (0x10)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'offload_rd_ioperth' set to 8 (0x8)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'offload_wr_ioperth' set to 8 (0x8)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'nrpcrBits' set to 16 (0x10)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'drl_increment' set to 8 (0x8)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'hbtimeout' set to 16 (0x10)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'timedwaitval' set to 30000 (0x7530)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'bio_offload' set to 2 (0x2)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'offload_threshold' set to 3072 (0xc00)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'AdvmFlexDgUseOnVolAdd' set to 1 (0x1)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'asuiocrSleepTimeS' set to 20 (0x14)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'asliocrMonUseLis' set to 1 (0x1)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'asmMQNumHwQueues' set to 1 (0x1)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'hungiothreshold' set to 30 (0x1e)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'asmFqpYield' set to 3 (0x3)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'hungioLongRep' set to 60 (0x3c)
K 4294867.489 insmod[4725] KsTunableSetValue: Tunable 'deadlock_timer' set to 1200 (0x4b0)
K 4294867.489 2026-08-15 00:01:19.752UTC insmod[4725] kcss_rbld_register: Client Id 0 Num Steps 3 registered
V 4294867.489 insmod[4725] Asm_drlAllocCaches: BITS_PER_PAGE=32768 NB1=128 NB2=256 SZ1=1024 SZ2=4096 |ageElem|=4 |age|=16 |dvi|=72 |drlPg|=1560
K 4294867.496 2026-08-15 00:01:19.760UTC insmod[4725] kcss_set_modes: racmode Not modified advmmode Not modified flexmode Not modified appmode: Not modified acfsrmode OFF
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsReplLogTimeOut' set to 20000 (0x4e20)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OfsRepSyncTimeOut' set to 20000 (0x4e20)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OfsReplLogCutPct' set to 80 (0x50)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OfsRlogDefaultSize' set to 10 (0xa)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OfsReplLogSyncPct' set to 25 (0x19)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OfsReplHelperThds' set to 8 (0x8)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsMetaCachePct' set to 7 (0x7)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsHashScaleFactor' set to 100 (0x64)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsOptimizeRecovery' set to 1 (0x1)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsOpenModeLocking' set to 1 (0x1)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsDefragExtentSize' set to 8 (0x8)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsDefragExtents' set to 8 (0x8)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsDefragPower' set to 5 (0x5)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsDefragGetRangeTimeout' set to 100 (0x64)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsVolLogIOBufSize' set to 2 (0x2)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsDeadlockTimeout' set to 900 (0x384)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OksStackThreshold' set to 2560 (0xa00)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OksTcpKeepAlive' set to 1 (0x1)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OksTcpKeepAliveIdleTime' set to 15 (0xf)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OksTcpKeepAliveIntvl' set to 10 (0xa)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OksTcpKeepAliveProbes' set to 18 (0x12)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OksDlmRbldThCnt' set to 1 (0x1)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'OksChecksumMsg' set to 1 (0x1)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsFsyncCommitThreshold' set to 5 (0x5)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsFsyncBatchLimit' set to 20 (0x14)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsGBMSearchLimit' set to 10 (0xa)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsDefaultCUsizeIdx' set to 4 (0x4)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCUCBMinBuckets' set to 2 (0x2)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCUCBPruneHighWaterMark' set to 128 (0x80)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCUCBPruneLowWaterMark' set to 96 (0x60)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCUCBPruneNumPerPass' set to 8 (0x8)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCmprssIndirectRebuild' set to 15000 (0x3a98)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsHMTestIntervalSecs' set to 10 (0xa)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsHMTimeOutIntervalSecs' set to 20 (0x14)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsHMSyscallLogDurationSecs' set to 60 (0x3c)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsHMSilenceIntervalMins' set to 240 (0xf0)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsHMThreadEnable' set to 1 (0x1)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsDontCompressPercent' set to 80 (0x50)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCmpStgRunThreshold' set to 67108864 (0x4000000)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCmpStgThrottleThreshold' set to 536870912 (0x20000000)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCmpStgThrottleTimeout' set to 5000 (0x1388)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCmpAsyncDelay' set to 5 (0x5)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCmpAsyncMaxSize' set to 1048576 (0x100000)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsCmpAsyncMinIdleTime' set to 100 (0x64)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsFCBRetentionInterval' set to 90000 (0x15f90)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsMaxStaleFiles' set to 16384 (0x4000)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsMaxUnusedFiles' set to 65536 (0x10000)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsFCBUnusedInterval' set to 600 (0x258)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsRangeLockSize' set to 124 (0x7c)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsOnlineFsckCOWStripeSize' set to 20 (0x14)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsOnlineFsckBucketFactor' set to 4 (0x4)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsOnlineFsckThrottleSamples' set to 1000 (0x3e8)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsOnlineFsckThrottleMult' set to 500 (0x1f4)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsOnlineFsckThrottleFreq' set to 10 (0xa)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsOnlineFsckThrottleMin' set to 20 (0x14)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsOnlineFsckFixerDelayFreq' set to 100 (0x64)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsResizeDelay' set to 2 (0x2)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsEncrFlushThreadCnt' set to 4 (0x4)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsEncrPageReadThreadCnt' set to 16 (0x10)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsEncrPageReadClusterSize' set to 256 (0x100)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsPerfTweak' set to 1 (0x1)
K 4294868.033 2026-08-15 00:01:20.296UTC insmod[4714] KsTunableSetValue: Tunable 'AcfsLogTimeStampInterval' set to 20 (0x14)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsHMBroadcastEnable' set to 1 (0x1)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsValidateRestrictedIo' set to 1 (0x1)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsLogIOTimePeriodSecs' set to 10 (0xa)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsEncrSplitSize' set to 128 (0x80)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsGDRFLScanMaxTimeWaitMin' set to 10 (0xa)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsNumCleanLists' set to 32 (0x20)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsDeferMinBatchSize' set to 256 (0x100)
K 4294868.033 insmod[4714] KsTunableSetValue: Tunable 'AcfsRemoteStorageMode' set to 1 (0x1)
F 4294868.033 insmod[4714] ofs_hash_create_int bucket_count=125000 bucket_size=40
F 4294868.039 insmod[4714] ofs_fcbtable_init: FCB hash size 125000
F 4294868.039 insmod[4714] ofs_hash_create_int bucket_count=73551 bucket_size=40
F 4294868.042 insmod[4714] ofs_meta_init: buffer cache size 555MB (73551 buckets)
F 4294868.042 insmod[4714] ofs_hash_create_int bucket_count=125000 bucket_size=40
F 4294868.045 insmod[4714] ofs_dlm_init: DLM hash size 125000
K 4294868.047 2026-08-15 00:01:20.311UTC insmod[4714] kcss_rbld_register: Client Id 2 Num Steps 4 registered
F 4294868.047 2026-08-15 00:01:20.311UTC insmod[4714] OfsStallInterfaces: incarn 0x0 stall 0 reason 0
F 4294868.047 2026-08-15 00:01:20.311UTC insmod[4714] OfsStallInterfaces: Interfaces disabled
V 4294868.047 insmod[4714] AsmIoctl_shimInfoKern 0
K 4294868.510 acfsutil.bin[4901] KsTunableSetValue: Tunable 'AcfsRemoteStorageMode' set to 0 (0x0)
K 4294868.655 acfsutil.bin[4942] NOTE: log times switching to user local time
K 4294868.655 acfsutil.bin[4942] KsTunableSetValue: Tunable 'KsBlogAlertLogMaxSz' set to 100 (0x64)
K 4294868.655 acfsutil.bin[4942] KsBlogInit: binary logging active. Directory /app/oracle/crsdata/chg19c/acfs
K 4294868.655 acfsutil.bin[4942] KsSetupLastGasp: Last Gasp File /app/oracle/crsdata/chg19c/acfs/acfs_lastgasp
K 4294868.655 2026-08-15 09:01:20.919 acfsutil.bin[4942] KsSetupLastGasp: Last Gasp File /app/oracle/crsdata/chg19c/acfs/acfs_lastgasp
Size 8192 PlogDir name size 31
K 4294868.655 acfsutil.bin[4942] KsSetupLastGasp: Closing Last Gasp File /app/oracle/crsdata/chg19c/acfs/acfs_lastgasp
K 4294868.655 acfsutil.bin[4942] KsSetupLastGasp: Last Gasp File /app/oracle/crsdata/chg19c/acfs/acfs_lastgasp opened for write
V 4294881.446 2026-08-15 09:01:33.710 AsmBlogInitFunc[4740] AsmBlogInitFunc: ADVM binary logging init done
V 4294881.646 asm_ckpt_+asm[2765] AsmRootAction in: VOLADD st INITIAL prev INITIAL dispatch VolAdd arg 0xffff97171cb13a00
V 4294881.646 asm_ckpt_+asm[2765] AsmRootStateVolAdd: ADVM detected ASM instance start
V 4294881.646 asm_ckpt_+asm[2765] Asm_createDG: DG name=DATA created
V 4294881.646 asm_ckpt_+asm[2765] AsmDgAction: DATA: in: VOLADD st INITIAL prev INITIAL func VolAdd arg1 0xffff971720647800, arg2 0xffff97171cb13a00
V 4294881.646 asm_ckpt_+asm[2765] AsmDgStateVolAdd: DATA.acfs_my_vol-150: add/enable
V 4294881.646 asm_ckpt_+asm[2765] AsmForceAsmStateDump: forcing an ASM state dump. ERROR: racMode is uninitialized
V 4294881.646 asm_ckpt_+asm[2765] AsmMessage: cannot queue message with opcode 18 w/o a VBG!
K 4294881.646 asm_ckpt_+asm[2765] Free stack space lows OKS:2048 ACFS:2048 ADVM:2048
K 4294881.650 asm_ckpt_+asm[2765] ASSERT: (AsmRoot.racMode != -1) /scratch/builds/dbintgci/dbintgci_usm_j38335/el9uek8_x86_64/usm/src/avd/driver/./asmdg.c:1691
K 4294881.650 asm_ckpt_+asm[2765] KsDumpStack: See stack call traceback in /var/log/messages
K 4294881.650 2026-08-15 09:01:33.914 asm_ckpt_+asm[2765] A 4294881.650 HM: Assertion dump. Lines start "A 2765 "
A 2765 4294881.650 HM assertion output
A 2765 name:asm_ckpt_+asm pid:2765
A 2765 tsd:0xffff97171f0ae488 l_OfsVolNum:-1
A 2765 current_record_seq_cnt:28
A 2765 total_elapsed_secs:0 hang_elapsed_secs:0
A 2765 record_cnt:4 lock_cnt:1 func_cnt:3
A 2765 last_rec_rem:LH_TrackOnly
A 2765 Hang Manager stack dump for tid:0xffff971708839b80
A 2765 0 F Asm_createVol
A 2765 0 F asmdg.c line:1681
A 2765 0 F elapsed_secs:0 seq_num:16
A 2765 1 L LH_ADVM_volListLock type:303
A 2765 1 L asmdg.c line:667
A 2765 1 L LHV:LH_ADVM_volListLock:303 LHV2:LH_ADVM_volListLock:303
A 2765 1 L id1:0xffff9717206479f8 id2:0x0000000000000000
A 2765 1 L mode:0x44:LH_KSRWLOCK,LH_EXCLUSIVE
A 2765 1 L state:held prev_tid:0xffff971708839b80
A 2765 1 L blocked_ticks:0 held_ticks:4
A 2765 1 L elapsed_secs:0 seq_num:15
A 2765 2 F AsmDgStateVolAdd
A 2765 2 F asmdg.c line:637
A 2765 2 F elapsed_secs:0 seq_num:11
A 2765 3 F AsmIoctl_kfvdirAddVol
A 2765 3 F asmcommon.c line:2457
A 2765 3 F elapsed_secs:0 seq_num:1
V 4294881.650 asm_ckpt_+asm[2765] AsmDgStateVolAdd: DATA.#1: ADD/ENABLE failed.
V 4294881.650 asm_ckpt_+asm[2765] AsmDgAction: DATA: out: VOLADD st INITIAL prev INITIAL ret 1
V 4294881.650 asm_ckpt_+asm[2765] AsmRootStateVolAdd: Volume Creation failed for group DATA
V 4294881.650 asm_ckpt_+asm[2765] AsmRootStateVolAdd: delete/free DG DATA
V 4294881.650 asm_ckpt_+asm[2765] AsmDgStopThreads: DATA: stopping all threads
V 4294881.650 UsmError:DATA[4738] AsmIoErrorThread: DATA: ASMEVENT_DG_STOP_ETHREAD
V 4294881.650 asm_ckpt_+asm[2765] Asm_deleteDG: DG DATA deleted, 0 active DGs left
V 4294881.650 asm_ckpt_+asm[2765] AsmRootAction out: VOLADD st INITIAL prev INITIAL ret 1
V 4297774.394 oracle_23338_+a[23338] AsmRootAction in: VOLADD st INITIAL prev INITIAL dispatch VolAdd arg 0xffff97171cb13900
V 4297774.394 2026-08-15 09:49:46.657 oracle_23338_+a[23338] AsmRootStateVolAdd: ADVM detected ASM instance start
V 4297774.394 oracle_23338_+a[23338] Asm_createDG: DG name=DATA created
V 4297774.394 oracle_23338_+a[23338] AsmDgAction: DATA: in: VOLADD st INITIAL prev INITIAL func VolAdd arg1 0xffff971720647000, arg2 0xffff97171cb13900
V 4297774.394 oracle_23338_+a[23338] AsmDgStateVolAdd: DATA.acfs_my_vol-150: add/enable
V 4297774.394 oracle_23338_+a[23338] AsmForceAsmStateDump: forcing an ASM state dump. ERROR: racMode is uninitialized
K 4297796.096 2026-08-15 09:50:08.359 KsLHHMThread[4723] S 4297796.096 HM: Hung syscall warning. Lines start "S 23338 "
S 23338 HM: WARNING syscall appears hung pid:23338
S 23338 tid:0xffff971707d0d280 tsd:0xffff97171f0ae828 l_OfsVolNum:-1
S 23338 name:oracle_23338_+a current_record_seq_cnt:24
S 23338 total_elapsed_secs:21 hang_elapsed_secs:21
S 23338 record_cnt:7 lock_cnt:2 func_cnt:5
S 23338 last_rec_rem:LH_WaitEventGeneric
S 23338 0 L LH_WaitEventGeneric type:379
S 23338 0 L asmutil.c line:4114
S 23338 0 L LHV:LH_WaitEventGeneric:379 LHV2:LH_WaitEventGeneric:379
S 23338 0 L id1:0xffffb01cd040f898 id2:0x00000001002afe38
S 23338 0 L mode:0x200:LH_WAIT_EVENT
S 23338 0 L state:blocked prev_tid:0x0000000000000000
S 23338 0 L blocked_ticks:11208 held_ticks:0
S 23338 0 L elapsed_secs:11 seq_num:24
K 4297796.096 KsLHHMThread[4723] Hang Analyzer: Spawning a callback to handle hung thread.
S 23338 1 F AsmMessage
S 23338 1 F asmMsg.c line:528
S 23338 1 F elapsed_secs:21 seq_num:21
S 23338 2 F AsmForceAsmStateDump
S 23338 2 F asmutil.c line:3531
S 23338 2 F elapsed_secs:21 seq_num:17
S 23338 3 F Asm_createVol
S 23338 3 F asmdg.c line:1681
S 23338 3 F elapsed_secs:21 seq_num:16
S 23338 4 L LH_ADVM_volListLock type:303
S 23338 4 L asmdg.c line:667
S 23338 4 L LHV:LH_ADVM_volListLock:303 LHV2:LH_ADVM_volListLock:303
S 23338 4 L id1:0xffff9717206471f8 id2:0x0000000000000000
S 23338 4 L mode:0x44:LH_KSRWLOCK,LH_EXCLUSIVE
S 23338 4 L state:held prev_tid:0xffff971707d0d280
S 23338 4 L blocked_ticks:0 held_ticks:21702
S 23338 4 L elapsed_secs:21 seq_num:15
S 23338 5 F AsmDgStateVolAdd
S 23338 5 F asmdg.c line:637
S 23338 5 F elapsed_secs:21 seq_num:11
S 23338 6 F AsmIoctl_kfvdirAddVol
S 23338 6 F asmcommon.c line:2457
S 23338 6 F elapsed_secs:21 seq_num:1
K 4297806.336 2026-08-15 09:50:18.599 KsLHHMThread[4723] S 4297806.336 HM: Hung syscall warning. Lines start "S 23338 "
S 23338 HM: WARNING syscall appears hung pid:23338
S 23338 tid:0xffff971707d0d280 tsd:0xffff97171f0ae828 l_OfsVolNum:-1
S 23338 name:oracle_23338_+a current_record_seq_cnt:24
S 23338 total_elapsed_secs:31 hang_elapsed_secs:31
S 23338 record_cnt:7 lock_cnt:2 func_cnt:5
S 23338 last_rec_rem:LH_WaitEventGeneric
S 23338 0 L LH_WaitEventGeneric type:379
S 23338 0 L asmutil.c line:4114
S 23338 0 L LHV:LH_WaitEventGeneric:379 LHV2:LH_WaitEventGeneric:379
S 23338 0 L id1:0xffffb01cd040f898 id2:0x00000001002afe38
S 23338 0 L mode:0x200:LH_WAIT_EVENT
S 23338 0 L state:blocked prev_tid:0x0000000000000000
S 23338 0 L blocked_ticks:21448 held_ticks:0
S 23338 0 L elapsed_secs:21 seq_num:24
K 4297806.336 KsLHHMThread[4723] Hang Analyzer: Spawning a callback to handle hung thread.
S 23338 1 F AsmMessage
S 23338 1 F asmMsg.c line:528
S 23338 1 F elapsed_secs:31 seq_num:21
S 23338 2 F AsmForceAsmStateDump
S 23338 2 F asmutil.c line:3531
S 23338 2 F elapsed_secs:31 seq_num:17
S 23338 3 F Asm_createVol
S 23338 3 F asmdg.c line:1681
S 23338 3 F elapsed_secs:31 seq_num:16
S 23338 4 L LH_ADVM_volListLock type:303
S 23338 4 L asmdg.c line:667
S 23338 4 L LHV:LH_ADVM_volListLock:303 LHV2:LH_ADVM_volListLock:303
S 23338 4 L id1:0xffff9717206471f8 id2:0x0000000000000000
S 23338 4 L mode:0x44:LH_KSRWLOCK,LH_EXCLUSIVE
S 23338 4 L state:held prev_tid:0xffff971707d0d280
S 23338 4 L blocked_ticks:0 held_ticks:31942
S 23338 4 L elapsed_secs:31 seq_num:15
S 23338 5 F AsmDgStateVolAdd
S 23338 5 F asmdg.c line:637
S 23338 5 F elapsed_secs:31 seq_num:11
S 23338 6 F AsmIoctl_kfvdirAddVol
S 23338 6 F asmcommon.c line:2457
S 23338 6 F elapsed_secs:31 seq_num:1
K 4297814.918 oracle_23338_+a[23338] Free stack space lows OKS:2048 ACFS:2048 ADVM:2048
K 4297814.923 oracle_23338_+a[23338] ASSERT: (AsmRoot.racMode != -1) /scratch/builds/dbintgci/dbintgci_usm_j38335/el9uek8_x86_64/usm/src/avd/driver/./asmdg.c:1691
K 4297814.923 oracle_23338_+a[23338] KsDumpStack: See stack call traceback in /var/log/messages
K 4297814.923 2026-08-15 09:50:27.187 oracle_23338_+a[23338] A 4297814.923 HM: Assertion dump. Lines start "A 23338 "
A 23338 4297814.923 HM assertion output
A 23338 name:oracle_23338_+a pid:23338
A 23338 tsd:0xffff97171f0ae828 l_OfsVolNum:-1
A 23338 current_record_seq_cnt:29
A 23338 total_elapsed_secs:40 hang_elapsed_secs:40
A 23338 record_cnt:4 lock_cnt:1 func_cnt:3
A 23338 last_rec_rem:LH_TrackOnly
A 23338 Hang Manager stack dump for tid:0xffff971707d0d280
A 23338 0 F Asm_createVol
A 23338 0 F asmdg.c line:1681
A 23338 0 F elapsed_secs:40 seq_num:16
A 23338 1 L LH_ADVM_volListLock type:303
A 23338 1 L asmdg.c line:667
A 23338 1 L LHV:LH_ADVM_volListLock:303 LHV2:LH_ADVM_volListLock:303
A 23338 1 L id1:0xffff9717206471f8 id2:0x0000000000000000
A 23338 1 L mode:0x44:LH_KSRWLOCK,LH_EXCLUSIVE
A 23338 1 L state:held prev_tid:0xffff971707d0d280
A 23338 1 L blocked_ticks:0 held_ticks:40529
A 23338 1 L elapsed_secs:40 seq_num:15
A 23338 2 F AsmDgStateVolAdd
A 23338 2 F asmdg.c line:637
A 23338 2 F elapsed_secs:40 seq_num:11
A 23338 3 F AsmIoctl_kfvdirAddVol
A 23338 3 F asmcommon.c line:2457
A 23338 3 F elapsed_secs:40 seq_num:1
V 4297814.923 oracle_23338_+a[23338] AsmDgStateVolAdd: DATA.#1: ADD/ENABLE failed.
V 4297814.923 oracle_23338_+a[23338] AsmDgAction: DATA: out: VOLADD st INITIAL prev INITIAL ret 1
V 4297814.923 oracle_23338_+a[23338] AsmRootStateVolAdd: Volume Creation failed for group DATA
V 4297814.923 oracle_23338_+a[23338] AsmRootStateVolAdd: delete/free DG DATA
V 4297814.923 oracle_23338_+a[23338] AsmDgStopThreads: DATA: stopping all threads
V 4297814.923 oracle_23338_+a[23338] AsmWakeThreads: Still waiting on 1 entries
V 4297814.923 UsmError:DATA[4737] AsmIoErrorThread: DATA: ASMEVENT_DG_STOP_ETHREAD
V 4297814.923 oracle_23338_+a[23338] Asm_deleteDG: DG DATA deleted, 0 active DGs left
V 4297814.923 oracle_23338_+a[23338] AsmRootAction out: VOLADD st INITIAL prev INITIAL ret 1
V 4298092.120 oracle_26126_+a[26126] AsmRootAction in: VOLADD st INITIAL prev INITIAL dispatch VolAdd arg 0xffff97171cb13900
V 4298092.120 2026-08-15 09:55:04.384 oracle_26126_+a[26126] AsmRootStateVolAdd: ADVM detected ASM instance start
V 4298092.120 oracle_26126_+a[26126] Asm_createDG: DG name=DATA created
V 4298092.120 oracle_26126_+a[26126] AsmDgAction: DATA: in: VOLADD st INITIAL prev INITIAL func VolAdd arg1 0xffff971720643800, arg2 0xffff97171cb13900
V 4298092.120 oracle_26126_+a[26126] AsmDgStateVolAdd: DATA.acfs_my_vol-150: add/enable
V 4298092.120 oracle_26126_+a[26126] AsmForceAsmStateDump: forcing an ASM state dump. ERROR: racMode is uninitialized
K 4298113.536 2026-08-15 09:55:25.799 KsLHHMThread[4723] S 4298113.536 HM: Hung syscall warning. Lines start "S 26126 "
S 26126 HM: WARNING syscall appears hung pid:26126
S 26126 tid:0xffff971637f43700 tsd:0xffff97171f0ae828 l_OfsVolNum:-1
S 26126 name:oracle_26126_+a current_record_seq_cnt:24
S 26126 total_elapsed_secs:21 hang_elapsed_secs:21
S 26126 record_cnt:7 lock_cnt:2 func_cnt:5
S 26126 last_rec_rem:LH_WaitEventGeneric
S 26126 0 L LH_WaitEventGeneric type:379
S 26126 0 L asmutil.c line:4114
S 26126 0 L LHV:LH_WaitEventGeneric:379 LHV2:LH_WaitEventGeneric:379
S 26126 0 L id1:0xffffb01cd32f7a18 id2:0x00000001002fd414
S 26126 0 L mode:0x200:LH_WAIT_EVENT
S 26126 0 L state:blocked prev_tid:0x0000000000000000
S 26126 0 L blocked_ticks:11756 held_ticks:0
S 26126 0 L elapsed_secs:11 seq_num:24
K 4298113.536 2026-08-15 09:55:25.799 KsLHHMThread[4723] Hang Analyzer: Spawning a callback to handle hung thread.
S 26126 1 F AsmMessage
S 26126 1 F asmMsg.c line:528
S 26126 1 F elapsed_secs:21 seq_num:21
S 26126 2 F AsmForceAsmStateDump
S 26126 2 F asmutil.c line:3531
S 26126 2 F elapsed_secs:21 seq_num:17
S 26126 3 F Asm_createVol
S 26126 3 F asmdg.c line:1681
S 26126 3 F elapsed_secs:21 seq_num:16
S 26126 4 L LH_ADVM_volListLock type:303
S 26126 4 L asmdg.c line:667
S 26126 4 L LHV:LH_ADVM_volListLock:303 LHV2:LH_ADVM_volListLock:303
S 26126 4 L id1:0xffff9717206439f8 id2:0x0000000000000000
S 26126 4 L mode:0x44:LH_KSRWLOCK,LH_EXCLUSIVE
S 26126 4 L state:held prev_tid:0xffff971637f43700
S 26126 4 L blocked_ticks:0 held_ticks:21416
S 26126 4 L elapsed_secs:21 seq_num:15
S 26126 5 F AsmDgStateVolAdd
S 26126 5 F asmdg.c line:637
S 26126 5 F elapsed_secs:21 seq_num:11
S 26126 6 F AsmIoctl_kfvdirAddVol
S 26126 6 F asmcommon.c line:2457
S 26126 6 F elapsed_secs:21 seq_num:1
K 4298123.776 2026-08-15 09:55:36.039 KsLHHMThread[4723] S 4298123.776 HM: Hung syscall warning. Lines start "S 26126 "
S 26126 HM: WARNING syscall appears hung pid:26126
S 26126 tid:0xffff971637f43700 tsd:0xffff97171f0ae828 l_OfsVolNum:-1
S 26126 name:oracle_26126_+a current_record_seq_cnt:24
S 26126 total_elapsed_secs:31 hang_elapsed_secs:31
S 26126 record_cnt:7 lock_cnt:2 func_cnt:5
S 26126 last_rec_rem:LH_WaitEventGeneric
S 26126 0 L LH_WaitEventGeneric type:379
S 26126 0 L asmutil.c line:4114
S 26126 0 L LHV:LH_WaitEventGeneric:379 LHV2:LH_WaitEventGeneric:379
S 26126 0 L id1:0xffffb01cd32f7a18 id2:0x00000001002fd414
S 26126 0 L mode:0x200:LH_WAIT_EVENT
S 26126 0 L state:blocked prev_tid:0x0000000000000000
S 26126 0 L blocked_ticks:21996 held_ticks:0
S 26126 0 L elapsed_secs:21 seq_num:24
K 4298123.776 KsLHHMThread[4723] Hang Analyzer: Spawning a callback to handle hung thread.
S 26126 1 F AsmMessage
S 26126 1 F asmMsg.c line:528
S 26126 1 F elapsed_secs:31 seq_num:21
S 26126 2 F AsmForceAsmStateDump
S 26126 2 F asmutil.c line:3531
S 26126 2 F elapsed_secs:31 seq_num:17
S 26126 3 F Asm_createVol
S 26126 3 F asmdg.c line:1681
S 26126 3 F elapsed_secs:31 seq_num:16
S 26126 4 L LH_ADVM_volListLock type:303
S 26126 4 L asmdg.c line:667
S 26126 4 L LHV:LH_ADVM_volListLock:303 LHV2:LH_ADVM_volListLock:303
S 26126 4 L id1:0xffff9717206439f8 id2:0x0000000000000000
S 26126 4 L mode:0x44:LH_KSRWLOCK,LH_EXCLUSIVE
S 26126 4 L state:held prev_tid:0xffff971637f43700
S 26126 4 L blocked_ticks:0 held_ticks:31656
S 26126 4 L elapsed_secs:31 seq_num:15
S 26126 5 F AsmDgStateVolAdd
S 26126 5 F asmdg.c line:637
S 26126 5 F elapsed_secs:31 seq_num:11
S 26126 6 F AsmIoctl_kfvdirAddVol
S 26126 6 F asmcommon.c line:2457
S 26126 6 F elapsed_secs:31 seq_num:1
K 4298131.763 oracle_26126_+a[26126] Free stack space lows OKS:2048 ACFS:2048 ADVM:2048
###!!!@@@ KsLog Tail/Start @@@!!!###
|
드라이버 지원 가능 여부 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
|
# /app/grid/product/19c/bin/acfsdriverstate supported -v
ACFS-9200: Supported
ACFS-9553: Operating System: linux
ACFS-9554: Machine Architecture: x86_64-linux-thread-multi
ACFS-9555: Operating system name and information: Linux chg19c 6.12.0-1.23.3.2.el9uek.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 13 17:24:00 PDT 2025 x86_64 x86_64 x86_64 GNU/Linux
ACFS-9556: Release package: oraclelinux-release-9.6-1.0.8.el9.x86_64
ACFS-9557: Version: EL9
ACFS-9558: Variable _ORA_USM_NOT_SUPPORTED is defined: no
ACFS-9559: Running in a local container: no
ACFS-9561: USM Drivers are KABI Compatible.
ACFS-9562: Install Path: /app/grid/product/19c/usm/install/Oracle/EL9UEK/x86_64/6.12.0-0.20.20/6.12.0-0.20.20-x86_64/bin
ACFS-9999: Drivers were NOT unzipped.
ACFS-9577: Kabi Method: RPM
DISCLAIMER:
The determination of whether the current system configuration is supported
or not is based on the list of approved kernels and OS versions at the time
of shipment of the base code, together with any installed patches. At times,
specific kernel or OS versions may be unsupported due to known issues or OS
bugs.
For the latest information and notes on ACFS, including the most up to date
support information with patches and PSU information, consult MOS note
(Doc ID 1369107.1): ACFS Support On OS Platforms (Certification Matrix).
|
가능한 상태임
드라이버 install 상태 확인
|
1
2
|
# /app/grid/product/19c/bin/acfsdriverstate installed
ACFS-9203: true
|
install 되어 있음
드라이버 load 여부 확인
|
1
2
|
# /app/grid/product/19c/bin/acfsdriverstate loaded
ACFS-9203: true
|
load 되어 있음
드라이버 버전 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
|
# /app/grid/product/19c/bin/acfsdriverstate version -v
ACFS-9325: Driver OS kernel version = 6.12.0-0.20.20.el9uek.x86_64.
ACFS-9326: Driver build number = 260329.
ACFS-9231: Driver build version = 19.0.0.0.0 (19.31.0.0.0).
ACFS-9547: Driver available build number = 260329.
ACFS-9232: Driver available build version = 19.0.0.0.0 (19.31.0.0.0).
ACFS-9549: Kernel and command versions.
Kernel:
Build version: 19.0.0.0.0
Build full version: 19.31.0.0.0
Build hash: 9256567290
Bug numbers: NoTransactionInformation
Commands:
Build version: 19.0.0.0.0
Build full version: 19.31.0.0.0
Build hash: 9256567290
Bug numbers: NoTransactionInformation
|
모두 정상임
grid 상태 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
|
$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
ONLINE ONLINE chg19c STABLE
ora.LISTENER.lsnr
ONLINE ONLINE chg19c STABLE
ora.asm
ONLINE ONLINE chg19c Started,STABLE
ora.ons
OFFLINE OFFLINE chg19c STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.cssd
1 ONLINE ONLINE chg19c STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.evmd
1 ONLINE ONLINE chg19c STABLE
ora.oracle19.db
1 ONLINE ONLINE chg19c Open,HOME=/app/oracl
e/product/19c,STABLE
--------------------------------------------------------------------------------
|
아래 문서에 따르면 Restart 환경에서는 ACFS를 Enable 해줘야한다고 나옴
|
1
2
3
4
5
|
# cd /app/grid/product/19c/crs/install
# ./roothas.sh -lockacfs
Using configuration parameter file: /app/grid/product/19c/crs/install/crsconfig_params
The log of current session can be found at:
/app/oracle/crsdata/chg19c/crsconfig/roothas_2026-08-15_10-09-56AM.log
|
참고용 로그
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
|
# cat /app/oracle/crsdata/chg19c/crsconfig/roothas_2026-08-15_10-09-56AM.log
2026-08-15 10:09:56: Checking parameters from paramfile /app/grid/product/19c/crs/install/crsconfig_params to validate installer variables
2026-08-15 10:09:56: Install node: oel9reco
2026-08-15 10:09:56: Current node is not the install node
2026-08-15 10:09:56: The configuration parameter file /app/grid/product/19c/crs/install/crsconfig_params is valid
2026-08-15 10:09:56: Run command --/app/grid/product/19c/bin/oraversion -libVersion-- as oracle
2026-08-15 10:09:56: /app/grid/product/19c/bin/oraversion -libVersion successfully executed
2026-08-15 10:09:56: Command output:
> 19
>End Command output
2026-08-15 10:09:56: "/app/grid/product/19c/bin/oraversion -libVersion" output: 19
2026-08-15 10:09:56: Run command --/app/grid/product/19c/bin/oraversion -majorVersion-- as oracle
2026-08-15 10:09:56: /app/grid/product/19c/bin/oraversion -majorVersion successfully executed
2026-08-15 10:09:56: Command output:
> 19
>End Command output
2026-08-15 10:09:56: "/app/grid/product/19c/bin/oraversion -majorVersion" output: 19
2026-08-15 10:09:56: ### Printing the configuration values from files:
2026-08-15 10:09:56: /app/grid/product/19c/crs/install/crsconfig_params
2026-08-15 10:09:56: /app/grid/product/19c/crs/install/s_crsconfig_defs
2026-08-15 10:09:56: AFD_CONF=false
2026-08-15 10:09:56: APPLICATION_VIP=
2026-08-15 10:09:56: ASMCA_ARGS=
2026-08-15 10:09:56: ASM_CONFIG=
2026-08-15 10:09:56: ASM_CREDENTIALS=
2026-08-15 10:09:56: ASM_DISCOVERY_STRING=ORCL:*
2026-08-15 10:09:56: ASM_SPFILE=
2026-08-15 10:09:56: ASM_UPGRADE=false
2026-08-15 10:09:56: BIG_CLUSTER=false
2026-08-15 10:09:56: CDATA_AUSIZE=1
2026-08-15 10:09:56: CDATA_BACKUP_AUSIZE=1
2026-08-15 10:09:56: CDATA_BACKUP_DISKS=
2026-08-15 10:09:56: CDATA_BACKUP_DISK_GROUP=
2026-08-15 10:09:56: CDATA_BACKUP_FAILURE_GROUPS=
2026-08-15 10:09:56: CDATA_BACKUP_QUORUM_GROUPS=
2026-08-15 10:09:56: CDATA_BACKUP_REDUNDANCY=
2026-08-15 10:09:56: CDATA_BACKUP_SITES=
2026-08-15 10:09:56: CDATA_BACKUP_SIZE=0
2026-08-15 10:09:56: CDATA_DISKS=
2026-08-15 10:09:56: CDATA_DISK_GROUP=DATA
2026-08-15 10:09:56: CDATA_FAILURE_GROUPS=
2026-08-15 10:09:56: CDATA_QUORUM_GROUPS=
2026-08-15 10:09:56: CDATA_REDUNDANCY=
2026-08-15 10:09:56: CDATA_SITES=
2026-08-15 10:09:56: CDATA_SIZE=0
2026-08-15 10:09:56: CLSCFG_MISSCOUNT=
2026-08-15 10:09:56: CLUSTER_CLASS=
2026-08-15 10:09:56: CLUSTER_GUID=
2026-08-15 10:09:56: CLUSTER_NAME=
2026-08-15 10:09:56: CLUSTER_TYPE=
2026-08-15 10:09:56: CRS_LIMIT_CORE=unlimited
2026-08-15 10:09:56: CRS_LIMIT_MEMLOCK=unlimited
2026-08-15 10:09:56: CRS_LSNR_STACK=32768
2026-08-15 10:09:56: CRS_NODEVIPS=
2026-08-15 10:09:56: CRS_STORAGE_OPTION=0
2026-08-15 10:09:56: CSS_LEASEDURATION=400
2026-08-15 10:09:56: DC_HOME=
2026-08-15 10:09:56: DIRPREFIX=
2026-08-15 10:09:56: DISABLE_OPROCD=0
2026-08-15 10:09:56: EXTENDED_CLUSTER=false
2026-08-15 10:09:56: EXTENDED_CLUSTER_SITES=oel9reco
2026-08-15 10:09:56: EXTENDED_CLUSTER_SITE_GUIDS=
2026-08-15 10:09:56: EXTERNAL_ORACLE=/opt/oracle
2026-08-15 10:09:56: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
2026-08-15 10:09:56: GIMR_CONFIG=
2026-08-15 10:09:56: GIMR_CREDENTIALS=
2026-08-15 10:09:56: GNS_ADDR_LIST=
2026-08-15 10:09:56: GNS_ALLOW_NET_LIST=
2026-08-15 10:09:56: GNS_CONF=false
2026-08-15 10:09:56: GNS_CREDENTIALS=
2026-08-15 10:09:56: GNS_DENY_ITF_LIST=
2026-08-15 10:09:56: GNS_DENY_NET_LIST=
2026-08-15 10:09:56: GNS_DOMAIN_LIST=
2026-08-15 10:09:56: GNS_TYPE=
2026-08-15 10:09:56: GPNPCONFIGDIR=/app/grid/product/19c
2026-08-15 10:09:56: GPNPGCONFIGDIR=/app/grid/product/19c
2026-08-15 10:09:56: GPNP_PA=
2026-08-15 10:09:56: HUB_NODE_LIST=
2026-08-15 10:09:56: HUB_NODE_VIPS=
2026-08-15 10:09:56: HUB_SIZE=0
2026-08-15 10:09:56: ID=/etc/init.d
2026-08-15 10:09:56: INIT=/sbin/init
2026-08-15 10:09:56: INITCTL=/sbin/initctl
2026-08-15 10:09:56: INSTALL_NODE=oel9reco
2026-08-15 10:09:56: ISROLLING=true
2026-08-15 10:09:56: IT=/etc/inittab
2026-08-15 10:09:56: JLIBDIR=/app/grid/product/19c/jlib
2026-08-15 10:09:56: JREDIR=/app/grid/product/19c/jdk/jre/
2026-08-15 10:09:56: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
2026-08-15 10:09:56: LISTENER_USERNAME=oracle
2026-08-15 10:09:56: MGMT_DB=false
2026-08-15 10:09:56: MSGFILE=/var/adm/messages
2026-08-15 10:09:56: NETWORKS=
2026-08-15 10:09:56: NEW_HOST_NAME_LIST=
2026-08-15 10:09:56: NEW_NODEVIPS=
2026-08-15 10:09:56: NEW_NODE_NAME_LIST=
2026-08-15 10:09:56: NEW_PRIVATE_NAME_LIST=
2026-08-15 10:09:56: NODE_NAME_LIST=
2026-08-15 10:09:56: OCRCONFIG=/etc/oracle/ocr.loc
2026-08-15 10:09:56: OCRCONFIGDIR=/etc/oracle
2026-08-15 10:09:56: OCRID=
2026-08-15 10:09:56: OCRLOC=ocr.loc
2026-08-15 10:09:56: OCR_LOCATIONS=
2026-08-15 10:09:56: ODA_CONFIG=
2026-08-15 10:09:56: OLASTGASPDIR=/etc/oracle/lastgasp
2026-08-15 10:09:56: OLD_CRS_HOME=
2026-08-15 10:09:56: OLRCONFIG=/etc/oracle/olr.loc
2026-08-15 10:09:56: OLRCONFIGDIR=/etc/oracle
2026-08-15 10:09:56: OLRLOC=olr.loc
2026-08-15 10:09:56: OPC_CLUSTER_TYPE=
2026-08-15 10:09:56: OPC_NAT_ADDRESS=
2026-08-15 10:09:56: OPROCDCHECKDIR=/etc/oracle/oprocd/check
2026-08-15 10:09:56: OPROCDDIR=/etc/oracle/oprocd
2026-08-15 10:09:56: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
2026-08-15 10:09:56: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
2026-08-15 10:09:56: ORACLE_BASE=/app/oracle
2026-08-15 10:09:56: ORACLE_HOME=/app/grid/product/19c
2026-08-15 10:09:56: ORACLE_OWNER=oracle
2026-08-15 10:09:56: ORA_ASM_GROUP=dba
2026-08-15 10:09:56: ORA_DBA_GROUP=oinstall
2026-08-15 10:09:56: PING_TARGETS=
2026-08-15 10:09:56: PRIVATE_NAME_LIST=
2026-08-15 10:09:56: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
2026-08-15 10:09:56: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d
2026-08-15 10:09:56: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
2026-08-15 10:09:56: RC_KILL=K15
2026-08-15 10:09:56: RC_KILL_OLD=K96
2026-08-15 10:09:56: RC_KILL_OLD2=K19
2026-08-15 10:09:56: RC_START=S96
2026-08-15 10:09:56: REUSEDG=false
2026-08-15 10:09:56: RHP_CONF=false
2026-08-15 10:09:56: RHP_PROVISIONED=
2026-08-15 10:09:56: RIM_NODE_LIST=
2026-08-15 10:09:56: SCAN_CREDENTIALS=
2026-08-15 10:09:56: SCAN_IPS=0racle_install_crs_OPC_SCAN_IPs%
2026-08-15 10:09:56: SCAN_NAME=
2026-08-15 10:09:56: SCAN_PORT=0
2026-08-15 10:09:56: SCAN_TYPE=
2026-08-15 10:09:56: SCRBASE=/etc/oracle/scls_scr
2026-08-15 10:09:56: SILENT=true
2026-08-15 10:09:56: SO_EXT=so
2026-08-15 10:09:56: SRVCFGLOC=srvConfig.loc
2026-08-15 10:09:56: SRVCONFIG=/var/opt/oracle/srvConfig.loc
2026-08-15 10:09:56: SRVCONFIGDIR=/var/opt/oracle
2026-08-15 10:09:56: SYSTEMCTL=/usr/bin/systemctl
2026-08-15 10:09:56: SYSTEMD_SYSTEM_DIR=/etc/systemd/system
2026-08-15 10:09:56: TZ=Asia/Seoul
2026-08-15 10:09:56: UPSTART_INIT_DIR=/etc/init
2026-08-15 10:09:56: USER_IGNORED_PREREQ=true
2026-08-15 10:09:56: VNDR_CLUSTER=false
2026-08-15 10:09:56: VOTING_DISKS=
2026-08-15 10:09:56: ### Printing other configuration values ###
2026-08-15 10:09:56: CLSCFG_EXTRA_PARMS=
2026-08-15 10:09:56: HAS_GROUP=oinstall
2026-08-15 10:09:56: HAS_USER=oracle
2026-08-15 10:09:56: HOST=chg19c
2026-08-15 10:09:56: LOCK_ACFS=1
2026-08-15 10:09:56: OLR_DIRECTORY=/app/oracle/crsdata/chg19c/olr
2026-08-15 10:09:56: OLR_LOCATION=/app/oracle/crsdata/chg19c/olr/chg19c_19.olr
2026-08-15 10:09:56: ORACLERESTART=0
2026-08-15 10:09:56: ORA_CRS_HOME=/app/grid/product/19c
2026-08-15 10:09:56: ORA_VERSION=19
2026-08-15 10:09:56: SIHA=1
2026-08-15 10:09:56: SUCC_REBOOT=0
2026-08-15 10:09:56: SUPERUSER=root
2026-08-15 10:09:56: cluutil_trc_suff_pp=0
2026-08-15 10:09:56: crscfg_trace=1
2026-08-15 10:09:56: crscfg_trace_file=/app/oracle/crsdata/chg19c/crsconfig/roothas_2026-08-15_10-09-56AM.log
2026-08-15 10:09:56: old_nodevips=
2026-08-15 10:09:56: osdfile=/app/grid/product/19c/crs/install/s_crsconfig_defs
2026-08-15 10:09:56: parameters_valid=1
2026-08-15 10:09:56: paramfile=/app/grid/product/19c/crs/install/crsconfig_params
2026-08-15 10:09:56: platform_family=unix
2026-08-15 10:09:56: pp_srvctl_trc_suff=0
2026-08-15 10:09:56: srvctl_trc_suff=0
2026-08-15 10:09:56: srvctl_trc_suff_pp=0
2026-08-15 10:09:56: stackStartLevel=11
2026-08-15 10:09:56: user_is_superuser=1
2026-08-15 10:09:56: ### Printing of configuration values complete ###
2026-08-15 10:09:56: Print system environment variables:
2026-08-15 10:09:56: BASH_FUNC_which% = () { ( alias;
eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
}
2026-08-15 10:09:56: DBUS_SESSION_BUS_ADDRESS = unix:path=/run/user/0/bus
2026-08-15 10:09:56: DEBUGINFOD_IMA_CERT_PATH = /etc/keys/ima:
2026-08-15 10:09:56: DISPLAY = localhost:12.0
2026-08-15 10:09:56: HOME = /root
2026-08-15 10:09:56: LANG = en_US.UTF-8
2026-08-15 10:09:56: LD_LIBRARY_PATH = /app/grid/product/19c/lib:
2026-08-15 10:09:56: LESSOPEN = ||/usr/bin/lesspipe.sh
2026-08-15 10:09:56: LOGNAME = root
2026-08-15 10:09:56: LS_COLORS = rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.m4a=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.oga=01;36:*.opus=01;36:*.spx=01;36:*.xspf=01;36:
2026-08-15 10:09:56: MOTD_SHOWN = pam
2026-08-15 10:09:56: OLDPWD = /root
2026-08-15 10:09:56: ORACLE_BASE = /app/oracle
2026-08-15 10:09:56: ORACLE_HOME = /app/grid/product/19c
2026-08-15 10:09:56: PATH = /root/.local/bin:/root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
2026-08-15 10:09:56: PWD = /app/grid/product/19c/crs/install
2026-08-15 10:09:56: SHELL = /bin/bash
2026-08-15 10:09:56: SHLVL = 2
2026-08-15 10:09:56: SSH_CLIENT = 10.212.134.204 56384 22
2026-08-15 10:09:56: SSH_CONNECTION = 10.212.134.204 56384 10.70.101.164 22
2026-08-15 10:09:56: SSH_TTY = /dev/pts/2
2026-08-15 10:09:56: S_COLORS = auto
2026-08-15 10:09:56: TERM = xterm
2026-08-15 10:09:56: TZ = Asia/Seoul
2026-08-15 10:09:56: USER = root
2026-08-15 10:09:56: XDG_DATA_DIRS = /root/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share:/usr/local/share:/usr/share
2026-08-15 10:09:56: XDG_RUNTIME_DIR = /run/user/0
2026-08-15 10:09:56: XDG_SESSION_CLASS = user
2026-08-15 10:09:56: XDG_SESSION_ID = 8
2026-08-15 10:09:56: XDG_SESSION_TYPE = tty
2026-08-15 10:09:56: _ = /app/grid/product/19c/perl/bin/perl
2026-08-15 10:09:56: which_declare = declare -f
2026-08-15 10:09:56: Locking the files under bin and lib for ACFS
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfscm>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsdriverstate>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfshanfs>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsiob>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsload>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrd>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsregistrymount>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsremote>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_apply>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_apply.bin>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_dupd>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_dupd.bin>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_initializer>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_monitor>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_preapply>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_transport>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsreplcrs>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrm>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfsroot>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/bin/acfssinglefsmount>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfsdriverstate.pl>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfshanfs.pl>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfslib.pm>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfsload.pl>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfsr_member>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfsregistrymount.pl>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfsremote.pl>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfsreplcrs.pl>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfsroot.pl>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfssinglefsmount.pl>
2026-08-15 10:09:56: Set superuser at the acfs file </app/grid/product/19c/lib/acfstoolsdriver.sh>
2026-08-15 10:09:56: Set superuser at the libabcfs file </app/grid/product/19c/lib/libacfs19.a>
2026-08-15 10:09:56: Set superuser at the libabcfs file </app/grid/product/19c/lib/libacfs19.so>
|
로그 초반에 2026-08-15 10:09:56: Current node is not the install node 라고 표시됨
최근에 hostname을 oel9reco에서 chg19c로 변경을 해서 발생한 문제로 확인함
참고 : 오라클 19c Restart 환경 hostname 변경 가이드 ( https://positivemh.tistory.com/1402 )
분명 db도 잘 기동되어 있는데 문제가 발생함
roothas.sh -lockacfs를 수행할 때 /app/grid/product/19c/crs/install/crsconfig_params를 참고하는듯함
crsconfig_params 파일에서 이전 호스트네임 존재 여부 확인
|
1
2
3
4
|
$ grep -E 'INSTALL_NODE|EXTENDED_CLUSTER_SITES' \
/app/grid/product/19c/crs/install/crsconfig_params
INSTALL_NODE=oel9reco
EXTENDED_CLUSTER_SITES=oel9reco
|
2건 존재함
updateNodeList 수행
|
1
2
3
4
5
6
7
8
9
10
|
$ /app/grid/product/19c/oui/bin/runInstaller \
-updateNodeList \
ORACLE_HOME=/app/grid/product/19c \
-defaultHomeName \
CLUSTER_NODES= \
CRS=TRUE
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 8191 MB Passed
The inventory pointer is located at /etc/oraInst.loc
|
crsconfig_params 파일 재확인
|
1
2
3
4
|
$ grep -E 'INSTALL_NODE|EXTENDED_CLUSTER_SITES' \
/app/grid/product/19c/crs/install/crsconfig_params
INSTALL_NODE=oel9reco
EXTENDED_CLUSTER_SITES=oel9reco
|
그대로 존재함
수동으로 변경
|
1
2
3
4
5
6
7
8
|
# vi /app/grid/product/19c/crs/install/crsconfig_params
#기존
INSTALL_NODE=oel9reco
EXTENDED_CLUSTER_SITES=oel9reco
#변경
INSTALL_NODE=chg19c
EXTENDED_CLUSTER_SITES=chg19c
|
acfs enable(lockacfs) 재수행
|
1
2
3
4
|
# ./roothas.sh -lockacfs
Using configuration parameter file: /app/grid/product/19c/crs/install/crsconfig_params
The log of current session can be found at:
/app/oracle/crsdata/chg19c/crsconfig/roothas_2026-08-15_10-25-50AM.log
|
로그 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
|
# cat /app/oracle/crsdata/chg19c/crsconfig/roothas_2026-08-15_10-25-50AM.log
2026-08-15 10:25:50: Checking parameters from paramfile /app/grid/product/19c/crs/install/crsconfig_params to validate installer variables
2026-08-15 10:25:50: Install node: chg19c
2026-08-15 10:25:50: Current node is the install node
2026-08-15 10:25:50: cache CLUSTER_CLASS to /app/oracle/crsdata/@global/environmentInfo.cache
2026-08-15 10:25:50: clusterClass =
2026-08-15 10:25:50: The configuration parameter file /app/grid/product/19c/crs/install/crsconfig_params is valid
2026-08-15 10:25:50: Run command --/app/grid/product/19c/bin/oraversion -libVersion-- as oracle
2026-08-15 10:25:50: /app/grid/product/19c/bin/oraversion -libVersion successfully executed
2026-08-15 10:25:50: Command output:
> 19
>End Command output
2026-08-15 10:25:50: "/app/grid/product/19c/bin/oraversion -libVersion" output: 19
2026-08-15 10:25:50: Run command --/app/grid/product/19c/bin/oraversion -majorVersion-- as oracle
2026-08-15 10:25:50: /app/grid/product/19c/bin/oraversion -majorVersion successfully executed
2026-08-15 10:25:50: Command output:
> 19
>End Command output
2026-08-15 10:25:50: "/app/grid/product/19c/bin/oraversion -majorVersion" output: 19
2026-08-15 10:25:50: ### Printing the configuration values from files:
2026-08-15 10:25:50: /app/grid/product/19c/crs/install/crsconfig_params
2026-08-15 10:25:50: /app/grid/product/19c/crs/install/s_crsconfig_defs
2026-08-15 10:25:50: AFD_CONF=false
2026-08-15 10:25:50: APPLICATION_VIP=
2026-08-15 10:25:50: ASMCA_ARGS=
2026-08-15 10:25:50: ASM_CONFIG=
2026-08-15 10:25:50: ASM_CREDENTIALS=
2026-08-15 10:25:50: ASM_DISCOVERY_STRING=ORCL:*
2026-08-15 10:25:50: ASM_SPFILE=
2026-08-15 10:25:50: ASM_UPGRADE=false
2026-08-15 10:25:50: BIG_CLUSTER=false
2026-08-15 10:25:50: CDATA_AUSIZE=1
2026-08-15 10:25:50: CDATA_BACKUP_AUSIZE=1
2026-08-15 10:25:50: CDATA_BACKUP_DISKS=
2026-08-15 10:25:50: CDATA_BACKUP_DISK_GROUP=
2026-08-15 10:25:50: CDATA_BACKUP_FAILURE_GROUPS=
2026-08-15 10:25:50: CDATA_BACKUP_QUORUM_GROUPS=
2026-08-15 10:25:50: CDATA_BACKUP_REDUNDANCY=
2026-08-15 10:25:50: CDATA_BACKUP_SITES=
2026-08-15 10:25:50: CDATA_BACKUP_SIZE=0
2026-08-15 10:25:50: CDATA_DISKS=
2026-08-15 10:25:50: CDATA_DISK_GROUP=DATA
2026-08-15 10:25:50: CDATA_FAILURE_GROUPS=
2026-08-15 10:25:50: CDATA_QUORUM_GROUPS=
2026-08-15 10:25:50: CDATA_REDUNDANCY=
2026-08-15 10:25:50: CDATA_SITES=
2026-08-15 10:25:50: CDATA_SIZE=0
2026-08-15 10:25:50: CLSCFG_MISSCOUNT=
2026-08-15 10:25:50: CLUSTER_CLASS=
2026-08-15 10:25:50: CLUSTER_GUID=
2026-08-15 10:25:50: CLUSTER_NAME=
2026-08-15 10:25:50: CLUSTER_TYPE=
2026-08-15 10:25:50: CRS_LIMIT_CORE=unlimited
2026-08-15 10:25:50: CRS_LIMIT_MEMLOCK=unlimited
2026-08-15 10:25:50: CRS_LSNR_STACK=32768
2026-08-15 10:25:50: CRS_NODEVIPS=
2026-08-15 10:25:50: CRS_STORAGE_OPTION=0
2026-08-15 10:25:50: CSS_LEASEDURATION=400
2026-08-15 10:25:50: DC_HOME=
2026-08-15 10:25:50: DIRPREFIX=
2026-08-15 10:25:50: DISABLE_OPROCD=0
2026-08-15 10:25:50: EXTENDED_CLUSTER=false
2026-08-15 10:25:50: EXTENDED_CLUSTER_SITES=chg19c
2026-08-15 10:25:50: EXTENDED_CLUSTER_SITE_GUIDS=
2026-08-15 10:25:50: EXTERNAL_ORACLE=/opt/oracle
2026-08-15 10:25:50: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
2026-08-15 10:25:50: GIMR_CONFIG=
2026-08-15 10:25:50: GIMR_CREDENTIALS=
2026-08-15 10:25:50: GNS_ADDR_LIST=
2026-08-15 10:25:50: GNS_ALLOW_NET_LIST=
2026-08-15 10:25:50: GNS_CONF=false
2026-08-15 10:25:50: GNS_CREDENTIALS=
2026-08-15 10:25:50: GNS_DENY_ITF_LIST=
2026-08-15 10:25:50: GNS_DENY_NET_LIST=
2026-08-15 10:25:50: GNS_DOMAIN_LIST=
2026-08-15 10:25:50: GNS_TYPE=
2026-08-15 10:25:50: GPNPCONFIGDIR=/app/grid/product/19c
2026-08-15 10:25:50: GPNPGCONFIGDIR=/app/grid/product/19c
2026-08-15 10:25:50: GPNP_PA=
2026-08-15 10:25:50: HUB_NODE_LIST=
2026-08-15 10:25:50: HUB_NODE_VIPS=
2026-08-15 10:25:50: HUB_SIZE=0
2026-08-15 10:25:50: ID=/etc/init.d
2026-08-15 10:25:50: INIT=/sbin/init
2026-08-15 10:25:50: INITCTL=/sbin/initctl
2026-08-15 10:25:50: INSTALL_NODE=chg19c
2026-08-15 10:25:50: ISROLLING=true
2026-08-15 10:25:50: IT=/etc/inittab
2026-08-15 10:25:50: JLIBDIR=/app/grid/product/19c/jlib
2026-08-15 10:25:50: JREDIR=/app/grid/product/19c/jdk/jre/
2026-08-15 10:25:50: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
2026-08-15 10:25:50: LISTENER_USERNAME=oracle
2026-08-15 10:25:50: MGMT_DB=false
2026-08-15 10:25:50: MSGFILE=/var/adm/messages
2026-08-15 10:25:50: NETWORKS=
2026-08-15 10:25:50: NEW_HOST_NAME_LIST=
2026-08-15 10:25:50: NEW_NODEVIPS=
2026-08-15 10:25:50: NEW_NODE_NAME_LIST=
2026-08-15 10:25:50: NEW_PRIVATE_NAME_LIST=
2026-08-15 10:25:50: NODE_NAME_LIST=
2026-08-15 10:25:50: OCRCONFIG=/etc/oracle/ocr.loc
2026-08-15 10:25:50: OCRCONFIGDIR=/etc/oracle
2026-08-15 10:25:50: OCRID=
2026-08-15 10:25:50: OCRLOC=ocr.loc
2026-08-15 10:25:50: OCR_LOCATIONS=
2026-08-15 10:25:50: ODA_CONFIG=
2026-08-15 10:25:50: OLASTGASPDIR=/etc/oracle/lastgasp
2026-08-15 10:25:50: OLD_CRS_HOME=
2026-08-15 10:25:50: OLRCONFIG=/etc/oracle/olr.loc
2026-08-15 10:25:50: OLRCONFIGDIR=/etc/oracle
2026-08-15 10:25:50: OLRLOC=olr.loc
2026-08-15 10:25:50: OPC_CLUSTER_TYPE=
2026-08-15 10:25:50: OPC_NAT_ADDRESS=
2026-08-15 10:25:50: OPROCDCHECKDIR=/etc/oracle/oprocd/check
2026-08-15 10:25:50: OPROCDDIR=/etc/oracle/oprocd
2026-08-15 10:25:50: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
2026-08-15 10:25:50: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
2026-08-15 10:25:50: ORACLE_BASE=/app/oracle
2026-08-15 10:25:50: ORACLE_HOME=/app/grid/product/19c
2026-08-15 10:25:50: ORACLE_OWNER=oracle
2026-08-15 10:25:50: ORA_ASM_GROUP=dba
2026-08-15 10:25:50: ORA_DBA_GROUP=oinstall
2026-08-15 10:25:50: PING_TARGETS=
2026-08-15 10:25:50: PRIVATE_NAME_LIST=
2026-08-15 10:25:50: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
2026-08-15 10:25:50: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d
2026-08-15 10:25:50: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
2026-08-15 10:25:50: RC_KILL=K15
2026-08-15 10:25:50: RC_KILL_OLD=K96
2026-08-15 10:25:50: RC_KILL_OLD2=K19
2026-08-15 10:25:50: RC_START=S96
2026-08-15 10:25:50: REUSEDG=false
2026-08-15 10:25:50: RHP_CONF=false
2026-08-15 10:25:50: RHP_PROVISIONED=
2026-08-15 10:25:50: RIM_NODE_LIST=
2026-08-15 10:25:50: SCAN_CREDENTIALS=
2026-08-15 10:25:50: SCAN_IPS=0racle_install_crs_OPC_SCAN_IPs%
2026-08-15 10:25:50: SCAN_NAME=
2026-08-15 10:25:50: SCAN_PORT=0
2026-08-15 10:25:50: SCAN_TYPE=
2026-08-15 10:25:50: SCRBASE=/etc/oracle/scls_scr
2026-08-15 10:25:50: SILENT=true
2026-08-15 10:25:50: SO_EXT=so
2026-08-15 10:25:50: SRVCFGLOC=srvConfig.loc
2026-08-15 10:25:50: SRVCONFIG=/var/opt/oracle/srvConfig.loc
2026-08-15 10:25:50: SRVCONFIGDIR=/var/opt/oracle
2026-08-15 10:25:50: SYSTEMCTL=/usr/bin/systemctl
2026-08-15 10:25:50: SYSTEMD_SYSTEM_DIR=/etc/systemd/system
2026-08-15 10:25:50: TZ=Asia/Seoul
2026-08-15 10:25:50: UPSTART_INIT_DIR=/etc/init
2026-08-15 10:25:50: USER_IGNORED_PREREQ=true
2026-08-15 10:25:50: VNDR_CLUSTER=false
2026-08-15 10:25:50: VOTING_DISKS=
2026-08-15 10:25:50: ### Printing other configuration values ###
2026-08-15 10:25:50: CLSCFG_EXTRA_PARMS=
2026-08-15 10:25:50: HAS_GROUP=oinstall
2026-08-15 10:25:50: HAS_USER=oracle
2026-08-15 10:25:50: HOST=chg19c
2026-08-15 10:25:50: LOCK_ACFS=1
2026-08-15 10:25:50: OLR_DIRECTORY=/app/oracle/crsdata/chg19c/olr
2026-08-15 10:25:50: OLR_LOCATION=/app/oracle/crsdata/chg19c/olr/chg19c_19.olr
2026-08-15 10:25:50: ORACLERESTART=0
2026-08-15 10:25:50: ORA_CRS_HOME=/app/grid/product/19c
2026-08-15 10:25:50: ORA_VERSION=19
2026-08-15 10:25:50: SIHA=1
2026-08-15 10:25:50: SUCC_REBOOT=0
2026-08-15 10:25:50: SUPERUSER=root
2026-08-15 10:25:50: cluutil_trc_suff_pp=0
2026-08-15 10:25:50: crscfg_trace=1
2026-08-15 10:25:50: crscfg_trace_file=/app/oracle/crsdata/chg19c/crsconfig/roothas_2026-08-15_10-25-50AM.log
2026-08-15 10:25:50: old_nodevips=
2026-08-15 10:25:50: osdfile=/app/grid/product/19c/crs/install/s_crsconfig_defs
2026-08-15 10:25:50: parameters_valid=1
2026-08-15 10:25:50: paramfile=/app/grid/product/19c/crs/install/crsconfig_params
2026-08-15 10:25:50: platform_family=unix
2026-08-15 10:25:50: pp_srvctl_trc_suff=0
2026-08-15 10:25:50: srvctl_trc_suff=0
2026-08-15 10:25:50: srvctl_trc_suff_pp=0
2026-08-15 10:25:50: stackStartLevel=11
2026-08-15 10:25:50: user_is_superuser=1
2026-08-15 10:25:50: ### Printing of configuration values complete ###
2026-08-15 10:25:50: Print system environment variables:
2026-08-15 10:25:50: BASH_FUNC_which% = () { ( alias;
eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
}
2026-08-15 10:25:50: DBUS_SESSION_BUS_ADDRESS = unix:path=/run/user/0/bus
2026-08-15 10:25:50: DEBUGINFOD_IMA_CERT_PATH = /etc/keys/ima:
2026-08-15 10:25:50: DISPLAY = localhost:12.0
2026-08-15 10:25:50: HOME = /root
2026-08-15 10:25:50: LANG = en_US.UTF-8
2026-08-15 10:25:50: LD_LIBRARY_PATH = /app/grid/product/19c/lib:
2026-08-15 10:25:50: LESSOPEN = ||/usr/bin/lesspipe.sh
2026-08-15 10:25:50: LOGNAME = root
2026-08-15 10:25:50: LS_COLORS = rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.m4a=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.oga=01;36:*.opus=01;36:*.spx=01;36:*.xspf=01;36:
2026-08-15 10:25:50: MOTD_SHOWN = pam
2026-08-15 10:25:50: OLDPWD = /root
2026-08-15 10:25:50: ORACLE_BASE = /app/oracle
2026-08-15 10:25:50: ORACLE_HOME = /app/grid/product/19c
2026-08-15 10:25:50: PATH = /root/.local/bin:/root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
2026-08-15 10:25:50: PWD = /app/grid/product/19c/crs/install
2026-08-15 10:25:50: SHELL = /bin/bash
2026-08-15 10:25:50: SHLVL = 2
2026-08-15 10:25:50: SSH_CLIENT = 10.212.134.204 56384 22
2026-08-15 10:25:50: SSH_CONNECTION = 10.212.134.204 56384 10.70.101.164 22
2026-08-15 10:25:50: SSH_TTY = /dev/pts/2
2026-08-15 10:25:50: S_COLORS = auto
2026-08-15 10:25:50: TERM = xterm
2026-08-15 10:25:50: TZ = Asia/Seoul
2026-08-15 10:25:50: USER = root
2026-08-15 10:25:50: XDG_DATA_DIRS = /root/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share:/usr/local/share:/usr/share
2026-08-15 10:25:50: XDG_RUNTIME_DIR = /run/user/0
2026-08-15 10:25:50: XDG_SESSION_CLASS = user
2026-08-15 10:25:50: XDG_SESSION_ID = 8
2026-08-15 10:25:50: XDG_SESSION_TYPE = tty
2026-08-15 10:25:50: _ = /app/grid/product/19c/perl/bin/perl
2026-08-15 10:25:50: which_declare = declare -f
2026-08-15 10:25:50: Locking the files under bin and lib for ACFS
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfscm>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsdriverstate>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfshanfs>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsiob>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsload>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrd>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsregistrymount>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsremote>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_apply>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_apply.bin>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_dupd>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_dupd.bin>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_initializer>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_monitor>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_preapply>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrepl_transport>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsreplcrs>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsrm>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfsroot>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/bin/acfssinglefsmount>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfsdriverstate.pl>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfshanfs.pl>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfslib.pm>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfsload.pl>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfsr_member>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfsregistrymount.pl>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfsremote.pl>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfsreplcrs.pl>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfsroot.pl>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfssinglefsmount.pl>
2026-08-15 10:25:50: Set superuser at the acfs file </app/grid/product/19c/lib/acfstoolsdriver.sh>
2026-08-15 10:25:50: Set superuser at the libabcfs file </app/grid/product/19c/lib/libacfs19.a>
2026-08-15 10:25:50: Set superuser at the libabcfs file </app/grid/product/19c/lib/libacfs19.so>
|
이제는 2026-08-15 10:25:50: Current node is the install node 라고 나옴
볼륨 enable 재시도시 동일 에러 발생함
|
1
2
3
|
$ asmcmd volenable -G DATA acfs_my_vol
ORA-15032: not all alterations performed
ORA-15480: error reported in the ASM volume driver (DBD ERROR: OCIStmtExecute)
|
restart 재시작
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
|
# /app/grid/product/19c/bin/crsctl stop has
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'chg19c'
CRS-2673: Attempting to stop 'ora.oracle19.db' on 'chg19c'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'chg19c'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'chg19c' succeeded
CRS-2677: Stop of 'ora.oracle19.db' on 'chg19c' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'chg19c'
CRS-2677: Stop of 'ora.DATA.dg' on 'chg19c' succeeded
CRS-2673: Attempting to stop 'ora.evmd' on 'chg19c'
CRS-2673: Attempting to stop 'ora.asm' on 'chg19c'
CRS-2677: Stop of 'ora.evmd' on 'chg19c' succeeded
CRS-2677: Stop of 'ora.asm' on 'chg19c' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'chg19c'
CRS-2677: Stop of 'ora.cssd' on 'chg19c' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'chg19c' has completed
CRS-4133: Oracle High Availability Services has been stopped.
# /app/grid/product/19c/bin/crsctl start has
CRS-4123: Oracle High Availability Services has been started.
|
grid 상태 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
|
$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
ONLINE ONLINE chg19c STABLE
ora.LISTENER.lsnr
ONLINE ONLINE chg19c STABLE
ora.asm
ONLINE ONLINE chg19c Started,STABLE
ora.ons
OFFLINE OFFLINE chg19c STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.cssd
1 ONLINE ONLINE chg19c STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.evmd
1 ONLINE ONLINE chg19c STABLE
ora.oracle19.db
1 ONLINE OFFLINE chg19c Instance Shutdown,ST
ARTING
--------------------------------------------------------------------------------
|
다시 volinfo 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
|
ASMCMD> volinfo -G DATA acfs_my_vol
Diskgroup Name: DATA
Volume Name: ACFS_MY_VOL
Volume Device: /dev/asm/acfs_my_vol-150
State: DISABLED
Size (MB): 1024
Resize Unit (MB): 64
Redundancy: UNPROT
Stripe Columns: 8
Stripe Width (K): 1024
Usage:
Mountpath:
|
volenable 시도
|
1
2
|
ASMCMD> volenable -G DATA acfs_my_vol
(에러 발생안함)
|
volinfo 재확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
|
ASMCMD> volinfo -G DATA acfs_my_vol
Diskgroup Name: DATA
Volume Name: ACFS_MY_VOL
Volume Device: /dev/asm/acfs_my_vol-150
State: ENABLED
Size (MB): 1024
Resize Unit (MB): 64
Redundancy: UNPROT
Stripe Columns: 8
Stripe Width (K): 1024
Usage:
Mountpath:
|
State가 ENABLE로 변경됨
해당 디바이스 확인
|
1
2
|
# ls -l /dev/asm/acfs_my_vol-150
brwxrwx--- 1 root dba 250, 76801 Aug 15 10:35 /dev/asm/acfs_my_vol-150
|
잘 보임
해당 볼륨 디바이스를 acfs로 포맷
|
1
2
3
4
5
6
|
# /sbin/mkfs -t acfs /dev/asm/acfs_my_vol-150
mkfs.acfs: version = 19.0.0.0.0
mkfs.acfs: on-disk version = 46.0
mkfs.acfs: volume = /dev/asm/acfs_my_vol-150
mkfs.acfs: volume size = 1073741824 ( 1.00 GB )
mkfs.acfs: Format complete.
|
volinfo 재확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
|
$ asmcmd volinfo -G DATA acfs_my_vol
Diskgroup Name: DATA
Volume Name: ACFS_MY_VOL
Volume Device: /dev/asm/acfs_my_vol-150
State: ENABLED
Size (MB): 1024
Resize Unit (MB): 64
Redundancy: UNPROT
Stripe Columns: 8
Stripe Width (K): 1024
Usage: ACFS
Mountpath:
|
Usage 부분이 ACFS로 변경됨
파일시스템 생성
|
1
|
# mkdir -p /acfs
|
파일시스템 마운트
|
1
|
# /bin/mount -t acfs /dev/asm/acfs_my_vol-150 /acfs
|
확인
|
1
2
3
|
# df -hT /acfs
Filesystem Type Size Used Avail Use% Mounted on
/dev/asm/acfs_my_vol-150 acfs 1.0G 311M 714M 31% /acfs
|
volinfo 재확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
|
$ asmcmd volinfo -G DATA acfs_my_vol
Diskgroup Name: DATA
Volume Name: ACFS_MY_VOL
Volume Device: /dev/asm/acfs_my_vol-150
State: ENABLED
Size (MB): 1024
Resize Unit (MB): 64
Redundancy: UNPROT
Stripe Columns: 8
Stripe Width (K): 1024
Usage: ACFS
Mountpath: /acfs
|
Mountpath도 정상적으로 /acfs로 보임
권한 부여
|
1
2
|
# chown oracle:dba /acfs
# chmod 755 /acfs
|
재기동 후에도 잘 붙게끔 /etc/fstab에도 적용
|
1
2
|
# vi /etc/fstab
/dev/asm/acfs_my_vol-150 /acfs acfs noauto 0 0
|
참고. rac에서 마운트 방법
|
1
2
3
|
# srvctl add filesystem -volume acfs_my_vol -diskgroup DATA \
-path /acfs -fstype acfs -mountowner oracle \
-mountgroup dba -mountperm 755
|
grid 상태 확인
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
|
$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
ONLINE ONLINE chg19c STABLE
ora.LISTENER.lsnr
ONLINE ONLINE chg19c STABLE
ora.asm
ONLINE ONLINE chg19c Started,STABLE
ora.ons
OFFLINE OFFLINE chg19c STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.cssd
1 ONLINE ONLINE chg19c STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.evmd
1 ONLINE ONLINE chg19c STABLE
ora.oracle19.db
1 ONLINE ONLINE chg19c Open,HOME=/app/oracl
e/product/19c,STABLE
--------------------------------------------------------------------------------
|
Restart 환경에서는 RAC와는 다르게 acfs, advm 리소스가 grid에 등록되지는 않는다고함
공식 문서 중 : The Oracle ACFS registry resource is supported only for Oracle Grid Infrastructure cluster configurations; it is not supported for Oracle Restart configurations.
참고 : https://docs.oracle.com/en/database/oracle/oracle-database/19/ostmg/acfs-advanced-topics.html#GUID-9394890B-0CBF-4606-AC94-830FACF2D254
결론 :
Restart 환경에서 acfs를 사용하고 있을 때 hostname을 변경하는 경우
본문과 같이 /app/grid/product/19c/crs/install/crsconfig_params 파일도 수정해줘야 정상적으로 동작하는듯함
정확히는 acfs enable(lockacfs) 명령어(./roothas.sh -lockacfs) 수행 시 해당 파일을 참조하는데 그 파일에 이전 호스트네임이 적혀있어
acfs enable 처리가 제대로 수행되지 않았음. 수동으로 변경 후 grid 재시작 후 정상적으로 동작하는것을 확인하였음
테스트 케이스여서 모든 상황에 이렇게 된다라고 말할 순 없지만 /app/grid/product/19c/crs/install/crsconfig_params 파일은 유저가 변경하지 않는이상
runInstaller 명령으로는 업데이트가 안되기 때문에 이 파일 내의 호스트네임을 변경해줘야함
참조 :
https://docs.oracle.com/en/database/oracle/oracle-database/19/ladbi/enabling-oracle-acfs-on-oracle-restart-configurations.html
https://docs.oracle.com/en/database/oracle/oracle-database/19/ostmg/acfs-commands-linux.html#GUID-019B9315-870C-4F2A-BE5E-D4623639FACB
https://docs.oracle.com/en/database/oracle/oracle-database/19/ostmg/acfs-advanced-topics.html#GUID-C249903F-8CE1-4BE1-9D7A-3B065BF5AC54
https://docs.oracle.com/en/database/oracle/oracle-database/26/acfsg/steps-manage-acfs.html#GUID-37D5ACB8-BFBA-4CC2-B90F-C9C72C47F956
오라클 19c Restart 환경 hostname 변경 가이드 ( https://positivemh.tistory.com/1402 )
https://docs.oracle.com/en/error-help/db/advm-00606/?r=26ai
'ORACLE > Trouble Shooting' 카테고리의 다른 글
| ORA-12162: TNS:net service name is incorrectly specified (0) | 2026.07.25 |
|---|---|
| [INS-30508] Invalid ASM disks. (0) | 2026.06.28 |
| [INS-32403] The Installer has detected that the inventory location (0) | 2026.06.24 |
| ping: ora19fs: Name or service not known (0) | 2026.06.20 |
| ORA-19502: write error on file "/app/oracle/oradata/ORA19DBFS_BK/REDO_G2_9.LOG", block number 2566145 (block size=512) (0) | 2026.06.04 |