如果自己搞不定可以找诗檀软件专业ORACLE数据库修复团队成员帮您恢复!
诗檀软件专业数据库修复团队
服务热线 ： 13764045638 QQ号:47079569 邮箱：service@parnassusdata.com
ORA-17503: ksfdopn:2 Failed to open file +DATA/hisdb/control02.ctl
注意当操作系统和存储之间出现IO错误时可能导致ORACLE ASM自动存储管理无法读取关键的ASM metadata，在下面的例子中 由于
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
IBM AIX RISC System/6000 Error: 5: I/O error
IBM AIX 小机出现无法读取/dev/rhdiskdata4 裸设备上的数据块，导致ASM实例无法读取关键性的ASM FILE 1 文件指针信息，此时将无法读取其他asm源数据，虽然可能ASM diskgroup可以mount，但却无法读取任何diskgroup 中的文件，启动数据库也会报错。
Dirty Detach Reconfiguration complete Fri Jun 24 15:37:39 BEIST 2016 freeing rdom 1 Fri Jun 24 15:37:39 BEIST 2016 WARNING: dirty detached from domain 1 Fri Jun 24 15:37:39 BEIST 2016 SUCCESS: diskgroup DATA was dismounted Fri Jun 24 15:37:39 BEIST 2016 Errors in file /u01/oracle/admin/+ASM/bdump/+asm1_b000_16121950.trc: ORA-15001: diskgroup "DATA" does not exist or is not mounted Fri Jun 24 15:37:39 BEIST 2016 WARNING: PST-initiated MANDATORY DISMOUNT of group DATA not performed - group not mounted Fri Jun 24 15:37:39 BEIST 2016 Errors in file /u01/oracle/admin/+ASM/bdump/+asm1_b001_17891466.trc: ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted Fri Jun 24 15:38:13 BEIST 2016 SQL> alter diskgroup data mount Fri Jun 24 15:38:13 BEIST 2016 NOTE: cache registered group DATA number=1 incarn=0x3b18e4ab Fri Jun 24 15:38:13 BEIST 2016 NOTE: Hbeat: instance first (grp 1) Fri Jun 24 15:38:18 BEIST 2016 NOTE: start heartbeating (grp 1) NOTE: cache opening disk 0 of grp 1: DATA_0000 path:/dev/rhdiskdata1 Fri Jun 24 15:38:18 BEIST 2016 NOTE: F1X0 found on disk 0 fcn 0.0 NOTE: cache opening disk 1 of grp 1: DATA_0001 path:/dev/rhdiskdata2 NOTE: cache opening disk 2 of grp 1: DATA_0002 path:/dev/rhdiskdata3 NOTE: cache opening disk 3 of grp 1: DATA_0003 path:/dev/rhdiskdata4 NOTE: cache mounting (first) group 1/0x3B18E4AB (DATA) * allocate domain 1, invalid = TRUE Fri Jun 24 15:38:18 BEIST 2016 NOTE: attached to recovery domain 1 Fri Jun 24 15:38:18 BEIST 2016 NOTE: starting recovery of thread=1 ckpt=136.4125 group=1 NOTE: advancing ckpt for thread=1 ckpt=136.4125 NOTE: cache recovered group 1 to fcn 0.20885584 Fri Jun 24 15:38:18 BEIST 2016 NOTE: LGWR attempting to mount thread 1 for disk group 1 NOTE: LGWR mounted thread 1 for disk group 1 NOTE: opening chunk 1 at fcn 0.20885584 ABA NOTE: seq=137 blk=4126 Fri Jun 24 15:38:18 BEIST 2016 NOTE: cache mounting group 1/0x3B18E4AB (DATA) succeeded SUCCESS: diskgroup DATA was mounted Fri Jun 24 15:38:21 BEIST 2016 NOTE: recovering COD for group 1/0x3b18e4ab (DATA) SUCCESS: completed COD recovery for group 1/0x3b18e4ab (DATA) Fri Jun 24 15:38:28 BEIST 2016 Errors in file /u01/oracle/admin/+ASM/udump/+asm1_ora_15532158.trc: ORA-27091: unable to queue I/O ORA-27072: File I/O error IBM AIX RISC System/6000 Error: 5: I/O error Additional information: 7 Additional information: 47104 Additional information: -1 Fri Jun 24 15:38:28 BEIST 2016 WARNING: IO Failed. au:23 diskname:/dev/rhdiskdata4 rq:110433db0 buffer:110612000 au_offset(bytes):0 iosz:65536 operation:0 status:2 WARNING: cache failed to read gn 1 fn 1 blk 256 count 16 from disk 3 ERROR: cache failed to read fn=1 blk=256 from disk(s): 3 ORA-15080: synchronous I/O operation to a disk failed NOTE: cache initiating offline of disk 3 group 1 WARNING: process 15532158 initiating offline of disk 3.3587706990 (DATA_0003) with mask 0x3 in group 1 WARNING: Disk 3 in group 1 in mode: 0x7,state: 0x2 will be taken offline NOTE: PST update: grp = 1, dsk = 3, mode = 0x6 Fri Jun 24 15:38:28 BEIST 2016 ERROR: too many offline disks in PST (grp 1) Fri Jun 24 15:38:28 BEIST 2016 WARNING: Disk 3 in group 1 in mode: 0x7,state: 0x2 was taken offline Fri Jun 24 15:38:28 BEIST 2016 ERROR: PST-initiated MANDATORY DISMOUNT of group DATA Fri Jun 24 15:38:28 BEIST 2016 NOTE: halting all I/Os to diskgroup DATA NOTE: active pin found: 0x700000015faec28 NOTE: active pin found: 0x700000015faeee8 NOTE: active pin found: 0x700000015faf1a8 NOTE: active pin found: 0x700000015faf468 NOTE: active pin found: 0x700000015faecd8 NOTE: active pin found: 0x700000015faef98 NOTE: active pin found: 0x700000015faf258 NOTE: active pin found: 0x700000015faf518 NOTE: active pin found: 0x700000015faed88 NOTE: active pin found: 0x700000015faf048 NOTE: active pin found: 0x700000015faf308 NOTE: active pin found: 0x700000015faf5c8 NOTE: active pin found: 0x700000015faee38 NOTE: active pin found: 0x700000015faf0f8 NOTE: active pin found: 0x700000015faf3b8 NOTE: active pin found: 0x700000015faeb78 Fri Jun 24 15:38:28 BEIST 2016 NOTE: cache dismounting group 1/0x3B18E4AB (DATA) Fri Jun 24 15:38:30 BEIST 2016 Dirty detach reconfiguration started (old inc 9, new inc 9) List of nodes: 0 Global Resource Directory partially frozen for dirty detach * dirty detach - domain 1 invalid = TRUE 276 GCS resources traversed, 0 cancelled 6104 GCS resources on freelist, 6124 on array, 6124 allocated Dirty Detach Reconfiguration complete Fri Jun 24 15:38:30 BEIST 2016 freeing rdom 1 Fri Jun 24 15:38:30 BEIST 2016 WARNING: dirty detached from domain 1 Fri Jun 24 15:38:30 BEIST 2016 SUCCESS: diskgroup DATA was dismounted Fri Jun 24 15:38:30 BEIST 2016 Errors in file /u01/oracle/admin/+ASM/bdump/+asm1_b000_16121950.trc: ORA-15001: diskgroup "DATA" does not exist or is not mounted Fri Jun 24 15:38:30 BEIST 2016 WARNING: PST-initiated MANDATORY DISMOUNT of group DATA not performed - group not mounted Fri Jun 24 15:38:30 BEIST 2016 Errors in file /u01/oracle/admin/+ASM/bdump/+asm1_b001_17891466.trc: ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted Fri Jun 24 15:38:34 BEIST 2016 SQL> alter diskgroup data mount Fri Jun 24 15:38:34 BEIST 2016 NOTE: cache registered group DATA number=1 incarn=0xbef8e4b0 Fri Jun 24 15:38:34 BEIST 2016 NOTE: Hbeat: instance first (grp 1) Fri Jun 24 15:38:39 BEIST 2016 NOTE: start heartbeating (grp 1) NOTE: cache opening disk 0 of grp 1: DATA_0000 path:/dev/rhdiskdata1 Fri Jun 24 15:38:39 BEIST 2016 NOTE: F1X0 found on disk 0 fcn 0.0 NOTE: cache opening disk 1 of grp 1: DATA_0001 path:/dev/rhdiskdata2 NOTE: cache opening disk 2 of grp 1: DATA_0002 path:/dev/rhdiskdata3 NOTE: cache opening disk 3 of grp 1: DATA_0003 path:/dev/rhdiskdata4 NOTE: cache mounting (first) group 1/0xBEF8E4B0 (DATA) * allocate domain 1, invalid = TRUE Fri Jun 24 15:38:39 BEIST 2016 NOTE: attached to recovery domain 1 Fri Jun 24 15:38:39 BEIST 2016 NOTE: starting recovery of thread=1 ckpt=137.4127 group=1 NOTE: advancing ckpt for thread=1 ckpt=137.4127 NOTE: cache recovered group 1 to fcn 0.20885588 Fri Jun 24 15:38:39 BEIST 2016 NOTE: LGWR attempting to mount thread 1 for disk group 1 NOTE: LGWR mounted thread 1 for disk group 1 NOTE: opening chunk 1 at fcn 0.20885588 ABA NOTE: seq=138 blk=4128 Fri Jun 24 15:38:39 BEIST 2016 NOTE: cache mounting group 1/0xBEF8E4B0 (DATA) succeeded SUCCESS: diskgroup DATA was mounted Fri Jun 24 15:38:42 BEIST 2016 NOTE: recovering COD for group 1/0xbef8e4b0 (DATA) SUCCESS: completed COD recovery for group 1/0xbef8e4b0 (DATA) Fri Jun 24 16:02:23 BEIST 2016 alter database mount Fri Jun 24 16:02:23 BEIST 2016 ORA-15000 signalled during: alter database mount... Fri Jun 24 16:02:43 BEIST 2016 Errors in file /u01/oracle/admin/+ASM/udump/+asm1_ora_21495942.trc: ORA-27091: unable to queue I/O ORA-27072: File I/O error IBM AIX RISC System/6000 Error: 5: I/O error Additional information: 7 Additional information: 47112 Additional information: -1 Fri Jun 24 16:02:43 BEIST 2016 WARNING: IO Failed. au:23 diskname:/dev/rhdiskdata4 rq:110433b60 buffer:70000001046c000 au_offset(bytes):4096 iosz:4096 operation:0 status:2 WARNING: cache failed to read gn 1 fn 1 blk 257 count 1 from disk 3 ERROR: cache failed to read fn=1 blk=257 from disk(s): 3 ORA-15080: synchronous I/O operation to a disk failed NOTE: cache initiating offline of disk 3 group 1 WARNING: process 21495942 initiating offline of disk 3.3587706994 (DATA_0003) with mask 0x3 in group 1 WARNING: Disk 3 in group 1 in mode: 0x7,state: 0x2 will be taken offline NOTE: PST update: grp = 1, dsk = 3, mode = 0x6 Fri Jun 24 16:02:43 BEIST 2016 ERROR: too many offline disks in PST (grp 1) Fri Jun 24 16:02:43 BEIST 2016 WARNING: Disk 3 in group 1 in mode: 0x7,state: 0x2 was taken offline Fri Jun 24 16:02:43 BEIST 2016 ERROR: PST-initiated MANDATORY DISMOUNT of group DATA Fri Jun 24 16:02:43 BEIST 2016 NOTE: halting all I/Os to diskgroup DATA NOTE: active pin found: 0x700000015faeb78 NOTE: active pin found: 0x700000015faec28 Fri Jun 24 16:02:43 BEIST 2016 NOTE: cache dismounting group 1/0xBEF8E4B0 (DATA) Fri Jun 24 16:02:45 BEIST 2016 Dirty detach reconfiguration started (old inc 9, new inc 9) List of nodes: 0
启动数据库时报错：
ORA-00210: cannot open the specified control file
ORA-00202: control file: ‘+DATA/hisdb/control02.ctl’
ORA-17503: ksfdopn:2 Failed to open file +DATA/hisdb/control02.ctl
ORA-15001: diskgroup “DATA” does not exist or is not mounted
ORA-15001: diskgroup “DATA” does not exist or is not mounted
ORA-205 signalled during: alter database mount…
Fri Jun 24 15:31:13 BEIST 2016 SUCCESS: diskgroup DATA was dismounted SUCCESS: diskgroup DATA was dismounted Fri Jun 24 15:31:15 BEIST 2016 ORA-00210: cannot open the specified control file ORA-00202: control file: '+DATA/hisdb/control02.ctl' ORA-17503: ksfdopn:2 Failed to open file +DATA/hisdb/control02.ctl ORA-15130: diskgroup "DATA" is being dismounted ORA-15066: offlining disk "DATA_0003" may result in a data loss Fri Jun 24 15:31:15 BEIST 2016 ORA-205 signalled during: alter database mount... Fri Jun 24 15:34:25 BEIST 2016 NOTE: ASMB process exiting due to lack of ASM file activity for 195 seconds Fri Jun 24 15:34:25 BEIST 2016 Stopping background process RBAL Fri Jun 24 16:02:38 BEIST 2016 alter database mount Fri Jun 24 16:02:38 BEIST 2016 This instance was first to mount Fri Jun 24 16:02:38 BEIST 2016 Starting background process ASMB ASMB started with pid=27, OS id=23134340 Starting background process RBAL RBAL started with pid=28, OS id=10223654 Fri Jun 24 16:02:43 BEIST 2016 SUCCESS: diskgroup DATA was mounted Fri Jun 24 16:02:43 BEIST 2016 SUCCESS: diskgroup DATA was dismounted SUCCESS: diskgroup DATA was dismounted Fri Jun 24 16:02:45 BEIST 2016 ORA-00210: cannot open the specified control file ORA-00202: control file: '+DATA/hisdb/control02.ctl' ORA-17503: ksfdopn:2 Failed to open file +DATA/hisdb/control02.ctl ORA-15130: diskgroup "DATA" is being dismounted ORA-15066: offlining disk "DATA_0003" may result in a data loss Fri Jun 24 16:02:45 BEIST 2016 ORA-205 signalled during: alter database mount... Fri Jun 24 16:03:06 BEIST 2016 alter database mount This instance was first to mount Fri Jun 24 16:03:06 BEIST 2016 ORA-00210: cannot open the specified control file ORA-00202: control file: '+DATA/hisdb/control02.ctl' ORA-17503: ksfdopn:2 Failed to open file +DATA/hisdb/control02.ctl ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-15001: diskgroup "DATA" does not exist or is not mounted ORA-205 signalled during: alter database mount...
对于此种情况需要使用特殊恢复技巧扫描这些ORACLE ASM Diskgroup数据并做到数据恢复重组， 具体可以咨询诗檀软件ORACLE恢复团队。
Comment