Quantcast
Channel: ANBOB
Viewing all articles
Browse latest Browse all 708

Troubleshooting Oracle 19c RAC db crash with ORA-00600 [kcbbxsv_nwp]

$
0
0

db alert log

2020-06-12T05:01:44.048197+08:00
PDB(3):minact-scn: useg scan erroring out with error e:12751
2020-06-12T05:01:58.302414+08:00
Errors in file /u02/app/oracle/diag/rdbms/anbob/wgdb11/trace/wgdb11_dbwb_59726.trc  (incident=1280745) (PDBNAME=CDB$ROOT):
ORA-00600: internal error code, arguments: [kcbbxsv_nwp], [], [], [], [], [], [], [], [], [], [], []
Incident details in: /u02/app/oracle/diag/rdbms/wgdb1/wgdb11/incident/incdir_1280745/wgdb11_dbwb_59726_i1280745.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
2020-06-12T05:02:00.124461+08:00
Errors in file /u02/app/oracle/diag/rdbms/anbob/wgdb11/trace/wgdb11_dbwb_59726.trc:
ORA-00600: internal error code, arguments: [kcbbxsv_nwp], [], [], [], [], [], [], [], [], [], [], []
Errors in file /u02/app/oracle/diag/rdbms/wgdb1/wgdb11/trace/wgdb11_dbwb_59726.trc  (incident=1280746) (PDBNAME=CDB$ROOT):
ORA-471 [] [] [] [] [] [] [] [] [] [] [] []  <<<<<<<<
Incident details in: /u02/app/oracle/diag/rdbms/wgdb1/wgdb11/incident/incdir_1280746/wgdb11_dbwb_59726_i1280746.trc
2020-06-12T05:02:00.269879+08:00
Dumping diagnostic data in directory=[cdmp_20200612050200], requested by (instance=1, osid=59726 (DBWB)), summary=[incident=1280745].
2020-06-12T05:02:01.998825+08:00
USER (ospid: 59726): terminating the instance due to ORA error 471  <<<<<<<<
2020-06-12T05:02:09.324604+08:00
Instance terminated by USER(prelim), pid = 201552

trace file

*** 2020-06-12T05:01:58.303334+08:00
2020-06-12T05:01:58.303319+08:00
Incident 1280745 created, dump file: /u02/app/oracle/diag/rdbms/anbob/anbob1/incident/incdir_1280745/anbob1_dbwb_59726_i1280745.trc
ORA-00600: internal error code, arguments: [kcbbxsv_nwp], [], [], [], [], [], [], [], [], [], [], []
kge_experr : Found error ORA-600 not in expected list.
kge_experr: Dumping error frames [top = 1 : barrier top = 0]
kge_experr : [0] : Error = ORA-600 : 
Call stack = ksedsts()+426<-kge_snap_callstack()+77<-kgeadse()+557<-kgerinv_internal()+44
<-kgerinv()+40<-kserin()+180<-kcbbxsv()+17478<-kcbb_coalesce_int()+326<-kcbb_coalesce()+438<
-kcbbwthc()+817<-kcbbdrv()+8765<-ksb_act_run_int()+117<-ksb_act_run()+130<-ksbcti()+18
kge_experr: Dumping error frames - done
error 471 detected in background process
ORA-00600: internal error code, arguments: [kcbbxsv_nwp], [], [], [], [], [], [], [], [], [], [], []
2020-06-12T05:02:00.137498+08:00
Incident 1280746 created, dump file: /u02/app/oracle/diag/rdbms/anbob/anbob1/incident/incdir_1280746/anbob1_dbwb_59726_i1280746.trc
ORA-471 [] [] [] [] [] [] [] [] [] [] [] []
2020-06-12 05:02:01.983 :kjzduptcctx(): Notifying DIAG for crash event
 PROCESS STATE
-------------
Process global information:
     process: 0xee1ac44f0, call: 0xab52da458, xact: (nil), curses: 0xf6257d6e0, usrses: 0xf6257d6e0 <<<<<<<<<<<
     in_exception_handler: no
  ----------------------------------------
  SO: 0xf7fef76f8, type: process (2), map: 0xee1ac44f0
      state: LIVE (0x4532), flags: 0x1
      owner: (nil), proc: 0xf7fef76f8
      link: 0xf7fef7718[0xf7fef7718, 0xf7fef7718]
      child list count: 15, link: 0xf7fef7768[0xdbff094a8, 0xdbff098a8]
      conid: 1, conuid: 1, SGA version=(1,0), pg: 0
  SOC: 0xee1ac44f0, type: process (2), map: 0xf7fef76f8
       state: LIVE (0x99fc), flags: INIT (0x1)
  (process) Oracle pid:93, ser:1, calls cur/top: 0xab52da458/0xab52da458
            flags : (0x6) SYSTEM  icon_uid:0 logon_pdbid=0
            flags2: (0x800),  flags3: (0x10) 
            call error: 0, sess error: 0, txn error 0
            intr queue: empty
    (post info) last post received: 0 0 33
                last post received-location: ksa2.h LINE:298 ID:ksasnd
                last process to post me: 0xf21a5c338 1 6
                last post sent: 0 0 193
                last post sent-location: kjc.h LINE:2511 ID:KJCS Post snd proxy to flush msg
                last process posted by me: 0xf01a5e388 1 6
                waiter on post event: 0
    (latch info) hold_bits=0x0 ud_influx=0x19a7
    (osp latch info) hold_bits=0x0 ud_influx=0x0
    Process Group: DEFAULT, pseudo proc: 0xee1e6cf58
    O/S info: user: oracle, term: UNKNOWN, ospid: 59726 
    OSD pid info: 
    PDB SWITCH DEPTH : 0

   ----------------------------------------
    SO: 0xf7fe1ef90, type: session (4), map: 0xf6257d6e0
        state: LIVE (0x4532), flags: 0x1
        owner: 0xf7fef76f8, proc: 0xf7fef76f8
        link: 0xf7fe1efb0[0xf7f21de90, 0xf7f21de10]
        child list count: 2, link: 0xf7fe1f000[0xdbff87fa8, 0xe7fd12340]
        conid: 1, conuid: 1, SGA version=(1,0), pg: 0
    SOC: 0xf6257d6e0, type: session (4), map: 0xf7fe1ef90  <<<<<<<<<<<
         state: LIVE (0x99fc), flags: INIT (0x1)
    (session) sid: 4465 ser: 57003 trans: (nil), creator: 0xee1ac44f0
              flags: (0x51) USR/- flags2: (0x409) -/-/INC
              flags_idl: (0x1) status: BSY/-/-/- kill: -/-/-/-
              DID: 0001-005D-000000020000-0000-00000000, short-term DID: 
              txn branch: (nil)
              con_id/con_uid/con_name: 1/1/CDB$ROOT
              con_logonuid: 1 con_logonid: 1
              con_scuid: 1 con_scid: 1
              edition#: 0              user#/name: 0/SYS
              oct: 0, prv: 0, sql: (nil), psql: (nil)
              stats: 0xb1ffe1be0, PX stats: 0x12a0df44
    service name: SYS$BACKGROUND
    Current Wait Stack:
      Not in wait; last wait ended 2.446949 sec ago     <<<<<<<<<<<
    Wait State:
      fixed_waits=0 flags=0x21 boundary=(nil)/-1

kgerinv()+40 kernel generic error record internal named error with va_list
kserin()+180 kernel service error [partial hit for: kse ]
kcbbxsv()+17478 kernel cache buffers databasewriter take single buffer and check if we have to return to LRU
kcbb_coalesce_int()+326 kernel cache buffers databasewriter [partial hit for: kcbb ]
kcbb_coalesce()+438 kernel cache buffers databasewriter [partial hit for: kcbb ]
kcbbwthc()+817 kernel cache buffers databasewriter [partial hit for: kcbb ]
kcbbdrv()+8765 kernel cache buffers databasewriter central write driver
ksb_act_run_int()+117 kernel service background processes [partial hit for: ksb ]
ksb_act_run()+130 kernel service background processes [partial hit for: ksb ]
ksbcti() kernel service background processes call timeout/interrupts

MOS search callstack matched BUG 30486436.

INTERNAL PROBLEM DESCRIPTION:
A weak lock may be blocked due to a refuse bast was dropped for incorrect DRM check when refuse bast was issued right after DRM lock replay.

INTERNAL FIX DESCRIPTION:
Add check in refuse bast to handle DRM just replayed the lock. The refuse bast would be valid and should be honored.


Viewing all articles
Browse latest Browse all 708

Trending Articles