资源描述:
《oraclerac宕机分析报告》由会员上传分享,免费在线阅读,更多相关内容在工程资料-天天文库。
1、Oraclerac宕机分析报告某客户rac数据库2号节点实例自动宕节点,以下为分析报告一、现象回顾:2号节点发生故障时,alertS志显示如下:Thread2advancedtologsequence77740(LGWRswitch)Currentlog#24seq#77740mem#0:/dev/rcrm4_rd2_91_2GCurrentlog#24seq#77740mem#1:/dev/rcrm4_rd2_92_2GMonMar2809:45:23BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:46:52BEIST2011
2、PMONfailedtoacquirelatch,seePMONdumpMonMar2809:47:52BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:47:53BEIST2011Thread2advancedtologsequence77741(LGWRswitch)Currentlog#25seq#77741mem#0:/dev/rcrm5_rd2_101_2GCurrentlog#25seq#77741mem#1:/dev/rcrm5_rd2_102_2GMonMar2809:48:52BEIST2011PMONfaile
3、dtoacquirelatch,seePMONdumpMonMar2809:49:52BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:50:52BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:51:52BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:52:53BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:53:53BEIST2011PMO
4、Nfailedtoacquirelatch,seePMONdumpMonMar2809:54:53BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:55:53BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:56:53BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:57:53BEIST2011PMONfailedtoacquirelatch,seePMONdumpMonMar2809:58:44BEIST2
5、011Receivedaninstanceabortmessagefrominstance1(reason0x0)Pleasecheckinstance1alertandLMONtracefilesfordetail.LMDO:terminatinginstanceduetoerror481MonMar2809:58:45BEIST2011SystemstatedumpismadeforlocalinstanceSystemStatedumpedtotracefile/opt/oracle/admin/crrndb/bdump/crmdb2_diag_3732132・trcMonMar280
6、9:58:45BEIST2011Shuttingdowninstance(abort)Licensehighwatermark=2290从alert日志来看,二号节点主要表现为PMON进程不能获得latch(PMONfailedtoacquirelatch),超时等待10分钟,Z后接受到一号节点将二号节点宕机指令(Receivedaninstanceabortmessagefrominstance1(reason0x0)),LMD0进程将实例abort(LMD0:terminatinginstanceduetoerror481),并在宕机之前系统自动做了systemstatedump(Sys
7、temstatedumpismadeforlocalinstance),宕机之前用户在2节点的会话数为2290个(Licensehighwatermark=2290)□采用ass.awk工具分析crmdb2_diag_3732132.trc可以得到如下结果:StartingSystemstate1Ass.AwkVersion1.0.9・Process!ngcrmdb2_diag_3732132.trcSyst