资源描述:
《基于hbase查询引擎的业务支撑系统的设计与实现》由会员上传分享,免费在线阅读,更多相关内容在学术论文-天天文库。
1、哈尔滨工业大学工程硕士学位论文AbstractInrecentyears,theE-Businessindustrycontinuestodevelop,moreandmoreattentionsbythemostE-Businessareconcentratedonthelargedatastorage,extraction,calculation,analysisanddisplay.Withtheexplosivegrowthofbusinessdataandonurgentneedingofdataprocessingordataanalyzing,alsoduetotheintens
2、ificationofthecontradictionbetweenthedatastoragespaceanddataaccesstime,themostE-BusinesschoosedistributedstoragesystemHBasefordatastorage,tomeettheefficientdatainsertionandtheefficientdatareadoperation,buttheK-V'sdatamodelquerybyHBaseunabletomeetthebusinessdatamodelwhichtheuppersystemdemand.Inordert
3、osolvethisproblem,theauthorproposedtheneedsofbusinesssupportsystem,throughtheHBasequeryenginedataqueryanddatastandardoftwodatamodeltransformationstagetocompletetheconversionformK-Vdatamodeltorelationaldatamodelandfinallytothebusinessdatamodel.Thispaperbasedonthedevelopmentofthedatastandardizationstr
4、ategy,distributedSQLlikequerytechnologyandreal-timecalculationasthebackground,analyzedthedistributeddatastorageanddatastandardizationofthecurrentsituation,summeduptherequirementsfordataqueryanddatastandardization.Fromthetechnicalpointofview,thepaperintroducestheSQLparsing,cachingstrategy,coprocessor
5、andreal-timecalculate,finallyimplementstheefficientdataqueryandcomputeoperation.AnditcanprovidereferencefortheimplementationanddevelopmentoftheHBasebasedqueryengineandtheplatformoflargedatastandardization.ThebusinessoperationsupportingsystemuseJavalanguagetodevelopment,itrealizedtheHBasequeryenginea
6、nddatastandardizationandthedesignisdividedintologicalmodelofphysicallayer,datalogicmodellayerandbusinesslogicmodellayer.Physicalandlogicalmodellayerismainlythroughthemessagequeueandoff-linedatacomputingandtaskschedulingwillbeinthebottomofthereal-timedatawarehouseJRDWandofflinedatawarehouseJDWdataout
7、toHBasedistributedstoragesystem.LogicaldatamodellayerisdividedforK-Vlogicaldatamodelandrelationallogicaldatamodel,throughHBaseSQLlikequeryengineRunSQLwillquerytheincomeofK-Vlogicaldatamodeltransformat