资源描述：
《hadoop分布式系统存储数据库云计算(6)》由会员上传分享，免费在线阅读，更多相关内容在行业资料-天天文库。
1、Experiment-drivenSystemManagementShivnathBabuDukeUniversityJointworkwithSongyunDuan,HerodotosHerodotou,andVamsidharThummalaManagingDBsinSmalltoMediumBusinessEnterprises(SMBs)PeterisasystemadmininanSMBManagesthedatabase(DB)SMBcannotaffordaDBASupposePeterhastotuneapoorly-perf
2、ormingDBDesignadvisormaynothelpMaybetheproblemiswithDBconfigurationparametersDatabase(DB)TuningDBConfigurationParametersParametersthatcontrolMemorydistributionI/OoptimizationParallelismOptimizer’scostmodelNumberofparameters~10015-25criticalparamsdependingonOLAPVs.OLTPFewhol
3、isticparametertuningtoolsavailablePetermayhavetoresortto1000+pagetuningmanualsorrulesofthumbfromexpertsCanbeafrustratingexperienceResponseSurfacesTPC-H4GBDBsize,1GBmemory,Query182-dimProjectionofa11-dimSurfaceDBA’sApproachtoParameterTuningDBAsrunexperimentsHere,anexperiment
4、isarunoftheDBworkloadwithaspecificparameterconfigurationCommonstrategy:varyoneDBparameteratatimeExperiment-drivenManagementAremoreexperimentsneeded?ProcessoutputtoextractinformationPlannextsetofexperimentsConductexperimentsonworkbenchYesMgmt.taskResultGoal:Automatethisproce
5、ssRoadmapUsecasesofexperiment-drivenmgmt.Querytuning,benchmarking,Hadoop,testing,…iTuned:ToolforDBconfparametertuningEnd-to-endapplicationofexperiment-drivenmgmt..eX:Languageandrun-timesystemthatbringsexperiment-drivenmgmt.tousers&tuningtoolsWhatisanExperiment?Dependsonthem
6、anagementtaskPaysomeextracost,getnewinformationinreturnEvenforaspecificmanagementtask,therecanbespectrumofpossibleexperimentsUsesofExperiment-drivenMgmt.DBconfparametertuningUsesofExperiment-drivenMgmt.DBconfparametertuningMapReducejobtuninginHadoopUsesofExperiment-drivenMg
7、mt.DBconfparametertuningMapReducejobtuninginHadoopServerbenchmarkingCapacityplanningCost/perfmodelingSortHashAggregateNestedLoopJoinHashJoinSequentialScan(lineitem)HashHashJoinSequentialScan(supplier)HashSequentialScan(nation)IndexScan(orders)<100,187><100,187><100,436><1,0
8、.6><2473,7496><380459,229739><65,309><65,309><1,1><1,1><1629,1615>
