HiC2010-Cloud_Data_Management_Comprehension_Benchmark_and_Practice

《HiC2010-Cloud_Data_Management_Comprehension_Benchmark_and_Practice》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、CloudDataManagement:Comprehension,Benchmark,andPracticeChaiYunpeng,WAMDMLab,RUC1WAMDMLab,RUC2OutlineComprehensionBenchmarkPractice3ComprehensionIsCloudDataManagementNecessary?Storage:NAS,SAN,RAID,DFSDatabase:Oracle,mysql,PostgreSQL4ComprehensionChallengesofcurrentdatamanagementsystemsScalabi

2、lity57%everyyear(IDC)Doubleevery1.5years988EB(1EB=1024PB)datawillbeproducedin2010(IDC)Cost-effectiveFault-TolerantEvolving5ChallengesofScalabilityPervasiveComputingThinclient+servicesPC:Cheaplaptop(netbook)+explorerGoogle:Chrome+GoogleAppAmazon:EC2(CPU),S3(Storage)Hand-hold:Phone:iPhone

3、,AndriodTabletPC:iPad,Courier(Microsoft)service:MobileMe,iTune6ChallengesofScalability7ComprehensionChallengesofcurrentdatamanagementsystemsScalabilityCost-effectiveHardwareManagementFault-TolerantEvolving8ComprehensionChallengesofcurrentdatamanagementsystemsScalabilityCost-effectiveHar

4、dwareManagementFault-TolerantEvolving9ComprehensionChallengesofcurrentdatamanagementsystemsScalabilityCost-effectiveHardwareManagementFault-TolerantEvolving10ComprehensionFuturePictureofCloudDataManagementScalabilityExtremelargescaleCost-effectiveCommodityhardware(PC,SATADisk,SSD)Lar

5、ge-scale,unifiedplatformFault-TolerantEvolvingEasy-to-manageElasticstorageSupportallkindsofapplications11OutlineComprehensionBenchmarkPractice12BenchmarkHowtoreachtargets?Google:GFS/BigTable(HDFS/HBase)Amazon:Dynamo,SimpleDB,EC2,S3Facebook:CassandraMicrosoft:AzureYahoo!:PNUTSOthers:…1

6、3BenchmarkDFS-BASEDDBMS-BASEDMapReduceBigTableCouchDBHBaseVoldemortHyperTablePNUTSHiveSQLAzureGreenPlumHadoopDBCassandraSQL14TESTBEDSETUPServers:5HPcompaqdx75184coreCPU,7(4+3)GBRAM,1820GB(320GB+1500GB)SATA15HPcompaqdc7900(KP719AV)4coreCPU,8(4+4)GBRAM,2TB(500GB+1500GB)SATANetwork:Switch-H3CS50

7、48E(1000Mbps)OSLinux:Ubuntu9.04ServerSystemsHadoop0.20.2,Hive0.6.0,HBase0.20.3,Cassandra0.6-beta3,HadoopDB15NoSQLBenchmarkTasks:SequentialWrite(i)SequentialWriteSequentialReadRandomWrite(i)