资源描述：
《2015 container技术峰会-docker与mesos的结合应用》由会员上传分享，免费在线阅读，更多相关内容在教育资源-天天文库。
1、2015Container技术峰会-Docker与Mesos的结合应用基于Mesos和Docker的分布式计算平台王璞@数人科技2015/04/18WhyDistributedSystem???CostDistributedSystemDesignPrinciples??Scalability??moremediocremachinesthanafewpowerfulones??NoSINGLEPOINTFAILURE(faulttolerance)??Serviceduplication/multipleinstances??Datareplica??H
2、ighAvailability??Servicerequests:Loadbalancing/Servicediscovery??Datarequests:Sharding/Consistenthashing??Datalocality(lesscommunication)DistributedInfrastructure@DataMan??Automaticallymanagecomputingresources??scaleouttohundreds,thousands,millionsofservers??pseudosingleserverfrom
3、thedeveloper’spointof6><#00aa00'>view??FunctionallysimilartoanOS??Farfrommature??centralizedOSiswaymorematurethandistributedOS??notforendusers,butfordevelopers??justarunningenvironmentLinuxOSv.s.Distributed“OS”??3Masters,synchronizedbyZookeeper??~100Slaves,each2core4G??Frameworks:
4、Marathon,Chronos,Spark,StormMesosMesos:Fine-GrainedSharingFramework1Framework2Framework3Coarse-GrainedSharing(HPC):Fine-GrainedSharing(Mesos):+Improvedutilization,responsiveness,datalocalityStorageSystem(e.g.HDFS)StorageSystem(e.g.HDFS)Fw.1Fw.1Fw.3Fw.3Fw.2Fw.2Fw.2Fw.1Fw.3Fw.2Fw.3F
5、w.1Fw.1Fw.2Fw.2Fw.1Fw.3Fw.3Fw.3Fw.2Fw.2??Offeravailableresourcestoframeworks,letthempickwhichresourcestouseandwhichtaskstolaunch+KeepsMesossimple,letsitsupportfutureframeworks-DecentralizeddecisionsmightnotbeoptimalMesos:ResourceOffersSparkjobSparkschedulerHadoopjobHadoopscheduler
6、AllocationmoduleMesosmasterMesosslaveSparkexecutorMesosslaveSparkexecutortasktaskResourceofferPickframeworktoofferresourcestoMesosArchitectureMesosArchitectureSparkjobSparkschedulerHadoopjobHadoopschedulerAllocationmoduleMesosmasterMesosslaveSparkexecutorMesosslaveSparkexecutortas
7、ktaskPickframeworktoofferresourcestoResourceofferResourceoffer=listof(node,availableResources)E.g.{(node1,<2CPUs,3GB>),(node2,<1CPUs,2GB>)}SparkjobSparkschedulerHadoopjobHadoopschedulerAllocationmoduleMesosmasterMesosslaveSparkexecutorHadoopexecutorMesosslaveSparkexecu
8、tortasktaskPickframeworktoofferre
