资源描述：
《Google Architecture.pdf》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、http://highscalability.com/google-architectureGoogleArchitectureSaturday,November22,2008at10:01AMToddHoffinBigTable,C,ClusterFileSystem,Example,Geo-distributedClusters,Java,Linux,MapReduce,PythonUpdate2:Sorting1PBwithMapReduce.PBisnotpeanut-butter-and-jellymisspelled.It's1petabyteor1000ter
2、abytesor1,000,000gigabytes.Ittooksixhoursandtwominutestosort1PB(10trillion100-byterecords)on4,000computersandtheresultswerereplicatedthriceon48,000disks.Update:GregLindenpointstoanewGooglearticleMapReduce:simplifieddataprocessingonlargeclusters.Someinterestingstats:100kMapReducejobsareexec
3、utedeachday;morethan20petabytesofdataareprocessedperday;morethan10kMapReduceprogramshavebeenimplemented;machinesaredualprocessorwithgigabitethernetand4-8GBofmemory.GoogleistheKingofscalability.EveryoneknowsGooglefortheirlarge,sophisticated,andfastsearching,buttheydon'tjustshineinsearch.The
4、irplatformapproachtobuildingscalableapplicationsallowsthemtorolloutinternetscaleapplicationsatanalarminglyhighcompetitioncrushingrate.Theirgoalisalwaystobuildahigherperforminghigherscalinginfrastructuretosupporttheirproducts.Howdotheydothat?InformationSources1.Video:BuildingLargeSystemsatG
5、oogle2.GoogleLab:TheGoogleFileSystem3.GoogleLab:MapReduce:SimplifiedDataProcessingonhttp://weibo.com/developerworks2012-11-11整理第1／9页http://highscalability.com/google-architectureLargeClusters4.GoogleLab:BigTable.5.Video:BigTable:ADistributedStructuredStorageSystem.6.GoogleLab:TheChubbyLock
6、ServiceforLoosely-CoupledDistributedSystems.7.HowGoogleWorksbyDavidCarrinBaselineMagazine.8.GoogleLab:InterpretingtheData:ParallelAnalysiswithSawzall.9.DareObasonjo'sNotesonthescalabilityconference.Platform1.Linux2.Alargediversityoflanguages:Python,Java,C++What'sInside?TheStats1.Estimated4
7、50,000low-costcommodityserversin20062.In2005Googleindexed8billionwebpages.Bynow,whoknows?3.Currentlythereover200GFSclustersatGoogle.Aclustercanhave1000oreven5000machines.PoolsoftensofthousandsofmachinesretrievedatafromGFSclustersthatrunaslargeas5petabytesofsto
