资源描述:
《Bigtable_A Distributed Storage System for Structured Data .pdf》由会员上传分享,免费在线阅读,更多相关内容在学术论文-天天文库。
1、Bigtable:ADistributedStorageSystemforStructuredDataFayChang,JeffreyDean,SanjayGhemawat,WilsonC.Hsieh,DeborahA.WallachMikeBurrows,TusharChandra,AndrewFikes,RobertE.Gruberffay,jeff,sanjay,wilsonh,kerr,m3b,tushar,kes,gruberg@google.comGoogle,Inc.Abstractachievedscalabilityandhighpe
2、rformance,butBigtableprovidesadifferentinterfacethansuchsystems.BigtableBigtableisadistributedstoragesystemformanagingdoesnotsupportafullrelationaldatamodel;instead,itstructureddatathatisdesignedtoscaletoaverylargeprovidesclientswithasimpledatamodelthatsupportssize:petabytesofdat
3、aacrossthousandsofcommoditydynamiccontroloverdatalayoutandformat,andal-servers.ManyprojectsatGooglestoredatainBigtable,lowsclientstoreasonaboutthelocalitypropertiesoftheincludingwebindexing,GoogleEarth,andGoogleFi-datarepresentedintheunderlyingstorage.Dataisin-nance.Theseapplicat
4、ionsplaceverydifferentdemandsdexedusingrowandcolumnnamesthatcanbearbitraryonBigtable,bothintermsofdatasize(fromURLstostrings.Bigtablealsotreatsdataasuninterpretedstrings,webpagestosatelliteimagery)andlatencyrequirementsalthoughclientsoftenserializevariousformsofstruc-(frombackend
5、bulkprocessingtoreal-timedataserving).turedandsemi-structureddataintothesestrings.ClientsDespitethesevarieddemands,Bigtablehassuccessfullycancontrolthelocalityoftheirdatathroughcarefulprovidedaexible,high-performancesolutionforallofchoicesintheirschemas.Finally,Bigtableschemapa-
6、theseGoogleproducts.Inthispaperwedescribethesim-rametersletclientsdynamicallycontrolwhethertoservepledatamodelprovidedbyBigtable,whichgivesclientsdataoutofmemoryorfromdisk.dynamiccontroloverdatalayoutandformat,andwede-scribethedesignandimplementationofBigtable.Section2describesth
7、edatamodelinmoredetail,andSection3providesanoverviewoftheclientAPI.Sec-tion4brieydescribestheunderlyingGoogleinfrastruc-1IntroductiontureonwhichBigtabledepends.Section5describesthefundamentalsoftheBigtableimplementation,andSec-Overthelasttwoandahalfyearswehavedesigned,tion6descr
8、ibessomeoftherenementsthatwemadeimpleme