资源描述：
《The Google File System .pdf》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、TheGoogleFileSystemSanjayGhemawat,HowardGobioff,andShun-TakLeungGoogle∗ABSTRACT1.INTRODUCTIONWehavedesignedandimplementedtheGoogleFileSys-WehavedesignedandimplementedtheGoogleFileSys-tem,ascalabledistributedfilesystemforlargedistributedtem(GFS)tomeettherapidlygrowin
2、gdemandsofGoogle’sdata-intensiveapplications.Itprovidesfaulttolerancewhiledataprocessingneeds.GFSsharesmanyofthesamegoalsrunningoninexpensivecommodityhardware,anditdeliversaspreviousdistributedfilesystemssuchasperformance,highaggregateperformancetoalargenumberofclie
3、nts.scalability,reliability,andavailability.However,itsdesignWhilesharingmanyofthesamegoalsaspreviousdis-hasbeendrivenbykeyobservationsofourapplicationwork-tributedfilesystems,ourdesignhasbeendrivenbyobser-loadsandtechnologicalenvironment,bothcurrentandan-vationsofo
4、urapplicationworkloadsandtechnologicalenvi-ticipated,thatreflectamarkeddeparturefromsomeearlierronment,bothcurrentandanticipated,thatreflectamarkedfilesystemdesignassumptions.Wehavereexaminedtradi-departurefromsomeearlierfilesystemassumptions.Thistionalchoicesandexplor
5、edradicallydifferentpointsinthehasledustoreexaminetraditionalchoicesandexplorerad-designspace.icallydifferentdesignpoints.First,componentfailuresarethenormratherthantheThefilesystemhassuccessfullymetourstorageneeds.exception.ThefilesystemconsistsofhundredsorevenItiswid
6、elydeployedwithinGoogleasthestorageplatformthousandsofstoragemachinesbuiltfrominexpensivecom-forthegenerationandprocessingofdatausedbyourser-moditypartsandisaccessedbyacomparablenumberofviceaswellasresearchanddevelopmenteffortsthatrequireclientmachines.Thequantityan
7、dqualityofthecompo-largedatasets.Thelargestclustertodateprovideshun-nentsvirtuallyguaranteethatsomearenotfunctionalatdredsofterabytesofstorageacrossthousandsofdisksonanygiventimeandsomewillnotrecoverfromtheircur-overathousandmachines,anditisconcurrentlyaccessedrent
8、failures.Wehaveseenproblemscausedbyapplicationbyhundredsofclients.bugs,operatingsystembugs,humanerrors,andthefailuresInthispaper,wepresentfilesyst
