资源描述：
《google_file_system 英文文献资料》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、TheGoogleFileSystemSanjayGhemawat,HowardGobioff,andShun-TakLeungGoogle∗ABSTRACT1.INTRODUCTIONWehavedesignedandimplementedtheGoogleFileSys-WehavedesignedandimplementedtheGoogleFileSys-tem,ascalabledistributedfilesystemforlargedistributedtem(GFS)tomeettherapidlygrowingdemandsofGoogle’sda
2、ta-intensiveapplications.Itprovidesfaulttolerancewhiledataprocessingneeds.GFSsharesmanyofthesamegoalsrunningoninexpensivecommodityhardware,anditdeliversaspreviousdistributedfilesystemssuchasperformance,highaggregateperformancetoalargenumberofclients.scalability,reliability,andavailabil
3、ity.However,itsdesignWhilesharingmanyofthesamegoalsaspreviousdis-hasbeendrivenbykeyobservationsofourapplicationwork-tributedfilesystems,ourdesignhasbeendrivenbyobser-loadsandtechnologicalenvironment,bothcurrentandan-vationsofourapplicationworkloadsandtechnologicalenvi-ticipated,thatrefl
4、ectamarkeddeparturefromsomeearlierronment,bothcurrentandanticipated,thatreflectamarkedfilesystemdesignassumptions.Wehavereexaminedtradi-departurefromsomeearlierfilesystemassumptions.Thistionalchoicesandexploredradicallydifferentpointsinthehasledustoreexaminetraditionalchoicesandexplorerad
5、-designspace.icallydifferentdesignpoints.First,componentfailuresarethenormratherthantheThefilesystemhassuccessfullymetourstorageneeds.exception.ThefilesystemconsistsofhundredsorevenItiswidelydeployedwithinGoogleasthestorageplatformthousandsofstoragemachinesbuiltfrominexpensivecom-fortheg
6、enerationandprocessingofdatausedbyourser-moditypartsandisaccessedbyacomparablenumberofviceaswellasresearchanddevelopmenteffortsthatrequireclientmachines.Thequantityandqualityofthecompo-largedatasets.Thelargestclustertodateprovideshun-nentsvirtuallyguaranteethatsomearenotfunctionalatdre
7、dsofterabytesofstorageacrossthousandsofdisksonanygiventimeandsomewillnotrecoverfromtheircur-overathousandmachines,anditisconcurrentlyaccessedrentfailures.Wehaveseenproblemscausedbyapplicationbyhundredsofclients.bugs,operatingsystembugs,humanerrors,andthefailuresInthispaper,wepresentfil
8、esyst
