资源描述：
《Efficient Object Storage Journaling in a Distributed Parallel File System版本》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、EfficientObjectStorageJournalinginaDistributedParallelFileSystemSarpOral,FeiyiWang,DavidDillow,GalenShipman,RossMillerNationalCenterforComputationalSciencesOakRidgeNationalLaboratory{oralhs,fwang2,gshipman,dillowda,rgmiller}@ornl.govOlegDrokinLustreCenterofExcellence
2、atORNLSunMicrosystemInc.oleg.drokin@sun.comAbstract1IntroductionLarge-scaleHPCsystemstargetabalanceoffileI/Oper-Journalingisawidelyusedtechniquetoincreasefilesys-formancewithcomputationalcapability.Traditionally,thetemrobustnessagainstmetadataand/ordatacorruptions.sta
3、ndardwas2bytespersecondofI/ObandwidthforeachWhiletheoverheadofjournalingcanbemaskedbythepage1,000FLOPsofcomputationalcapacity[18].Maintain-cacheforsmall-scale,localfilesystems,wefoundthatLus-ingthatbalancefora1Petaflops(PFLOPs)supercomputertre’suseofjournalingfortheob
4、jectstoresignificantlyim-wouldrequirethedeploymentastoragesubsystemcapa-pactedtheoverallperformanceofourlarge-scalecenter-bleofdelivering2TB/secofI/Obandwidthataminimum.wideparallelfilesystem.Byrequiringthateachwritere-Buildingsuchasystemwithcurrentornear-termstorageq
5、uestwaitforajournaltransactiontocommit,Lustrein-technologywouldrequireontheorderof100,000magnetictroducedserializationtotheclientrequeststreamandim-disks.Thiswouldbecostprohibitivenotonlyduetotheposedadditionallatencyduetodiskheadmovement(seeks)rawmaterialcostsofthe
6、disksthemselves,butalsototheforeachrequest.magnitudeofthedesign,installation,andongoingmanage-Inthispaper,wepresentthechallengeswefacedwhilementandelectricalcostsfortheentiresystem,includingdeployingaverylargescaleproductionstoragesystem.theRAIDcontrollers,networkli
7、nks,andswitches.AtthisOurworkprovidesahead-to-headcomparisonoftwosig-scale,reliabilitymetricsforeachcomponentwouldvirtu-nificantlydifferentapproachestoincreasingtheoveralleffi-allyguaranteethatsuchasystemwouldcontinuouslyoper-ciencyoftheLustrefilesystem.First,wepresent
8、ahardwareateinadegradedmodeduetoongoingsimultaneousrecon-solutionusingexternaljournalingdevicestoeliminatethestructionoperations[22].laten
