资源描述:
《disk-to–disk parallel sorting on hpvm clusters running windows ntnew》由会员上传分享,免费在线阅读,更多相关内容在教育资源-天天文库。
1、cCopyrightbyLuisFelipeRivera-Alvarez,2000DISK-TO-DISKPARALLELSORTINGONHPVMCLUSTERSRUNNINGWINDOWSNTBYLUISFELIPERIVERA-ALVAREZIngen.,UniversidadNacionalAutonomadeMexico,1995THESISSubmittedinpartialfulllmentoftherequirementsforthedegreeofMasterofScienceinCo
2、mputerScienceintheGraduateCollegeoftheUniversityofIllinoisatUrbana-Champaign,2000Urbana,IllinoisAbstractInordertomeasuredatabaseperformanceofcomputersystems,acollectionofcompaniesand1universitiesdenedthreebenchmarksin1985,includingadisk-to-disksortofonemil
3、lionrecords,whichbecameastandardfordatabasesystems.Aftertherstocialresultforthisbenchmarkin1986,performancesteadilyimprovedeachyearthereafter.In1996thebestsystemsfortheDatamationSortweremultiprocessors,andsince1997clustersofworkstationshavedominatedthesed
4、isk-to-disksortingbenchmarks.Weexplorethebenets,performancelimitations,andkeyarchitecturalissuesinvolvedinachievinghighperformanceindisk-to-disksorting.ThetestbedforthisworkwastheNCSANT-Supercluster,aclusterofPentium-IIworkstationsrunningWindowsNTandtheHPV
5、Msoft-waresuite.WeselectedtheMinuteSortbenchmark,whichrequiresthesortingofasmanyrecordsaspossibleinoneminute,astheperformancebenchmarkbecauseitoeredtheclearestopportunityforcomparison.OurworkbuildsontheBerkeleyNOWSort,adaptedandtunedfortheNT-Superclusteran
6、demployingthehighspeedcommunicationoftheFMlayer(FastMessages,fromtheHPVMsystem).TheMPI-FMlibrarywasusedasthecommunicationAPI,sinceitoeredalmostalltheunderlyingFMperformanceandsimpliedtheprogrammingeort,givenitshighlevelcommunicationandsynchronizationprim
7、itives.Usingaonepasssortarchitecture,ourMinuteSortbenchmarksorts10.3GBin56.51seconds2on60nodesoftheNTSupercluster,makingitthefastestknownMinuteSort.Eachmachineintheclustercomprisedtwo300MHzPentiumII's,512MBofmemory,anda4.3GB10000RPMUltraSCSIdisk.Thesystemwa
8、sabletosustain480MB/sofaggregatebandwidthfordatainput1NamedDatamationSortafteritwaspublishedintheDatamationmagazine.2AsofApril1999.iii(read)and660MB/sofaggregatebandwidthfordataoutput(write).Theprimary