hadoop集群测试报告

《hadoop集群测试报告》由会员上传分享，免费在线阅读，更多相关内容在工程资料-天天文库。

1、Hadoop集群测试报告1•测试环境硬件环境主机名机型大体配羞功能Linux版本hadoop1HPDL388G7CPU2.53G24cores/24G内存/2・300Gnaaenode/SecondaiyNaMeNode/jobtiacker/jiaster/hadoop2HPDL388G7CPU2.53G24cores/24G内存/2・300Ghadoop21机<6cores/10G/60G)datanode/1asktracker/recionserverhadooD22hadoop5HPDL300G6CPU2.63GI6coi

2、res/24G内存/2・300G

3、km宙似机《6coires/8G/150G)anode/tasktracker/rc&onserverhadoop6hadoop3HPDL300G6HPDL388G7KvniQfmvikocorev9//iouj；CPU2.53G8cores/16G内存/2・300GCPU2.5X24co“s/24G内存/2・300Caaxanoae/ia^Ktracxer/refionserverd&tanode/tasktracker/recionserverRHEL6.2hadoop31datanode/t

4、asktracker/re^ionserverhadoop32datanode/tasktracker/rejionserverhadoop4HPDL388G7CPU2.53G24cores/24G内存/2拿300Ghadoop41datanode/tasktracker/re^ionserverhadoop42datanode/1asktracker/regionserver软件环境oRHEL6.22.6.32-220.el6.x86_64ohadoop-1.0.2ohive-0.&1ohbase-0.92.1oOracle11g

5、_r2(64位)oKVMoMySQL-server-5.5.23-1,el6.x86_64ojdk-7u3-linux-x64osqoop-1.4.1-incubating—hadoop-l.O.O.targz2•集群部署listerIcbTrackcrdatanodedatnnodc如也nod”dAtJinoiicMglorwzrrogicmsionF^rr^gk«ngen*»rr»>xirlaskTrackerta

6、akTrackcrUskTnKkcrt«skTrnckcrhadixj(i31hack»<»p51ha4oop32hjjkk»o(pH庇如玮62hadoap!2hddxip3hadoopShadoi)i>trpgionf^rvar3eHadoop集群基准测试3.1写测试写10个1000M的文件lroot@hadoopIhadoop]#hadoopjarhadoop-test-1.0.2.jarTestDFSIO-write-nrFiles10-fileSize1000结果：TestDFSIO:writeDate&time:TueJu

7、l1010:52:56CST2012Numberoffiles:10TotalMBytesprocessed:10000Throughputmb/sec:19.991963230781227AverageIOratemb/sec:20.200298309326172IOratestddeviation:2.094306472547166Testexectimesec:104.689Throughput(N)=Z二filcsX®time-Theindex1WiWMdenotestheindividualmaptasks3.2读测试读1

8、0个1000M的文件lroot@hadoop1hadoop]#hadoopjarhadoop-test-1.0.2.jarTestDFSIO-read・nrFiles10-fileSize1000结杲：TestDFSIO:readDate&time:TueJul1011:03:14CST2012Numberoffiles:10TotalMBytesprocessed:10000Throughputmb/sec:41.544111537630656AverageIOratemb/sec:44.81391143798828IOrates

9、tddeviation:13.201496268890057Testexectimesec:67.595清除测试数据[root@hadooplhadoop]#hadoopjarhadoop-test-1.0.2.jarTestDFSI