资源描述：
《2.6亿条数据测试》由会员上传分享，免费在线阅读，更多相关内容在教育资源-天天文库。
1、1测试环境使用4台32g内存24核服务器进行测试。在2.6亿条数据下进行测试，ddl.sql语句如下：CREATETABLEYH_DYYH(HHVARCHAR(25)NOTNULL,CJDYIDVARCHAR(25)NOTNULL,DWDMVARCHAR(25)NOTNULL,TQIDVARCHAR(25)NOTNULL,YHLXVARCHAR(25)NOTNULL,SFYZXVARCHAR(25)NOTNULL,AZRQVARCHAR(25)NOTNULL,PRIMARYKEY(HH));PARTITIONTAB
2、LEYH_DYYHONCOLUMNHH;CREATETABLESB_DYSJZB(SJIDVARCHAR(25)NOTNULL,DWDMVARCHAR(25)NOTNULL,HHVARCHAR(25)NOTNULL,ZDJHVARCHAR(25)NOTNULL,CLDJHVARCHAR(25)NOTNULL,BJZSBLFLOAT,SFYXINt,PRIMARYKEY(SJID));PARTITIONTABLESB_DYSJZBONCOLUMNHH;CREATETABLESB_DYDLSJ(SJIDVARCHAR(
3、25)NOTNULL,SJSJVARCHAR(25)NOTNULL,CTFLOAT,PTFLOAT,ZXYGZFLOAT,ZXYGZ1FLOAT,ZXYGZ2FLOAT,ZXYGZ3FLOAT,ZXYGZ4FLOAT,BQBJINt,PRIMARYKEY(SJID,SJSJ));PARTITIONTABLESB_DYDLSJONCOLUMNSJID;CREATEINDEXHHINDEXONYH_DYYH(HH);1csvloader工具加载数据对加载数据的测试，对YH_DYYH表加载1000w条数据，对SB_DYS
4、JZB加载5000w条数据，对SB_DYDLSJ表加载1.5亿条数据，分步进行执行，每个文件保存5000w条数据。下面主要针对加载时间和每秒执行的事务数进行测试，测试结果如下：加载YH_DYYH表数据：csvloaderelaspsed:125.827secondsNumberofrowsreadfrominput:10000000Numberofrowssuccessfullyinserted:10000000Numberofrowsthatcouldnotbeinserted:0CSVLoaderrate:79
5、474.195row/s加载SB_DYSJZB表数据：CSVLoaderelapsed:642.436secondsNumberofrowsreadfrominput:50000000Numberofrowssuccessfullyinserted:50000000Numberofrowsthatcouldnotbeinserted:0CSVLoaderrate:77828.764row/s加载SB_DYDLSJ表数据:csvloaderelaspsed:879.899secondsNumberofrowsread
6、frominput:50000000Numberofrowssuccessfullyinserted:50000000Numberofrowsthatcouldnotbeinserted:0CSVLoaderrate:56824.703row/scsvloaderelaspsed:763.452secondsNumberofrowsreadfrominput:50000000Numberofrowssuccessfullyinserted:50000000Numberofrowsthatcouldnotbeinse
7、rted:0CSVLoaderrate:65492.002row/scsvloaderelaspsed:733.842secondsNumberofrowsreadfrominput:50000000Numberofrowssuccessfullyinserted:50000000Numberofrowsthatcouldnotbeinserted:0CSVLoaderrate:68134.557row/s1占用空间导入数据的文件大小YH_DYYH占磁盘空间大小为557M，SB_DYSJZB表占用磁盘空间大小为2.
8、6G,SB_DYDLSJ表占用磁盘空间大小为18.9G，总共的磁盘空间占用22G左右。主要进行测试数据的磁盘占用空间和导入后内存占用空间，现在测试kfactor=0的情况下内存占用空间情况，调用系统存储过程，得到集群中每个节点内存占用情况。测试结果如下：TIMESTAMPHOST_IDHOSTNAMERSSJAVAUSEDJAVAUNUSEDTUPLEDAT
