WEB中文文本聚类分类系统的设计与实现

《WEB中文文本聚类分类系统的设计与实现》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、西南交通大学硕士学位论文WEB中文文本聚类分类系统的设计与实现姓名：张宇申请学位级别：硕士专业：计算机应用技术指导教师：唐慧佳20090501西南交通大学硕士研究生学位论文第1I页ABSTRACT’IbxtclassificationandclusteringiSoneofthemostvaluableTechnologiesin‘‘TextInformationProcessing’’areathatarousesextensivestudyoftheorganization，managementandProcessingoflargea

2、mountoftextdata，whichlocaterequiredinformationswiftly,accuratelyandcomprehensively．Textclassificationandclustering，thekeytechnologyinorganizingandprocessinglargemountoftextdata,Cansolvetheproblemofinformationexplosiontoagreatextent．Moreover,textclassificationandclusteringw

3、illbewidelyappliedasthetechnicalbasisofinformationretrieval，searchengine，textdatabase，anddigitallibraryandSOon．Withtheadventoftheinformationera,textclassificationandclusteringisbecominghighlighting．ThispaperfirstlyintroducedWebminingintheoryandanalyzeditsdifference．Twoimpo

4、rtantbranchesofclusteringandclassificationaswellastherelevanceofthetheoryinWebminingwerealsointroduced．Secondly,thecharacteristicexpressionandcharacteristicweightsinWebdocumentswerestudiedsystematically,softwareofanalyzingHTMLfiles，extractionfeatures，weightscalculation,clu

5、stering，classification,resultvisualizationWasdeveloped，andthesoftwareadoptedthemulti-threadingtechnique．Thecommonclusteringalgorithmforclusteringwereintroducedandrealizedinthispaper．FourmostcommonlyusedclusteringalgorithmincludingK—meansalgorithm，fuzzyC·meansalgorithm(FCM)

6、，HierarchicalAgglomerativeClustering(HAC)algorithmandparticleswarmoptimization(PSO)algorithmwereadopted．Italsogaveacorrespondingintroductionofprincipalcomponentanalysis(PCA)．TheeffectofdimensionalityreductionWasachievedthroughprincipalcomponentanalysisofhigh-dimensionaldat

7、a．Finallythefirsttwo·dimensionofPCAtransformingwasselectedforplanarvisualization．ThepaperanalyzeddeficienciesofthetraditionalparticleswarRloptimizationalgorithm,andproposedanovelParticleSwarmOptimizationClusteringAlgorithmBasedonDensityandPSOinitializationmethod．Thealgorit

8、hmnotonlypossessesthecharacteristicofglobesearchingcapabilitybutalsoconsidersdistribution