资源描述:
《子空间半监督fisher判别分析》由会员上传分享,免费在线阅读,更多相关内容在行业资料-天天文库。
1、Vol.35,No.12ACTAAUTOMATICASINICADecember,2009SubspaceSemi-supervisedFisherDiscriminantAnalysisYANGWu-Yi1,2,3LIANGWei1XINLe4ZHANGShu-Wu1AbstractFisherdiscriminantanalysis(FDA)isapopularmethodforsuperviseddimensionalityreduction.FDAseeksforanembeddingtransformationsuchthattheratioofthebetwee
2、n-classscattertothewithin-classscatterismaximized.Labeleddata,however,oftenconsumemuchtimeandareexpensivetoobtain,astheyrequiretheeffortsofhumanannotators.Inordertocopewiththeproblemofeffectivelycombiningunlabeleddatawithlabeleddatatofindtheembeddingtransformation,weproposeanovelmethod,calledsu
3、bspacesemi-supervisedFisherdiscriminantanalysis(SSFDA),forsemi-superviseddimensionalityreduction.SSFDAaimstofindanembeddingtransformationthatrespectsthediscriminantstructureinferredfromthelabeleddataandtheintrinsicgeometricalstructureinferredfromboththelabeledandunlabeleddata.WealsoshowthatSS
4、FDAcanbeextendedtononlineardimensionalityreductionscenariosbyapplyingthekerneltrick.Theexperimentalresultsonfacerecognitiondemonstratetheeffectivenessofourproposedalgorithm.KeywordsFisherdiscriminantanalysis(FDA),semi-supervisedlearning,manifoldregularization,dimensionalityreductionIncasesofm
5、achinelearninganddatamining,suchasimageretrieval,andfacerecognition,wemayincreasinglyconfrontwiththecollectionofhigh-dimensionaldata.Thisleadsustoconsidermethodsofdimensionalityreductionthatallowustorepresentthedatainalowerdimensionalspace.Techniquesfordimensionalityreductionhaveat-tractedmu
6、chattentionincomputervisionandpatternrecognition.Themostpopulardimensionalityreductional-gorithmsincludeprincipalcomponentanalysis(PCA)[1−2]andFisherdiscriminantanalysis(FDA)[3].PCAisanunsupervisedmethod.Itprojectstheoriginalm-dimensionaldataintoad(d¿m)-dimensionalsubspaceinwhichthedatavaria
7、nceismaximized.Itcomputestheeigenvectorsofthedatacovariancematrix,andapprox-imatestheoriginaldatabyalinearcombinationoftheleadingeigenvectors.Ifthedataareembeddedinalinearsubspace,PCAisguaranteedtodiscoverthedimensionalityofthesubspaceandproducesac