迁移学习算法研究

《迁移学习算法研究》由会员上传分享，免费在线阅读，更多相关内容在教育资源-天天文库。

1、迁移学习算法研究庄福振中国科学院计算技术研究所2016年4月18日TrainingDataClassifierUnseenData(…,long,T)good!Whatif…2传统监督机器学习(1/2)2021/8/5[fromProf.QiangYang]传统监督机器学习(2/2)32021/8/5传统监督学习同源、独立同分布两个基本假设标注足够多的训练样本在实际应用中通常不能满足！训练集测试集分类器训练集测试集分类器迁移学习42021/8/5实际应用学习场景HP新闻Lenovo新闻不同源、分布不一致人工标记训练样本，费时耗力迁移学习运用已有

2、的知识对不同但相关领域问题进行求解的一种新的机器学习方法放宽了传统机器学习的两个基本假设迁移学习场景(1/4)52021/8/5迁移学习场景无处不在迁移知识迁移知识图像分类HP新闻Lenovo新闻新闻网页分类异构特征空间6Theappleisthepomaceousfruitoftheappletree,speciesMalusdomesticaintherosefamilyRosaceae...BananaisthecommonnameforatypeoffruitandalsotheherbaceousplantsofthegenusMus

3、awhichproducethiscommonlyeatenfruit...Training:TextFuture:ImagesApplesBananas迁移学习场景(2/4)2021/8/5[fromProf.QiangYang]XinJin,FuzhenZhuang,SinnoJialinPan,ChangyingDu,PingLuo,QingHe:HeterogeneousMulti-taskSemanticFeatureLearningforClassification.CIKM2015:1847-1850.TestTestTraini

4、ngTrainingClassifierClassifier72.65%DVDElectronicsElectronics84.60%ElectronicsDrop!迁移学习场景(3/4)72021/8/5[fromProf.QiangYang]8DVDElectronicsBookKitchenClothesVideogameFruitHotelTeaImpractical!迁移学习场景(4/4)2021/8/5[fromProf.QiangYang]OutlineConceptLearningforTransferLearningConce

5、ptLearningbasedonNon-negativeMatrixTri-factorizationforTransferLearningConceptLearningbasedonProbabilisticLatentSemanticAnalysisforTransferLearningTransferLearningusingAuto-encodersTransferLearningfromMultipleSourceswithAutoencoderRegularizationSupervisedRepresentationLearni

6、ng:TransferLearningwithDeepAuto-encoders92021/8/5ConceptLearningbasedonNon-negativeMatrixTri-factorizationforTransferLearningConceptLearningforTransferLearning102021/8/5IntroductionManytraditionallearningtechniquesworkwellonlyundertheassumption:Trainingandtestdatafollowthesa

7、medistributionTraining(labeled)ClassifierTest(unlabeled)FromdifferentcompaniesEnterpriseNewsClassification:includingtheclasses“ProductAnnouncement”,“Businessscandal”,“Acquisition”,……Productannouncement:HP'sjust-releasedLaserJetProP1100printerandtheLaserJetProM1130andM1210mul

8、tifunctionprinters,price…performance...AnnouncementforLenovoThinkPadThinkCe