【5A文】迁移学习算法研究.ppt

《【5A文】迁移学习算法研究.ppt》由会员上传分享，免费在线阅读，更多相关内容在工程资料-天天文库。

1、【5A文】迁移学习算法研究TrainingDataClassifierUnseenData(…,long,T)good!Whatif…2021/7/142传统监督机器学习(1/2)[fromProf.QiangYang]传统监督机器学习(2/2)2021/7/143传统监督学习同源、独立同分布两个基本假设标注足够多的训练样本在实际应用中通常不能满足！训练集测试集分类器训练集测试集分类器迁移学习2021/7/144实际应用学习场景HP新闻Lenovo新闻不同源、分布不一致人工标记训练样本，费时耗力迁移学习运用已有的知识对不同但相关领域问题进行求解的

2、一种新的机器学习方法放宽了传统机器学习的两个基本假设迁移学习场景(1/4)2021/7/145迁移学习场景无处不在迁移知识迁移知识图像分类HP新闻Lenovo新闻新闻网页分类迁移学习场景(2/4)异构特征空间2021/7/146Theappleisthepomaceousfruitoftheappletree,speciesMalusdomesticaintherosefamilyRosaceae...BananaisthecommonnameforatypeoffruitandalsotheherbaceousplantsofthegenusM

3、usawhichproducethiscommonlyeatenfruit...Training:TextFuture:ImagesApplesBananas[fromProf.QiangYang]XinJin,FuzhenZhuang,SinnoJialinPan,ChangyingDu,PingLuo,QingHe:HeterogeneousMulti-taskSemanticFeatureLearningforClassification.CIKM2015:1847-1850.TestTestTrainingTrainingClassifi

4、erClassifier72.65%DVDElectronicsElectronics84.60%ElectronicsDrop!迁移学习场景(3/4)2021/7/147[fromProf.QiangYang]迁移学习场景(4/4)2021/7/148DVDElectronicsBookKitchenClothesVideogameFruitHotelTeaImpractical![fromProf.QiangYang]OutlineConceptLearningforTransferLearningConceptLearningbasedon

5、Non-negativeMatrixTri-factorizationforTransferLearningConceptLearningbasedonProbabilisticLatentSemanticAnalysisforTransferLearningTransferLearningusingAuto-encodersTransferLearningfromMultipleSourceswithAutoencoderRegularizationSupervisedRepresentationLearning:TransferLearnin

6、gwithDeepAuto-encoders2021/7/149ConceptLearningbasedonNon-negativeMatrixTri-factorizationforTransferLearning2021/7/14ConceptLearningforTransferLearning10Introduction2021/7/14ConceptLearningforTransferLearning11Manytraditionallearningtechniquesworkwellonlyundertheassumption:Tr

7、ainingandtestdatafollowthesamedistributionTraining(labeled)ClassifierTest(unlabeled)FromdifferentcompaniesEnterpriseNewsClassification:includingtheclasses“ProductAnnouncement”,“Businessscandal”,“Acquisition”,……Productannouncement:HP'sjust-releasedLaserJetProP1100printerandthe

8、LaserJetProM1130andM1210multifunctionprinters,price…performance...An