资源描述：
《Statistical Learning Theory》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、CS229T/STAT231:StatisticalLearningTheory(Winter2014)PercyLiangLastupdatedWedFeb12201409:24Theselecturenoteswillbeupdatedperiodicallyasthecoursegoeson.Pleaseletusknowwhenyou ndtypos.SectionA.1describesthebasicnotationandde nitions;SectionA.2describessomebasictheorems.LecturesThenotesareorganiz
2、edaccordingtotopic.However,thelecturesthemselveswilloftenspillacrosstopics,sothematerialactuallycoveredineachlectureisexplicitlydelimitedandlinkedbelow.Lecture1/6:Overview,onlinelearningLecture1/8:OnlinelearningLecture1/13:OnlinelearningLecture1/15:OnlinelearningLecture1/20:Noclass(Marti
3、nLutherKingDay)Lecture1/22:OnlinelearningLecture1/27:KernelmethodsLecture1/29:KernelmethodsLecture2/3:KernelmethodsLecture2/5:UniformconvergenceLecture2/10:UniformconvergenceLecture2/12:UniformconvergenceLecture2/17:Noclass(PresidentsDay)Lecture2/19:UniformconvergenceLecture2/24:Dir
4、ectanalysisLecture2/26:DirectanalysisLecture3/3:Spectralmethods1Lecture3/5:SpectralmethodsLecture3/10:SpectralmethodsLecture3/12:Finalprojectpresentations21Overview[beginlecture1/6](1/6)1.1Whatisthiscourseabout?Machinelearninghasbecomeanindispensiblepartofmanyapplicationareas,rangingfro
5、mscience(biology,neuroscience,psychology,astronomy,etc.)toengineering(nat-urallanguageprocessing,computervision,robotics,etc.).Butmachinelearningisnotonecoherentapproach,butratherconsistsofadazzlingarrayofseeminglydisparateframeworksandparadigmsspanningclassi cation,regression,clustering,matr
6、ixfac-torization,graphicalmodels,probabilisticprogramming,etc.Thiscoursetriestouncoverthecommonstatisticalprinciplesunderlyingthisdiversearrayoftechniques,usingtheoreticalanalysisasthemaintoolforunderstanding.Wewilltrytoanswertwoquestions:{Whendolearningalgorithmswork(orfail)?Anyonewithhands
7、-onmachinelearningexperiencewillprobablyknowthatlearningalgorithmsrarelyworkthe rsttime.Whentheydon't,adeepertheoreticalunderstandingcano eranewperspectiveandcanaidintroubleshooting.{Howdowemakelearningalgorithmsbetter?Theoreticalanalysesofte
