05-第五讲-朱晓瑾-统计机器学习与自然语言处理

《05-第五讲-朱晓瑾-统计机器学习与自然语言处理》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、StatisticalMachineLearningforNLPXiaojinZhujerryzhu@cs.wisc.eduDepartmentofComputerSciencesUniversityofWisconsin{Madison,USACCF/ADL462013Zhu(Univ.Wisconsin)StatisticalMachineLearningforNLPCCF/ADL4620131/125Outline1BasicsofStatisticalLearningProbabilityStatisticalEstimationRegularizationDecisionTheo

2、ry2GraphicalModelsDirectedGraphicalModels(BayesianNetworks)UndirectedGraphicalModels(MarkovRandomFields)FactorGraphMarkovChainMonteCarloBeliefPropagationMeanFieldAlgorithmMaximizingProblems(Viterbi)3BayesianNon-ParametricModelsDirichletProcessesZhu(Univ.Wisconsin)StatisticalMachineLearningforNLPCC

3、F/ADL4620132/125BasicsofStatisticalLearningOutline1BasicsofStatisticalLearningProbabilityStatisticalEstimationRegularizationDecisionTheory2GraphicalModelsDirectedGraphicalModels(BayesianNetworks)UndirectedGraphicalModels(MarkovRandomFields)FactorGraphMarkovChainMonteCarloBeliefPropagationMeanField

4、AlgorithmMaximizingProblems(Viterbi)3BayesianNon-ParametricModelsDirichletProcessesZhu(Univ.Wisconsin)StatisticalMachineLearningforNLPCCF/ADL4620133/125BasicsofStatisticalLearningProbabilityOutline1BasicsofStatisticalLearningProbabilityStatisticalEstimationRegularizationDecisionTheory2GraphicalMod

5、elsDirectedGraphicalModels(BayesianNetworks)UndirectedGraphicalModels(MarkovRandomFields)FactorGraphMarkovChainMonteCarloBeliefPropagationMeanFieldAlgorithmMaximizingProblems(Viterbi)3BayesianNon-ParametricModelsDirichletProcessesZhu(Univ.Wisconsin)StatisticalMachineLearningforNLPCCF/ADL4620134/12

6、5BasicsofStatisticalLearningProbabilityProbabilityTheprobabilityofadiscreterandomvariableAtakingthevalueaisP(A=a)2[0;1].SometimeswrittenasP(a)whennodangerofconfusion.PNormalizationallaP(A=a)=1.JointprobabilityP(A=a;B=b)=P(a;b),thetwoeventsbothhappenatthesametime.PMarginalizationP(A=a)=allbP(A=a;B=

7、b),summingoutB".P(a;b)ConditionalprobabilityP(ajb)=,ahappensgivenbhappened.P(b)TheproductruleP(a;b)=P(a)P(bja)=P(b)P(ajb).Zhu(Univ.Wisconsin)StatisticalMachineLearningforNLPCCF/ADL4620135/125BasicsofStatisticalL