Natural Language Processing

《Natural Language Processing》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、NaturalLanguageProcessing:AlgorithmsandApplications,OldandNewNoahSmith2015CarnegieMellonUniversity!UniversityofWashingtonWSDMWinterSchool,January31,2015OutlineI.IntroductiontoNLPII.AlgorithmsforNLPIII.ExampleapplicationsPartIIntroductiontoNLPWhyNLP?analysistext/speech?generat

2、ionWhatdoesitmeantoknow"alanguage?LevelsofLinguisticKnowledgespeechtextphoneticsorthographyphonologymorphology"shallower"syntaxsemantics"deeper"pragmaticsdiscourseOrthographicKnowledgeRequiredลูกศิษย์วัดกระทิงยังยื้อปิดถนนทางขึ้นไปนมัสการพระบาทเขาคิชฌกูฏหวิดปะทะกับเจ้าถิ่นที่

3、ออกมาเผชิญหน้าเพราะเดือดร้อนสัญจรไม่ได้ผวจ.เร่งทุกฝ่ายเจรจาก่อนที่ชื่อเสียงของจังหวัดจะเสียหายไปมากกว่านี้พร้อมเสนอหยุดจัดงาน15วัน....MorphologicalKnowledgeRequireduygarlastramadklarmzdanmssnzcasna(behaving)asifyouareamongthosewhomwecouldnotcivilize"Aship-shippingshi

4、p,shippingshipping-ships.(Syntacticknowledgerequired.)analysistext/speech?generationExample:Part-of-SpeechTagging(Gimpeletal.,2011;Owoputietal.,2013)ikrsmhheaskedryolastnamesohecanadduonfblolololExample:Part-of-SpeechTagging(Gimpeletal.,2011;Owoputietal.,2013)Iknow,rightshake

5、myheadforyourikrsmhheaskedryolastnameyouFacebooklaughoutloudsohecanadduonfblolololExample:Part-of-SpeechTagging(Gimpeletal.,2011;Owoputietal.,2013)Iknow,rightshakemyheadforyourikrsmhheaskedryolastname!GOVPDANinterjectionacronympronounverbprep.det.adj.nounyouFacebooklaughoutl

6、oudsohecanadduonfblolololPOVVOP^!prepositionpropernounPartIIAlgorithmsforNLPAStartingPoint:CategorizingTextsMostellerandWallace(1963)automaticallyinferredtheauthorsofthedisputedFederalistPapers.Manyotherexamples:INews:politicsvs.sportsvs.businessvs.technology...IReviewsoflms,

7、restaurants,products:postivevs.negativeIEmail:spamvs.notIWhatisthereadinglevelofapieceoftext?IHowin uentialwillascienticpaperbe?IWillapieceofproposedlegislationpass?CategorizingTexts:AStandardLineofAttack1.Humanexpertslabelsomedata.2.FeedthedatatoalearningalgorithmLthatconstr

8、uctsanautomaticlabelingfunction(classier)C.3.Applythatfuncti