资源描述：
《Book reviews》由会员上传分享，免费在线阅读，更多相关内容在行业资料-天天文库。
1、ComputationalLinguisticsVolume24,Number2EvaluatingNaturalLanguageProcessingSystems:AnAnalysisandReviewKarenSparckJonesandJuliaR.Galliers(UniversityofCambridge)Berlin:Springer-Verlag(LectureNotesinComputerScience1083,editedbyG.Goos,J.HartmanisandJ.vanLeeuwen,Subseri
2、esLectureNotesinArtificialIntelligence,editedbyJ.G.CarbonellandJ.Siekmann),1995,xv+228pp;paperbound,ISBN3-540-61309-9,$43.00ReviewedbySharonM.WalterAirForceResearchLaboratoryHavingmaturedtothepointofutilityforcertaincircumscribedapplications,natu-rallanguageprocess
3、ing(NLP)technologyhasagrowingneedfortheformulationofevaluationmethodologies.EvaluatingNaturalLanguageProcessingSystems:AnAnal-ysisandReviewprovidesahistoricalperspectiveandoutlineofeffortsthathavebeenmadetoprovidemeaningfulandusefulevaluationsofNLPsystems,describes
4、thedeficienciesofthoseefforts,andoffersanevaluationapproachintendedtoaddressthosedeficiencies.EvaluatingNaturalLanguageProcessingSystemsisdividedintothreechapters.WhileChapter1purportstointroduceevaluationconceptsandterminology,theesotericpresentationstyledetractsf
5、romitsvaluefortechnologyneophytes.Thechapterdoes,however,provideagreatdealofinformationandinthecourseofdoingso,presentsrelevant,interestingissuessuchasthespecialproblemsassociatedwithevaluatingso-calledgenericsystems,andthevalueofqualitativeversus(or,inconjunctionw
6、ith)quantitativeevaluationapproaches.Chapter2isacomprehensiveandin-depthreviewofsignificantNLPevaluationresearchactivitiesandresources,rangingacrossmultiplemodalities(e.g.,speech),taskdomains(e.g.,messageprocessing),participatoryactivities(e.g.,workshops,tutori-als
7、),evaluationmethodologiesandexperimenttechniques(e.g.,Wizard-of-Ozexperi-ments),resources(e.g.,corpora,testsuites,toolkits),andresourceassociations(e.g.,theLinguisticDataConsortium).Itismadeupofthreesections.Subdivisionswithinthefirstsectionfocusonevaluationactivit
8、iesineachofthetaskareasofmachinetransla-tion,messageprocessing,databaseinquiry,speechunderstanding,summarizingandmessagecategorization.Thetaskare
