Building NLP Systems for Two Resource-Scarce Indigenous Languages

《Building NLP Systems for Two Resource-Scarce Indigenous Languages》由会员上传分享，免费在线阅读，更多相关内容在行业资料-天天文库。

1、BuildingNLPSystemsforTwoResource-ScarceIndigenousLanguages:MapudungunandQuechua1121ChristianMonson,AriadnaFontLlitjós,RobertoAranovich,LoriLevin,1111RalfBrown,EricPeterson,JaimeCarbonell,AlonLavie1LanguageTechnologiesInstituteSchoolofComputerScienceCarnegieMellonUniversity2DepartmentofLin

2、guisticsUniversityofPittsburghAbstractByadoptinga“first-things-first”approachweovercomeanumberofchallengesinherentindevelopingNLPSystemsforresource-scarcelanguages.Byfirstgatheringthenecessarycorporaandlexiconswearethenenabledtobuild,forMapudungun,aspelling-corrector,morphologicalanalyzer

3、,andtwoMapudungun-Spanishmachinetranslationsystems;andforQuechua,amorphologicalanalyzeraswellasarule-basedQuechua-Spanishmachinetranslationsystem.Wehavealsoworkedonlanguages(Hebrew,Hindi,Dutch,andChinese)forwhichresourcessuchaslexiconsandmorphologicalanalyzerswereavailable.Theflexibilityo

4、ftheAVENUEprojectarchitectureallowsustotakeadifferentapproachasneededineachcase.ThispaperdescribestheMapudungunandQuechuasystems.translationsandautomaticallyrefinesthetranslationrules1.TheAVENUEProject(FontLlitjósetal.2005a).Thelong-termgoaloftheAVENUEprojectatCMUistofacilitatemachinetran

5、slationforalargerpercentageof2.AVENUEandIndigenousLanguagesofthetheworld’slanguagesbyreducingthecostandtimeofWesternHemisphereproducingMTsystems.ThereareanumberofradicallyOverthepastsixyearstheAVENUEprojectattheLan-differentwaystoapproachMT.EachofthesemethodsofguageTechnologiesInstituteat

6、CarnegieMellonUniver-accomplishingmachinetranslationhasadifferentsetofsityhasworkedwithnativeinformantsandthegovern-strengthsandweaknessesandeachrequiresdifferentre-mentofChiletoproduceavarietyofnaturallanguagesourcestobuild.TheAVENUEapproachcombinestheseprocessing(NLP)toolsforMapudungun,

7、anindigenousdifferenttypesofMTinone“omnivorous”systemthatSouthAmericanlanguagespokenbylessthan1millionwill“eat”whateverresourcesareavailabletoproducethepeopleinChileandArgentina.DuringthefinalyearandhighestqualityMTpossiblegiventheresources.Ifapar-ahalfofthistime,th