资源描述：
《Referring Expression Generation and Comprehension via Attributes》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、ReferringExpressionGenerationandComprehensionviaAttributesJingyuLiu1,3LiangWang1,2,3Ming-HsuanYang41CenterforResearchonIntelligentPerceptionandComputing(CRIPAC),NationalLaboratoryofPatternRecognition(NLPR)2CenterforExcellenceinBrainScienceandIntelligenceTechnology(CEBSIT),InstituteofAutom
2、ation,ChineseAcademyofSciences(CASIA)3UniversityofChineseAcademyofSciences(UCAS)4UniversityofCalifornia,Merced{jingyu.liu,wangliang}@nlpr.ia.ac.cnmhyang@ucmerced.eduAbstractReferringexpressionisakindoflanguageexpressionthatusedforreferringtoparticularobjects.Tomaketheexpressionwithoutambi
3、guation,peopleoftenuseattributestodescribetheparticularobject.Inthispaper,weexploretheroleofattributesbyincorporatingthemintobothre-manwithredtiedonutwithholeferringexpressiongenerationandcomprehension.Wefirsttrainanattributelearningmodelfromvisualobjectsandtheirpaireddescriptions.Theninth
4、egenerationtask,wetakethelearnedattributesastheinputintothegenerationmodel,thustheexpressionsaregenerateddrivenbybothattributesandthepreviouswords.Forcomprehension,weembedthelearnedattributeswithvisualfeaturesandse-reddoubledeckerbusmostfrontelephantmanticsintothecommonspacemodel,thenthet
5、argetob-jectisretrievedbasedonitsrankingdistanceinthecommonFigure1.Someexamplesofourresults.Thefirstrowaretwospace.Experimentalresultsonthethreestandarddatasets,examplesofreferringexpressiongeneration.ThetargetobjectisRefCOCO,RefCOCO+,andRefCOCOgshowsignificantshownincontour.Thesecondroware
6、twoexamplesofreferringimprovementsoverthebaselinemodel,demonstratingthatexpressioncomprehension.Thegreenboxesaregroundtruthandourmethodiseffectiveforbothtasks.theblueboxesareretrievedboxes.naturallanguagegeneration.Ontheotherside,thetaskof1.Introductioncomprehensionrequiresthelistenertopr
7、ovehiscompre-Referringexpression[27]isaparticularkindofhu-hensionbypointingtothetargetobject’slocation,whichismanexpressionsthatfocusesoneffectivelydescribingthebasedonthequalityofthelistener’sinterpretationoftheex-uniqueobjectinsomeenvironments.Theinteractivepro-pr
