Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition History, Trends, and Affect-related Applications

《Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition History, Trends, and Affect-related Applications》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、1SurveyonRGB,3D,Thermal,andMultimodalApproachesforFacialExpressionRecognition:History,Trends,andAffect-relatedApplicationsCiprianA.Corneanu,MarcOliu,JeffreyF.Cohn,andSergioEscaleraAbstract—Facialexpressionsareanimportantwaythroughwhichhumansinteractsociall

2、y.Buildingasystemcapableofautomaticallyrecognizingfacialexpressionsfromimagesandvideohasbeenanintensefieldofstudyinrecentyears.Interpretingsuchexpressionsremainschallengingandmuchresearchisneededaboutthewaytheyrelatetohumanaffect.Thispaperpresentsageneralov

3、erviewofautomaticRGB,3D,thermalandmultimodalfacialexpressionanalysis.Wedefineanewtaxonomyforthefield,encompassingallstepsfromfacedetectiontofacialexpressionrecognition,anddescribeandclassifythestateoftheartmethodsaccordingly.Wealsopresenttheimportantdatasets

4、andthebench-markingofmostinfluentialmethods.Weconcludewithageneraldiscussionabouttrends,importantquestionsandfuturelinesofresearch.IndexTerms—FacialExpression,Affect,EmotionRecognition,RGB,3D,Thermal,Multimodal.F1INTRODUCTIONACIALexpressions(FE)arevitalsign

5、alingsystemsofFaffect,conveyingcuesabouttheemotionalstateofper-sons.Togetherwithvoice,language,handsandpostureofthebody,theyformafundamentalcommunicationsystembetweenhumansinsocialcontexts.AutomaticFErecog-nition(AFER)isaninterdisciplinarydomainstandingatt

6、hecrossingofbehavioralscience,neurology,andartificialintelligence.Studiesofthefaceweregreatlyinfluencedinpremoderntimesbypopulartheoriesofphysiognomyandcreationism.Physiognomyassumedthataperson’scharacterorperson-alitycouldbejudgedbytheirouterappearance,espe

7、ciallyFig.1:Inthe19thcentury,DuchennedeBoulogneconductedexperimentsonhowFEsareproduced.From[4].theface[1].LeonardoDaVinciwasoneofthefirsttorefutesuchclaimsstatingtheywerewithoutscientificsupport[2].cles(seeFigure1).ApproximatelyinthesamehistoricalInthe17thce

8、nturyinEngland,JohnBuwlerstudiedhumanperiod,CharlesDarwinfirmlyplacedFEinanevolutionarycommunicationwithparticularinterestinthesignlanguagecontext[5].Thismarkedthebeginningofmodernresearchofpersonswithhearingi