Learning to Compare Image Patches via Convolutional Neural Networks

《Learning to Compare Image Patches via Convolutional Neural Networks》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、LearningtoCompareImagePatchesviaConvolutionalNeuralNetworksSergeyZagoruykoNikosKomodakisUniversiteParisEst,EcoledesPontsParisTechUniversiteParisEst,EcoledesPontsParisTechsergey.zagoruyko@imagine.enpc.frnikos.komodakis@enpc.frAbstractsimilarityInthispaperweshowhowtolearndirectlyfromimagedata(i.e.

2、,withoutresortingtomanually-designedfeatures)decisionnetworkageneralsimilarityfunctionforcomparingimagepatches,whichisataskoffundamentalimportanceformanycom-ConvNetputervisionproblems.Toencodesuchafunction,weoptforaCNN-basedmodelthatistrainedtoaccountforawidevarietyofchangesinimageappearance.Tot

3、hatend,weexploreandstudymultipleneuralnetworkarchitectures,whicharespecificallyadaptedtothistask.Weshowthatsuchanapproachcansignificantlyoutperformthestate-of-patch1patch2the-artonseveralproblemsandbenchmarkdatasets.Figure1.Ourgoalistolearnageneralsimilarityfunctionforim-agepatches.Toencodesuchafu

4、nction,herewemakeuseofand1.Introductionexploreconvolutionalneuralnetworkarchitectures.Comparingpatchesacrossimagesisprobablyoneofthesoftware)largedatasetsthatcontainpatchcorrespondencesmostfundamentaltasksincomputervisionandimageanal-betweenimages[22].Thisbegsthefollowingquestion:canysis.Itisoft

5、enusedasasubroutinethatplaysanimportantwemakeproperuseofsuchdatasetstoautomaticallylearnroleinawidevarietyofvisiontasks.Thesecanrangefromasimilarityfunctionforimagepatches?low-leveltaskssuchasstructurefrommotion,widebaselineThegoalofthispaperistoaffirmativelyaddressthematching,buildingpanoramas,a

6、ndimagesuper-resolution,abovequestion.Ouraimisthustobeabletogenerateauptohigher-leveltaskssuchasobjectrecognition,imagepatchsimilarityfunctionfromscratch,i.e.,withoutattempt-retrieval,andclassificationofobjectcategories,tomentioningtouseanymanuallydesignedfeaturesbutinsteaddi-afewcharacteristicex

7、amples.rectlylearnthisfunctionfromannotatedpairsofrawimageOfcourse,theproblemofdecidingiftwopatchescorre-patches.Tothatend,inspiredalsobytherecentadvancesinspondtoeachotherornotisquitechallengingasthereexistneuralarchitectur