资源描述:
《利用空间上下文做物件识别》由会员上传分享,免费在线阅读,更多相关内容在教育资源-天天文库。
1、利用空间上下文寻找识别物体原作者:GeremyHeitz,DaphneKollerStanfordUniversityThingsvs.StuffStuff(n):Materialdefinedbyahomogeneousorrepetitivepatternoffine-scaleproperties,buthasnospecificordistinctivespatialextentorshape.Thing(n):Anobjectwithaspecificsizeandshape.From:Forsyth
2、etal.Findingpicturesofobjectsinlargecollectionsofimages.ObjectRepresentationinComputerVision,1996.FindingThingsContextiskey!OutlineWhatisContext?TheThingsandStuff(TAS)modelResultsSatelliteDetectionExampleD(W)=0.8D(W)=0.8ErrorAnalysisTypically…Weneedtolookout
3、sidetheboundingbox!FalsePositivesareOUTOFCONTEXTTruePositivesareINCONTEXTTypesofContextScene-Thing:Stuff-Stuff:gistcar“likely”keyboard“unlikely”Thing-Thing:[Torralbaetal.,LNCS2005][Gouldetal.,IJCV2008][Rabinovichetal.,ICCV2007]TypesofContextStuff-Thing:Ba
4、sedonspatialrelationshipsIntuition:Trees=nocarsHouses=carsnearbyRoad=carshere“Carsdriveonroads”“Cowsgrazeongrass”“Boatssailonwater”Goal:UnsupervisedOutlineWhatisContext?TheThingsandStuff(TAS)modelResultsThingsDetection“candidates”Lowdetectorthreshold->“over-
5、detect”EachcandidatehasadetectorscoreThingsCandidatedetectionsImageWindowWi+ScoreBooleanR.V.TiTi=1:CandidateisapositivedetectionThingmodelTiImageWindowWiStuffCoherentimageregionsCoarse“superpixels”FeaturevectorFjinRnClusterlabelSjin{1…C}StuffmodelNaïveBayes
6、SjFjRelationshipsDescriptiveRelations“Near”,“Above”,“Infrontof”,etc.ChoosesetR={r1…rK}Rijk=1:DetectioniandregionjhaverelationkRelationshipmodelS72=TreesS4=HousesS10=RoadT1RijkTiSjR1,10,in=1TheTASModelRijkTiSjFjImageWindowWiWi:WindowTi:ObjectPresenceSj:Regi
7、onLabelFj:RegionFeaturesRijk:RelationshipNJKSupervisedinTrainingSetAlwaysObservedAlwaysHiddenUnrolledModelT1S1S2S3S4S5T2T3R2,1,above=0R3,1,left=1R1,3,near=0R3,3,in=1R1,1,left=1CandidateWindowsImageRegionsLearningtheParametersAssumeweknowRSjishiddenEvery
8、thingelseobservedExpectation-Maximization“Contextualclustering”ParametersarereadilyinterpretableRijkTiSjFjImageWindowWiNJKSupervisedinTrainingSetAlwaysObservedAlwaysHiddenLearnedSatelliteClu