资源描述:
《a multimedia system for temporally situated perceptual psycholinguistic analysis》由会员上传分享,免费在线阅读,更多相关内容在教育资源-天天文库。
1、,,1{33()cKluwerAcademicPublishers,Boston.ManufacturedinTheNetherlands.AMultimediaSystemforTemporallySituatedPerceptualPsycholinguisticAnalysisyyyyFRANCISQUEK,ROBERTBRYLL,CEMILKIRBAS,HASANARSLAN,zANDDAVIDMCNEILLquek@cs.wright.eduyVisionInterfacesandSystemsLaboratoryWrightStateUniversity,Dayton,
2、OHzDepartmentofPsychologyUniversityofChicagoAbstract.Perceptualanalysisofvideo(analysisbyunaidedearandeye)playsanimportantroleinsuchdisciplinesaspsychology,psycholinguistics,linguistics,anthropology,andneurology.Inthespecicdomainofpsycholinguisticanalysisofgestureandspeech,researchersmicro-an
3、alyzevideosofsubjectsusingahighqualityvideocassetterecorderthathasadigitalfreezecapabilitydowntothespecicframe.Suchanalysesareverylaborintensiveandslow.Wepresentamultimediasystemforperceptualanalysisofvideodatausingamultiple,dynamicallylinkedrepresentationmodel.Thesystemcomponentsarelinkedthr
4、oughatimeportalwithacurrenttimefocus.Thesystemprovidesmechanismstoanalyzeoverlappinghierarchicalinterpretationsofthediscourse,andintegratesvisualgestureanalysis,speechanalysis,videogazeanalysis,andtexttranscriptionintoacoordinatedwhole.Thevariousinteractioncomponentsfacilitateaccuratemulti-poi
5、ntaccesstothedata.Whilethissystemiscurrentlyusedtoanalyzegesture,speechandgazeinhumandiscourse,thesystemdescribedmaybeapliedtoanyothereldwherecarefulanalysisoftemporalsynchroniesinvideoisimportant.Keywords:MultimediaDataVisualization;TemporalAnalysis;UserInterface;Multiple,LinkedRepresentatio
6、n;GestureCoding;Gesture,SpeechandGazeAnalysisDRAFTMarch23,2000,12:23amDRAFT21.IntroductionPerceptualanalysisofvideo(analysisbyunaidedearandeye)playsanimportantroleinsuchdisciplinesaspsychology,psycholinguistics,linguistics,anthropology,andneurology.Inthespecicdomainofpsycholinguisticanalysiso
7、fgestureandspeech,researchersmicro-analyzevideosofsubjectsusingaprofessionalqualityvideocassetterecorderthathasadigitalfreezecapabilitydowntothespecicframe.Thisisapainstakingandlaborioustask.Inourownworkontheintegratedanalysisofgesture