资源描述：
《Developing Crowdsourced Ontology Engineering Tasks An iterative process 发展众源本体工程任务：一个迭代过程》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、DevelopingCrowdsourcedOntologyEngineeringTasks:AniterativeprocessJonathanM.Mortensen,MarkA.Musen,NatalyaF.NoyStanfordCenterforBiomedicalInformaticsResearchStanfordUniversity,StanfordCA94305,USAAbstract.ItisincreasinglyevidentthattherealizationoftheSeman-tic
2、Webwillrequirenotonlycomputation,butalsohumancontribution.Crowdsourcingisbecomingapopularmethodtoinjectthishumanele-ment.Researchershaveshownhowcrowdsourcingcancontributetoman-agingsemanticdata.Oneparticularareathatrequiressigni canthumancurationisontologye
3、ngineering.Verifyinglargeandcomplexontologiesisachallengingandexpensivetask.Recently,wehavedemonstratedthatonline,crowdsourcedworkerscanassistwithontologyveri cation.Speci cally,inourworkwesoughttoanswerthefollowingdrivingques-tions:(1)Iscrowdsourcingontolo
4、gyveri cationfeasible?(2)Whatistheoptimalformulationoftheveri cationtask?(3)Howdoesthiscrowd-sourcingmethodperforminanapplication?Inthiswork,wesummarizetheexperimentswedevelopedtoanswerthesequestionsandtheresultsofeachexperiment.Throughiterativetaskdesign,w
5、efoundthatworkerscouldreachanaccuracyof88%whenverifyingSNOMEDCT.Wethendiscussthepracticalknowledgewehavegainedfromtheseexperiments.Thisworkshowsthepotentialthatcrowdsourcinghastoo erotheron-tologyengineeringtasksandprovidesatemplateonemightfollowwhendevelop
6、ingsuchmethods.1BackgroundResearchcommunitieshavebegunusingcrowdsourcingtoassistwithmanagingthemassivescaleofdatawehavetoday.Indeed,certaintasksarebettersolvedbyhumansthanbycomputers.Inthelifesciences,Zooniverse,aplatformwhereincitizenscientistscontributeto
7、largescalestudies,asksuserstoperformtaskssuchasclassifyingmillionsofgalaxiesoridentifyingcancercellsinanimage[8].Inrelatedwork,VonAhnandcolleaguesdevelopedgameswithapurpose,atypeofcrowdsourcingwhereparticipantsplayagame,andasaresulthelpcom-pletesomemeaningf
8、ultask.Forexample,inFold.it,gamersassistwithfoldingaprotein,acomputationallychallengingtask[4].Furtherdemonstratingthepowerofthecrowd,Bernsteinetal.developedasystemthatusesthecrowdtoquicklyandaccuratel
