资源描述:
《Mechanical Cheat Spamming Schemes and Adversarial Techniques on Crowdsourcing Platforms机械欺骗:众包平台上的垃圾邮件方案和对抗技术》由会员上传分享,免费在线阅读,更多相关内容在学术论文-天天文库。
1、MechanicalCheat:SpammingSchemesandAdversarialTechniquesonCrowdsourcingPlatformsDjellelEddineDifallah,GianlucaDemartini,andPhilippeCudré-MaurouxeXascaleInfolabU.ofFribourg—Switzerland{firstname.lastname}@unifr.chABSTRACTincludeimageannotation,relevancejudgement,sentimentanalysis,language
2、translation,etc.Currently,crowdsouc-Crowdsourcingisbecomingavaluablemethodforcompanies1ingplatformslikeAmazonMechanicalTurk(AMT)allowandresearcherstocompletescoresofmicro-tasksbymeansrequesterstocreatetasksintheformofwebpages,decideofopencallsondedicatedonlineplatforms.Crowdsourcingonh
3、owmuchtopaypertask,andrestrictparticipantsbyresultsremainsunreliable,however,asthoseplatformsnei-declaringltersonacceptancerate,country,etc.Oncethetherconveymuchinformationabouttheworkers'identitytasksarecompleted,therequestergetsbackresultsinthenordotheyensurethequalityoftheworkdone.
4、Instead,itformofrawlesfromwhichtheyaresupposedtolteroutistheresponsibilityoftherequestertolteroutbadworkers,badanswers,anddecidewhetherornottopayforeachpoorlyaccomplishedtasks,andtoaggregateworkerresultsgivenanswer.Oneparticularappealofcrowdsourcingistoinordertoobtainanaloutcome.In
5、thispaper,werstre-completelargecollectionsoftasksthatarequestercannotviewtechniquescurrentlyusedtodetectspammersandma-dobyhimselfinareasonableamountoftime;hence,goingliciousworkers,whethertheyarebotsorhumansrandomlythroughalltheresponsemanuallyisalsonotpractical.orsemi-randomlycomplet
6、ingtasks;then,wedescribetheCrowdsourcingcallsattractsdierentcategoriesofpoten-limitationsofexistingtechniquesbyproposingapproachestialworkers;astudyofthedemographicsshowedthatwork-thatindividuals,orgroupsofindividuals,couldusetoat-ersarespreadovercountryclusters(mostlyinIndiaandtackat
7、askonexistingcrowdsourcingplatforms.WefocusUSA),ageandoccupation.Theincentivesforcompletingoncrowdsourcingrelevancejudgementsforsearchresultsasataskvariespertasktypeandperindividuals.Formoreaconcreteapplicationofourtechniques.than50%oftheIndianworkers,forinstance,crowdsourcing2isapri