资源描述:
《What is a Question Crowdsourcing Tweet Categorization什么是问题?众包推特分类》由会员上传分享,免费在线阅读,更多相关内容在学术论文-天天文库。
1、WhatisaQuestion?CrowdsourcingTweetCategorizationSharodaA.Paul,LichanHong,EdH.ChiPaloAltoResearchCenter3333CoyoteHillRd,PaloAlto,CA94304.{spaul,hong}@parc.com,chi@acm.orgABSTRACTfollowersonTwitter,naturallyduringtheirnormaluseofOnemajorwayinwhichAmazonMechani
2、calTurkhastheservice.beenusedisinthehumanlabeling(orcoding)ofdata,suchOneofthemainchallengesforuswastoidentifytweetsasastherelevanceofsearchresultsorqualityofWikipediaquestionsduetoseveralreasons:articles.Recently,weusedAmazonMechanicalTurkforclassifyingorla
3、belingTwitterupdatesasquestionsornot.•First,tweetshavedevelopedauniqueconventionforWepresentthedesignofourstudyandthestepsthatwetheuseoflanguage,whichcombinedwiththeir140-tooktoaddressthechallengeswefacedinusingcharacterlengthlimitation,canmakethemhardtoMech
4、anicalTurkforthislabelingtask.Wealsopresentourunderstand.findingsandsomelessonslearntabouttheutilityand•Second,tweetsoftencontainlittlecontext,sincetheyeffectivenessofusingmicro-taskmarketsforconductingaretargetedatfriendswhotypicallyalreadyknowalotlarge-sca
5、lestudiesinvolvinghuman-intelligencetasks.ofcontextabouttheuser.Hence,fromathirdpersonperspective,itwashardtodeterminewhichtweetsAuthorKeywordsSocialQ&A,socialsearch,Twitter,MechanicalTurk.werequestionsaskedbytheTwitterusertotheirsocialnetwork.ACMClassificat
6、ionKeywords•Third,wewereconcernedaboutintroducingourownH5.3.Groupandorganizationalinterfaces:Web-basedbiasregardingwhatisaquestionandwhatisnot.interaction.•Finally,themanualclassificationofthousandsofINTRODUCTIONtweetswastime-consuming,andhencenotscalable.Re
7、searchersareincreasinglyusingAmazonMechanicalWehypothesizedthatMechanicalTurkcouldhelpusdealTurktosourcemicro-tasksthatrequirehumanintelligence,withthesechallenges.Wecrowd-sourcedtheclassificationsuchascategorizationoftextorlabelingofimages[1,4].oftweetsasqu
8、estionsandtriedtoleveragethescalabilityHowever,therearevariouschallengestousingMechanicalandlow-costofusingMechanicalTurk.Turkthatraisequestionsaboutwhetheritisavalidmethodforlabelingandacquirin