资源描述：
《A Review of Strategies for Validating Computer-Automated Scoring》由会员上传分享，免费在线阅读，更多相关内容在行业资料-天天文库。
1、APPLIEDMEASUREMENTINEDUCATION,15(4),391–412Copyright©2002,LawrenceErlbaumAssociates,Inc.AReviewofStrategiesforValidatingComputer-AutomatedScoringYongweiYangTheGallupOrganizationLincoln,NEChadW.BuckendahlUniversityofNebraska–LincolnPiotrJ.JuszkiewiczandDennisonS.BholaTheG
2、allupOrganizationLincoln,NEComputer-automatedscoring(CAS)isbecomingapopulartoolinassessment.Vari-ousstudieshavebeenconductedtoassessthequalityofCAS-system-generatedscores.Thereisthenaneedforasystematicexaminationofthesestudiesinthecontextofcontemporaryvalidityconceptsand
3、currentpractice.ThisarticlestartswithabriefintroductiontocurrentCASsystems.Next,wereviewthecurrentpracticeofvalidatingCAS-system-generatedscores.Finally,wepresentaconceptualframeworkandgen-eralrecommendationsfordesigningvalidationstudiesforCASprocedures.Withtheadventofne
4、wtechnologies,computer-automatedscoring(CAS)systemsforscoringconstructed-responseandperformanceactivities(e.g.,essay)areemerg-ingaspopulartoolsinvarioustestingprograms.DifferentCASprocedureshaveyieldedarangeofresultsbut,generally,ahighlevelofcorrespondencebetweenthescore
5、sproducedbyhumanscorersandCASsystemsisreported.Althoughthisevidenceofreliabilityisvaluable,questionsariseaboutthevalidityofthescoresgeneratedfromthesescoringprocesses.IfcomparableresultsaregeneratedusingaCASsystem,whatarethetheoreticalandempiricalimplicationsthatarisefro
6、musingthisnewtechnology?RequestsforreprintsshouldbesenttoYongweiYang,TheGallupOrganization,301South68thStreetPlace,Lincoln,NE68510.E-mail:yongwei_yang@gallup.com392YANG,BUCKENDAHL,JUSZKIEWICZ,BHOLAAlthoughageneralframeworkforavalidationdesignhasbeenofferedinthecomputeriz
7、edtestingarena(Bennett&Bejar,1998),moresystematicexamina-tionsofCASsystemsinthecontextofcurrentpracticeandcontemporaryvalidityconceptsneedtobepresented.Theseexaminationswillprovideamorecompre-hensiveevaluationofthequalityofthevalidityevidencereportedinthesenewerareasofte
8、sting.Thisarticlepresentsaconceptualframeworkfordesigningvalida-tionstudiesforCASprocedures.Webaseourco
