Random Testing Theoretical Results and

《Random Testing Theoretical Results and》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、Thisarticlehasbeenacceptedforpublicationinafutureissueofthisjournal,buthasnotbeenfullyedited.Contentmaychangepriortofinalpublication.IEEETRANSACTIONSONSOFTWAREENGINEERING1RandomTesting:TheoreticalResultsandPracticalImplicationsAndreaArcuri,Member,IEEE,Muha

2、mmadZohaibIqbal,Member,IEEE,andLionelBriand,Fellow,IEEE.Abstract—Asubstantialamountofworkhasshedlightonwhetherrandomtestingisactuallyausefultestingtechnique.Despiteitssimplicity,severalsuccessfulreal-worldapplicationshavebeenreportedintheliterature.Althoug

3、hitisnotgoingtosolveallpossibletestingproblems,randomtestingappearstobeanessentialtoolinthehandsofsoftwaretesters.Inthispaper,wereviewandanalyzethedebateaboutrandomtesting.Itsbenefitsanddrawbacksarediscussed.Novelresultsaddressinggeneralquestionsaboutrandom

4、testingarealsopresented,suchashowlongdoesrandomtestingneedonaveragetoachievetestingtargets(e.g.,coverage),howdoesitscaleandhowlikelyisittoyieldsimilarresultsifwere-runitonthesametestingproblem(predictability).Duetoitssimplicitythatmakesthemathematicalanaly

5、sisofrandomtestingtractable,weprovidepreciseandrigorousanswerstothesequestions.Resultsshowthattherearepracticalsituationsinwhichrandomtestingisaviableoption.Ourtheoremsarebackedupbysimulationsandweshowhowtheycanbeappliedtomosttypesofsoftwareandtestingcrite

6、ria.Inlightoftheseresults,wethenassessthevalidityofempiricalanalysesreportedintheliteratureandderiveguidelinesforbothpractitionersandscientists.IndexTerms—CouponCollector,RandomTesting,Theory,SchurFunction,Predictability,PartitionTesting,AdaptiveRandomTest

7、ing.✦1INTRODUCTIONequivalent,aswewillshow.Inparticular,theyareinstancesof1theCouponCollector’sproblem[35],whichisawellknownORMALLYprovingthatnon-trivialsoftwareiscorrecturnprobleminprobabilityanalysis.Surprisingly,tothebestF(i.e.,satisfyingtheintendedbehav

8、ior)isingeneraleitherofourknowledge,wehavenotfoundintheliteratureanyimpossibleortoodifficulttobedoneinpractice.Therefore,workconnectingrandomtestingwiththeCouponCollector’stestingisthemostcommonsoftwareverifica