资源描述:
《直接搜索算法》由会员上传分享,免费在线阅读,更多相关内容在行业资料-天天文库。
1、Directsearchmethods:thenandnow直接搜索法:历史和现状RobertMichaelLewisa,1,VirginiaTorezona,b,*,2,MichaelW.Trossetc,aaICASE,MailStop132C,NASALangleyResearchCenter,Hampton,VA23681-2199.USAbDepartmentofComputerScience,CollegeofWilliam&Mary,P.O.Box8795,Williamsburg,VA23187-8795,USAcDepartmentofMathematic
2、s,CollegeofWilliam&Mary,P.O.Box8795,Williamsburg,VA23187-8795,USAReceived1July1999;receivedinrevisedform23February2000Abstract摘要我们讨论无约束优化的直接搜索法。我们从现在的观点来看这类与导数无关的算法,主要集中在1960到1971年的直接搜索法发展的黄金时期。我们首先讨论在未构建目标模型的情况怎样使用直接搜索法。然后我们考虑一些经典直接搜索法并揭示那些年这类算法的进展。特别地,当原始直接搜索法开始直接利用启发式方法时,更多近来的分析表明,虽然不是全
3、部但大部分启发式方法实际上已经足可以保证迭代序列中至少有一个子序列全局收敛到目标函数的一阶驻点。关键词:求导无关优化;直接搜索法;模式搜索法Wediscussdirectsearchmethodsforunconstrainedoptimization.Wegiveamodernperspectiveonthisclassicalfamilyofderivative-freealgorithms,focusingonthedevelopmentofdirectsearchmethodsduringtheirgoldenagefrom1960to1971.Wediscussh
4、owdirectsearchmethodsarecharacterizedbytheabsenceoftheconstructionofamodeloftheobjective.Wethenconsideranumberoftheclassicaldirectsearchmethodsanddiscusswhatresearchintheinterveningyearshasuncoveredaboutthesealgorithms.Inparticular,whiletheoriginaldirectsearchmethodswereconsciouslybasedons
5、traightforwardheuristics,morerecentanalysishasshownthatinmost–butnotall–casestheseheuristicsactuallysufficetoensureglobalconvergenceofatleastonesubsequenceofthesequenceofiteratestoafirst-orderstationarypointoftheobjectivefunction.©2000ElsevierScienceB.V.Allrightsreserved.Keywords:Derivativ
6、e-freeoptimization;Directsearchmethods;Patternsearchmethods1.Introduction1.引言罗伯特·胡克和T.A.捷吾斯首先在1961年的计算机械协会期刊上的一篇论文上提出“直接搜索”[12].在他们的论文的引言中这样描述直接搜索:RobertHookeandT.A.Jeevescoinedthephrase“directsearch”inapaperthatappearedin1961inthejournaloftheAssociationofComputingMachinery[12].TheyProvide
7、dthefollowingdescriptionofdirectsearchintheintroductiontotheirpaper:*Correspondingauthor.E-mailaddressed:bucharoo@icase.edu(R.M.Lewis),va@cs.wm.edu(V.Torczon),trosset@math.wm.edu(M.W.Trosset).1ThisresearchwassupportedbytheNationalAeronauticsandSpaceAdministrat